Transform bill images into actionable financial intelligence using deterministic analytics, collaborative AI reasoning, and explainable financial recommendations.
Python โข AutoGen AgentChat โข Streamlit โข Gemini โข Groq โข Plotly โข Pydantic โข EasyOCR
Demo Video:
Managing expenses involves far more than simply extracting totals from receipts.
Most expense tracking applications stop after Optical Character Recognition (OCR), leaving users to interpret their own spending behaviour.
This project extends traditional bill processing into a Financial Intelligence Platform that combines deterministic financial analytics with AutoGen-powered collaborative AI agents.
The platform processes uploaded bills, extracts structured financial information, analyzes spending patterns, detects recurring expenses, forecasts future expenditure, and generates verified financial recommendations through an AdvisorโReviewer collaboration workflow.
- ๐ OCR-based bill processing
- ๐งพ Automatic expense categorization
- ๐ Spending analytics dashboard
- ๐ Recurring expense detection
- ๐ Monthly spending forecasting
- ๐ค AutoGen Multi-Agent collaboration
- ๐ง AdvisorโReviewer financial consultation
- ๐ช Explainable AI with reflection traces
- ๐ Structured execution planning
- ๐ Interactive Streamlit dashboard
The platform follows a modular architecture consisting of deterministic financial analytics followed by collaborative AI reasoning.
- Streamlit User Interface
- Financial Coordinator
- Planning Service
- Execution Service
- Bill Processing Agent
- Expense Analytics Agent
- Recurring Expense Agent
- Spending Forecast Agent
- Financial Team
- Financial Serializer
- Response Synthesizer
Each component has a clearly defined responsibility, making the system modular, maintainable, and easily extensible.
Unlike traditional single-LLM applications, this project employs multiple specialized AI agents that collaborate before producing the final financial recommendation.
Responsible for:
- Financial assessment
- Risk identification
- Recommendation generation
Responsible for:
- Independent review
- Detecting missing observations
- Improving recommendation quality
- Providing constructive critique
The reviewer evaluates the advisor's assessment before the advisor produces a verified financial consultation.
This collaborative workflow significantly improves explainability and recommendation quality.
Upload Bill
โ
โผ
OCR & Information Extraction
โ
โผ
Expense Categorization
โ
โผ
Spending Analytics
โ
โผ
Recurring Expense Detection
โ
โผ
Monthly Spending Forecast
โ
โผ
AutoGen Financial Team
โ
โผ
Verified Financial Consultation
โ
โผ
Interactive Dashboard
This project combines deterministic software engineering with modern Agentic AI design.
- PlannerโExecutor architecture
- Modular coordinator design
- Deterministic financial analytics
- AutoGen AgentChat 0.7.5
- AdvisorโReviewer collaboration
- Structured serialization pipeline
- Reflection-based explainability
- Pydantic model validation
- Modular service architecture
- Interactive financial dashboard
User Upload
โ
โผ
Bill Processing Agent
โ
โผ
Expense Analytics Agent
โ
โผ
Recurring Expense Detection
โ
โผ
Spending Forecast Agent
โ
โผ
Advisor โ Reviewer (AutoGen)
โ
โผ
Financial Serializer
โ
โผ
Response Synthesizer
โ
โผ
Interactive Dashboard
Bill-Management-Agent/
โ
โโโ agents/
โ โโโ autogen/
โ โโโ coordinator/
โ โโโ financial/
โ โโโ registry/
โ โโโ planning/
โ
โโโ models/
โ
โโโ services/
โ
โโโ streamlit/
โ
โโโ tests/
โ
โโโ sample_bills/
โ
โโโ images/
โ
โโโ requirements.txt
| Layer | Technology |
|---|---|
| Language | Python 3.12 |
| UI | Streamlit |
| Multi-Agent Framework | AutoGen AgentChat 0.7.5 |
| LLM Providers | Google Gemini, Groq |
| OCR | EasyOCR |
| Data Processing | Pandas |
| Validation | Pydantic |
| Visualization | Plotly |
Clone the repository
git clone https://github.com/<username>/Bill-Management-Agent.git
cd Bill-Management-AgentCreate a virtual environment
python -m venv .venvActivate the environment
source .venv/bin/activateor
.venv\Scripts\activateInstall dependencies
pip install -r requirements.txtConfigure environment variables
GOOGLE_API_KEY=
GROQ_API_KEY=
Run the application
streamlit run app.pyThe system successfully provides:
- Automated bill processing
- Expense categorization
- Spending analytics
- Recurring expense analysis
- Monthly expenditure forecasting
- Multi-agent financial consultation
- Explainable AI reasoning
- Interactive financial dashboard
Future enhancements include:
- Persistent financial memory
- Budget planning
- Goal tracking
- Investment portfolio analysis
- Cloud deployment
- Multi-user authentication
- Mobile application
- Long-term financial insights
Contributions, feature suggestions, and discussions are welcome.
Feel free to fork the repository and submit a pull request.
This project is released under the MIT License.
R. Ruthuraraj
Assistant Professor | AI Trainer | Generative AI & Agentic AI Enthusiast
- GitHub: (GitHub link)





