Skip to content

About

An AutoGen-powered Financial Intelligence Platform that transforms bill images into actionable insights through OCR, expense analytics, forecasting, and multi-agent AI collaboration.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

ย 

History

2 Commits

Folders and files

Repository files navigation

๐Ÿ’ณ Financial Intelligence Platform

An AutoGen-Powered Multi-Agent Bill Management System

Transform bill images into actionable financial intelligence using deterministic analytics, collaborative AI reasoning, and explainable financial recommendations.


Python โ€ข AutoGen AgentChat โ€ข Streamlit โ€ข Gemini โ€ข Groq โ€ข Plotly โ€ข Pydantic โ€ข EasyOCR


๐ŸŽฅ Demo

Demo Video:

Watch Demo


๐Ÿ“ธ Application Preview

Landing Page

Financial Dashboard

AI Financial Consultation


๐ŸŒŸ Overview

Managing expenses involves far more than simply extracting totals from receipts.

Most expense tracking applications stop after Optical Character Recognition (OCR), leaving users to interpret their own spending behaviour.

This project extends traditional bill processing into a Financial Intelligence Platform that combines deterministic financial analytics with AutoGen-powered collaborative AI agents.

The platform processes uploaded bills, extracts structured financial information, analyzes spending patterns, detects recurring expenses, forecasts future expenditure, and generates verified financial recommendations through an Advisorโ€“Reviewer collaboration workflow.


โœจ Key Features

  • ๐Ÿ“„ OCR-based bill processing
  • ๐Ÿงพ Automatic expense categorization
  • ๐Ÿ“Š Spending analytics dashboard
  • ๐Ÿ” Recurring expense detection
  • ๐Ÿ“ˆ Monthly spending forecasting
  • ๐Ÿค– AutoGen Multi-Agent collaboration
  • ๐Ÿง  Advisorโ€“Reviewer financial consultation
  • ๐Ÿชž Explainable AI with reflection traces
  • ๐Ÿ“‹ Structured execution planning
  • ๐Ÿ“Š Interactive Streamlit dashboard

๐Ÿ—๏ธ System Architecture

The platform follows a modular architecture consisting of deterministic financial analytics followed by collaborative AI reasoning.

Core Components

  • Streamlit User Interface
  • Financial Coordinator
  • Planning Service
  • Execution Service
  • Bill Processing Agent
  • Expense Analytics Agent
  • Recurring Expense Agent
  • Spending Forecast Agent
  • Financial Team
  • Financial Serializer
  • Response Synthesizer

Each component has a clearly defined responsibility, making the system modular, maintainable, and easily extensible.


๐Ÿค AutoGen Multi-Agent Collaboration

Unlike traditional single-LLM applications, this project employs multiple specialized AI agents that collaborate before producing the final financial recommendation.

Financial Advisor

Responsible for:

  • Financial assessment
  • Risk identification
  • Recommendation generation

Financial Reviewer

Responsible for:

  • Independent review
  • Detecting missing observations
  • Improving recommendation quality
  • Providing constructive critique

The reviewer evaluates the advisor's assessment before the advisor produces a verified financial consultation.

This collaborative workflow significantly improves explainability and recommendation quality.


๐Ÿ”„ End-to-End Workflow

Upload Bill
      โ”‚
      โ–ผ
OCR & Information Extraction
      โ”‚
      โ–ผ
Expense Categorization
      โ”‚
      โ–ผ
Spending Analytics
      โ”‚
      โ–ผ
Recurring Expense Detection
      โ”‚
      โ–ผ
Monthly Spending Forecast
      โ”‚
      โ–ผ
AutoGen Financial Team
      โ”‚
      โ–ผ
Verified Financial Consultation
      โ”‚
      โ–ผ
Interactive Dashboard

๐Ÿง  Engineering Highlights

This project combines deterministic software engineering with modern Agentic AI design.

Highlights

  • Plannerโ€“Executor architecture
  • Modular coordinator design
  • Deterministic financial analytics
  • AutoGen AgentChat 0.7.5
  • Advisorโ€“Reviewer collaboration
  • Structured serialization pipeline
  • Reflection-based explainability
  • Pydantic model validation
  • Modular service architecture
  • Interactive financial dashboard

๐Ÿ“Š Financial Intelligence Pipeline

                     User Upload
                          โ”‚
                          โ–ผ
                 Bill Processing Agent
                          โ”‚
                          โ–ผ
               Expense Analytics Agent
                          โ”‚
                          โ–ผ
             Recurring Expense Detection
                          โ”‚
                          โ–ผ
              Spending Forecast Agent
                          โ”‚
                          โ–ผ
          Advisor โ†” Reviewer (AutoGen)
                          โ”‚
                          โ–ผ
             Financial Serializer
                          โ”‚
                          โ–ผ
            Response Synthesizer
                          โ”‚
                          โ–ผ
               Interactive Dashboard

๐Ÿ“‚ Project Structure

Bill-Management-Agent/
โ”‚
โ”œโ”€โ”€ agents/
โ”‚   โ”œโ”€โ”€ autogen/
โ”‚   โ”œโ”€โ”€ coordinator/
โ”‚   โ”œโ”€โ”€ financial/
โ”‚   โ”œโ”€โ”€ registry/
โ”‚   โ””โ”€โ”€ planning/
โ”‚
โ”œโ”€โ”€ models/
โ”‚
โ”œโ”€โ”€ services/
โ”‚
โ”œโ”€โ”€ streamlit/
โ”‚
โ”œโ”€โ”€ tests/
โ”‚
โ”œโ”€โ”€ sample_bills/
โ”‚
โ”œโ”€โ”€ images/
โ”‚
โ””โ”€โ”€ requirements.txt

๐Ÿ› ๏ธ Technology Stack

Layer Technology
Language Python 3.12
UI Streamlit
Multi-Agent Framework AutoGen AgentChat 0.7.5
LLM Providers Google Gemini, Groq
OCR EasyOCR
Data Processing Pandas
Validation Pydantic
Visualization Plotly

๐Ÿš€ Installation

Clone the repository

git clone https://github.com/<username>/Bill-Management-Agent.git

cd Bill-Management-Agent

Create a virtual environment

python -m venv .venv

Activate the environment

source .venv/bin/activate

or

.venv\Scripts\activate

Install dependencies

pip install -r requirements.txt

Configure environment variables

GOOGLE_API_KEY=

GROQ_API_KEY=

Run the application

streamlit run app.py

๐Ÿ“ˆ Results

The system successfully provides:

  • Automated bill processing
  • Expense categorization
  • Spending analytics
  • Recurring expense analysis
  • Monthly expenditure forecasting
  • Multi-agent financial consultation
  • Explainable AI reasoning
  • Interactive financial dashboard

๐Ÿ”ฎ Roadmap

Future enhancements include:

  • Persistent financial memory
  • Budget planning
  • Goal tracking
  • Investment portfolio analysis
  • Cloud deployment
  • Multi-user authentication
  • Mobile application
  • Long-term financial insights

๐Ÿค Contributing

Contributions, feature suggestions, and discussions are welcome.

Feel free to fork the repository and submit a pull request.


๐Ÿ“„ License

This project is released under the MIT License.


๐Ÿ‘จโ€๐Ÿ’ป Author

R. Ruthuraraj

Assistant Professor | AI Trainer | Generative AI & Agentic AI Enthusiast


โญ If you found this project useful, please consider giving it a star!

About

An AutoGen-powered Financial Intelligence Platform that transforms bill images into actionable insights through OCR, expense analytics, forecasting, and multi-agent AI collaboration.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages