Skip to content

sakethrajesh/AgInsuranceLLM

Repository files navigation

AgInsuranceLLM

This project aims to address the complexity and confusion surrounding insurance policy selection by developing a conversational assistant tailored for an agricultural insurance program in the US. The assistant will simplify the understanding of insurance terms and aid users in making informed decisions about coverage options. Focusing on the detection of rainfall deficits in insured pasture, forage, and rangelands, the assistant will offer clear explanations, visualizations, and guidance on selecting appropriate insurance terms. Additionally, the project may include simulations to illustrate the potential impact of different choices. Ultimately, this tool seeks to empower users to confidently navigate their insurance options and manage financial risks effectively.

License

This project, AgInsuranceLLM, is licensed under the GNU General Public License v3.0 (GPL-3.0). The GPL-3.0 is a copyleft license that requires derivatives of this code to be available under the same license. This encompasses both the original and modified versions of this project. If you distribute this software, either modified or in its original form, you must do so under the same license, ensuring that it remains free and open-source under the terms of the GPL-3.0.

File Structure

.
├── chatbot     <-- fronted
├── ChromaDB    <-- vector db population
├── kube        <-- kubernetes config files
├── LLM         <-- backend
├── redis       <-- user db
└── TestBench   <-- testing files and infrastructure 

System Design

This project is built on a microservices architecture in the cloud, enabling individual scaling of components based on demand. The core architecture comprises separate microservices like the Vector DB, User DB, API, and AI-related services (Gemma, Mistral, Neural-chat, Llama2, Ollama), each independently scalable to accommodate fluctuating loads. The front-end components (Home Page, Chatbot Page, Admin Page) can also scale independently to handle varying user traffic. This microservices approach in the cloud architecture ensures optimal performance, efficient resource utilization, and high scalability across the entire system.

System Architecture

Frontend

More Details Here

Backend

More Details Here

Ollama

More Details Here

Databases

Vector Database - ChromaDB

More Details Here

User DB - Redis

More Details Here

Testing

More Details Here

Production Deployment

Insurance Resources