A fully local Retrieval-Augmented Generation (RAG) chatbot and automatic quiz generator with no telemetry and usage costs
- Conversational chatbot with contextual memory powered by your own documents
- Automatic quiz generator based on the uploaded content
- 100% local AI using the llama3.2:3b model running via Ollama, no external API calls
- RAG (Retrieval-Augmented Generation) with nomic-embed-text embeddings
- Local vector database (Milvus Standalone) for efficient semantic search
- Object storage with MinIO
- Complete privacy, all data stays on your machine
- Docker and Docker Compose
- Ollama installed
- ~8 GB of available RAM
- ~5 GB of disk space
Download and install Ollama, then run:
ollama pull llama3.2:latest
ollama pull nomic-embed-text
git clone https://github.com/rubenzu03/RAG_chatbot.git
cd RAG_chatbot
cp .env.example .env
docker compose up -d
- Open http://localhost:9001 in your browser
- Log in with the credentials from your
.envfile - Create a bucket named
ragchatbot - Upload the documents you want to use as the knowledge base (PDF, TXT, DOCX, MD...)
After uploading your files, restart the containers so the RAG pipeline processes and indexes the content:
docker compose down
docker compose up -d