Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

Inference code for Llama models

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

🎒 local.ai - Run AI locally on your PC!

Self-hosted AI coding assistant

All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

🦜️🔗LangChain for Rust, the easiest way to write LLM-based programs in Rust

Rust bindings for the C++ api of PyTorch.

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of …

A pure-python PDF library capable of splitting, merging, cropping, and transforming the pages of PDF files

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

Minimalist ML framework for Rust

A Rust machine learning framework.

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

LLM Orchestrator built in Rust

This is version 2 of LaraChain.io ream more at https://LaraLlama.io

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Blazingly fast LLM inference.

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

ComfyUI-IF_AI_tools is a set of custom nodes for ComfyUI that allows you to generate prompts using a local Large Language Model (LLM) via Ollama. This tool enables you to enhance your image generat…

🤗 AutoTrain Advanced

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

Build resilient language agents as graphs.

A high-throughput and memory-efficient inference and serving engine for LLMs

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, Du…

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.

Stable Diffusion web UI