BentoML

All

104 repositories

BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•
Apache License 2.0
•15•97•0•0•Updated Apr 3, 2025Apr 3, 2025
bentocloud-homepage-news
Public
2•3•0•0•Updated Apr 2, 2025Apr 2, 2025
BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•830•7.6k•136•0•Updated Apr 2, 2025Apr 2, 2025
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker docker-image container container-image kubernetes k8s
Go
•10•18•6•9•Updated Apr 2, 2025Apr 2, 2025
OpenLLM
Public
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•705•11k•0•0•Updated Apr 2, 2025Apr 2, 2025
openllm-models
Public
Python
•12•37•0•0•Updated Apr 1, 2025Apr 1, 2025
BentoSentenceTransformers
Public
how to build a sentence embedding application using BentoML
Python
•2•6•0•1•Updated Mar 31, 2025Mar 31, 2025
BentoDiffusion
Public
BentoDiffusion: A collection of diffusion models served with BentoML
kubernetes ai lora model-serving fine-tuning diffusion-models stable-diffusion
Python
•
Apache License 2.0
•29•361•9•0•Updated Mar 27, 2025Mar 27, 2025
BentoOCR
Public
Turn any OCR models into online inference API endpoint 🚀 🌖
ocr model-deployment model-serving ocr-python ai-applications
Python
•4•54•1•0•Updated Mar 21, 2025Mar 21, 2025
BentoVoiceAgent
Public
Build Phone Calling Voice Agent fully powered by open source models.
voice-agent ai-phone-calling-guide ai-voice-assistant ai-phone
Python
•9•31•1•0•Updated Mar 18, 2025Mar 18, 2025
BentoMLflow
Public
Python
•1•1•0•0•Updated Mar 18, 2025Mar 18, 2025
BentoXTTSStreaming
Public
xtts with streaming endpoint
Python
•1•5•1•1•Updated Mar 17, 2025Mar 17, 2025
yatai-deployment
Public
🚀 Launching Bento in a Kubernetes cluster
Go
•14•17•7•3•Updated Mar 16, 2025Mar 16, 2025
BentoLangGraph
Public
Serving LangGraph Agent as REST API with BentoML, optionally with self-host open-source LLMs
Python
•3•7•0•1•Updated Mar 16, 2025Mar 16, 2025
BentoLMDeploy
Public
Self-host LLMs with LMDeploy and BentoML
Python
•2•18•1•0•Updated Mar 16, 2025Mar 16, 2025
BentoCLIP
Public
building a CLIP application using BentoML
Python
•2•10•0•2•Updated Mar 13, 2025Mar 13, 2025
helm-charts
Public
0•1•0•0•Updated Mar 13, 2025Mar 13, 2025
kantoku
Public
A Process & Socket Manager built with zmq
Python
•
Other
•258•1•0•0•Updated Mar 11, 2025Mar 11, 2025
comfy-pack
Public
A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.
ai-art comfyui genai comfyui-manager comfyui-workflow comfyui-nodes comfyui-api
Python
•
Apache License 2.0
•14•129•6•0•Updated Mar 10, 2025Mar 10, 2025
BentoMLCLLM
Public
Python
•1•5•0•0•Updated Mar 4, 2025Mar 4, 2025
BentoXTTS
Public
how to build an text-to-speech application using BentoML
Python
•3•6•1•3•Updated Mar 3, 2025Mar 3, 2025
BentoXGBoost
Public
Python
•2•0•0•0•Updated Feb 28, 2025Feb 28, 2025
BentoShield
Public
Python
•0•2•0•0•Updated Feb 27, 2025Feb 27, 2025
yatai-common
Public
Go
•5•2•0•2•Updated Feb 27, 2025Feb 27, 2025
BentoFunctionCalling
Public
Python
•1•6•0•1•Updated Feb 27, 2025Feb 27, 2025
quickstart
Public
BentoML Quickstart Example
Python
•
Apache License 2.0
•5•8•0•0•Updated Feb 26, 2025Feb 26, 2025
BentoWhisperX
Public
Python
•5•12•1•8•Updated Feb 18, 2025Feb 18, 2025
BentoSGLang
Public
Python
•1•3•0•0•Updated Feb 14, 2025Feb 14, 2025
LLMGateway
Public
Python
•0•2•0•1•Updated Feb 11, 2025Feb 11, 2025
BentoResnet
Public
Python
•3•5•0•1•Updated Feb 11, 2025Feb 11, 2025