OpenAI-compatible HTTP server for OmniVoice text-to-speech.
Author: zamery (@maemreyo) | Email: matthew.ngo1114@gmail.com
Early Development Notice
This is a new repository built on top of OmniVoice (released 2026). Both the upstream model and this server wrapper are under active development. Expect API changes, breaking updates, and performance improvements as PyTorch MPS support matures.
Current Status: Functional on CPU and CUDA. MPS (Apple Silicon) has known issues.
| Category | Sections |
|---|---|
| Getting Started | Features - Quick Start - Verification Status |
| Usage | API Usage - CLI Usage - Configuration |
| Reference | API Reference - Advanced Features - Examples |
| Deployment | Docker Deployment - Hardware Requirements - Performance - Benchmarks |
| Development | Development - Troubleshooting - Known Limitations |
| Project | Documentation Index - License - Contributing - Acknowledgments - Support |
Prerequisites: PyTorch must be installed first. See Quick Start for details.
# Install
pip install omnivoice-server
# Start server
omnivoice-server
# Test with curl
curl -X POST http://127.0.0.1:8880/v1/audio/speech \
-H "Content-Type: application/json" \
-d '{"model": "omnivoice", "input": "Hello world!"}' \
--output speech.wavomnivoice-server wraps the OmniVoice TTS model with an OpenAI-compatible HTTP API:
- Voice Design: Control gender, age, pitch, accent, dialect
- Voice Cloning: Clone from reference audio
- Streaming: Real-time audio streaming with chunked transfer
- Voice Profiles: Persistent storage for cloned voices
- OpenAI-Compatible: Drop-in replacement for OpenAI TTS endpoints
See Features for complete capability list.
- System: Working on CPU and CUDA
- MPS: Broken on Apple Silicon (use CPU instead)
- Performance: RTF ~4.92 on CPU, ~0.2 on GPU
See Verification Status for benchmarks and audio samples.
This README provides quick links to detailed documentation. For complete information, see:
- Individual section files in
docs/readme/sections/ - Technical docs in
docs/verification/,docs/system/,docs/architecture/
MIT - See License