CascadeFlow v0.6.0 Released #76
saschabuehrle
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
CascadeFlow v0.6.0 Release Notes
We're excited to announce CascadeFlow v0.6.0 with production-ready LangChain integration, multi-instance provider support, and access to 200+ models through OpenRouter!
New Features
✨ 100% Python/TypeScript Feature Parity Achieved
Full feature parity between Python and TypeScript implementations across the entire CascadeFlow library.
Highlights:
TypeScript-Specific Enhancements:
🔗 LangChain Integration (Python & TypeScript)
Production-ready LangChain integration for both Python and TypeScript with zero-config setup.
Features:
Documentation:
Examples:
🖥️ Multi-Instance Provider Support
Run draft and verifier models on separate Ollama/vLLM instances for optimized deployment.
Documentation:
Examples:
🌐 OpenRouter Provider
Access 200+ models through unified OpenRouter integration.
Documentation:
Bug Fixes
base_urlconfigurationo1-mini-2024-09-12) and documented Tier 5 requirementAttributeErrorinedge_device.pyexampleInstallation
Python:
TypeScript/Node.js:
LangChain Integration:
Full changelog: https://github.com/lemony-ai/cascadeflow/releases/tag/v0.6.0
Beta Was this translation helpful? Give feedback.
All reactions