v2.0.1
What's Changed
Since the release of v2.0.0 we have made a few bugfixes, added greater model support, and added user experience changes to help reduce the friction in sending chat prompts to a model in the Chat UI. The following are the highlights of changes since v2.0.0.
- Fixed support for self-signed certs across RAG and LISA Serve features
- Added support for vLLM embedding models
- Simplified API Token usage for those users who already use OpenAI clients. README and example notebook have been updated to reflect this change
- Fixed default values in the Chat UI so that TGI models are less likely to throw errors if the model kwargs are not modified before the first prompt
- Various dependency version bumps for security fixes
- Formally deprecated v1 routes. See the README for migrating to the v2 routes