We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
例如我在a,b,c三台机器部署了Ollama的DeepSeek r1 模型,是否可以在这之间动态分配
The text was updated successfully, but these errors were encountered:
可以调用下面的函数,手动传入url以及apikey。
chatCompletion(String baseUrl, String apiKey, ChatCompletion chatCompletion) chatCompletionStream(String baseUrl, String apiKey, ChatCompletion chatCompletion, SseListener eventSourceListener)
如果ollama没有设置apikey,传入null或者""都可以。
目前没有内置轮询、负载均衡相关的实现。需要您自己实现何时调用哪一台机器上的模型。
Sorry, something went wrong.
No branches or pull requests
例如我在a,b,c三台机器部署了Ollama的DeepSeek r1 模型,是否可以在这之间动态分配
The text was updated successfully, but these errors were encountered: