Skip to content

1.1.1 支持SGLANG和自定义Endpoint Name

Latest
Latest
Compare
Choose a tag to compare
@xiehust xiehust released this 03 Mar 05:10
· 10 commits to main since this release
1.1.1
b18cd2f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  1. 新增sglang推理框架, 目前支持版本为0.4.3, 部署时选择
  2. 增加自定义SageMaker Endpoint Name功能，部署模型时可以指定Endpoint Name
    image
  3. 升级vLLM至最新0.7.3，升级LLaMA-Factory支持Qwen2.5 VL微调
  4. 升级方法
Assets 2
Loading