Skip to content

[Feature] Support Qwen3.5 text model - #133

Open
botieking98 wants to merge 1 commit into
sgl-project:mainfrom
botieking98:feat/Qwen3.5_model
Open

[Feature] Support Qwen3.5 text model#133
botieking98 wants to merge 1 commit into
sgl-project:mainfrom
botieking98:feat/Qwen3.5_model

Conversation

@botieking98

@botieking98 botieking98 commented May 20, 2026

Copy link
Copy Markdown

Background

This PR adds Qwen3.5 text-only model support to mini-sglang, while keeping the serving path aligned with existing mini-sglang/sglang runtime patterns.

What Changed

  1. Added Qwen3.5 model implementation and model registration.
  2. Added the required GDN/Radix linear-attention path for Qwen3.5 prefill/decode.
  3. Introduced minimal runtime infrastructure needed by this path:
  • forward-batch context wiring
  • custom op registration helpers
  • model-executor helpers
  • compilation context utilities
  1. Updated related attention/layer/scheduler/tokenizer/model-config wiring so /v1/chat/completions works end-to-end.

Scope

  • In scope: text inference path only for Qwen3.5 family.
  • Out of scope: multimodal support, broader refactors unrelated to Qwen3.5.

Validation

python -m minisgl --model /root/models/Qwen3.6-27B --tp 8 --port 30000 --dtype bfloat16 --attn fi

Notes for Reviewers

  • This PR touches multiple subsystems because Qwen3.5 depends on both model-side and attention backend/kernel-side support.
  • Interfaces were kept as close as practical to upstream sglang patterns to reduce future sync cost.

@botieking98
botieking98 force-pushed the feat/Qwen3.5_model branch from d3861f4 to f5e606c Compare May 20, 2026 11:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant