Skip to content

Issues: sgl-project/sglang

Development Roadmap (2025 H1)
#4042 opened Mar 4, 2025 by zhyncs
Open 10
[Roadmap] Prefill and Decoding Disaggregation
#4655 opened Mar 21, 2025 by ByronHsu
Open 15
[Roadmap] DeepEP Support
#4734 opened Mar 24, 2025 by ch-wan
Open 2
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

442 Open 1,171 Closed
442 Open 1,171 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] deepseek-r1 cannot run multi-node under H20
#4978 opened Apr 2, 2025 by tanjunchen
5 tasks done
1
[Bug] ensure the git clone of long_prompt.txt good first issue Good for newcomers help wanted Extra attention is needed
#4976 opened Apr 1, 2025 by zhaochenyang20
5 tasks done
@zhaochenyang20
[Bug] sglang:v0.4.4 crashes when starting with optimized parameters
#4974 opened Apr 1, 2025 by Hugh-yw
1 of 5 tasks
3
[Bug] Fail to create server using MiniCPM-V-2_6_awq_int4 and Qwen2___5-VL-7B-Instruct-AWQ
#4972 opened Apr 1, 2025 by Xeladoes
4 of 5 tasks
[Bug] v0.4.4.post3-cu125 bench_serving is not TPOT
#4970 opened Apr 1, 2025 by Hugh-yw
1 of 5 tasks
1
[Bug] When enable torch compile and dp container start crashed
#4968 opened Apr 1, 2025 by momaek
2 of 5 tasks
4
[Bug] Docker image v0.4.4.post3-cu125 is labeled as CUDA 12.5 (cu125), but it actually contains CUDA 12.4.
#4952 opened Mar 31, 2025 by cynial
5 tasks done
1
Issue when running latest Mistral model
#4948 opened Mar 31, 2025 by fciannella
3
NotImplementedError: Updating weights_map with disk offloading is not implemented yet
#4945 opened Mar 31, 2025 by Gusha-nye
1
[Feature] use different lib so for fa3 in sgl-kernel high priority
#4941 opened Mar 31, 2025 by zhyncs
2 tasks
@yinfan98 @zhyncs @sleepcoo
1
[Feature] Support Video for Qwen VL
#4940 opened Mar 31, 2025 by remichu-ai
2 tasks done
[Bug] 0.0.0.0 host not supported bug Something isn't working
#4935 opened Mar 30, 2025 by gyin94
2 of 5 tasks
1
@kebe7jun
2
[Bug] Qwen/Qwen2.5-VL-7B-Instruct-AWQ sglang response time longer
#4916 opened Mar 30, 2025 by bao231
5 tasks
25
[Bug] Remove stream sync in fast decode plan of flashinfer mla backend bug Something isn't working flashinfer
#4905 opened Mar 29, 2025 by Fridge003
5 tasks
@Fridge003
[Feature] The performance fails to meet expectations.
#4903 opened Mar 29, 2025 by bebilli
2 tasks done
2
[Bug] Missing Torch and GGUF dependency in v0.4.4.post3 in Docker image
#4900 opened Mar 29, 2025 by davidsyoung
5 tasks done
1
[Bug] gemma-3-27b-it-bnb-4bit crash
#4897 opened Mar 29, 2025 by bebilli
5 tasks done
4
[Feature]about support gguf
#4894 opened Mar 29, 2025 by bebilli
2 tasks done
1
[Bug] Potential Issue with Querying Log Probabilities high priority
#4892 opened Mar 29, 2025 by yangky11
5 tasks done
@merrymercy
[Track] remove srt docker image
#4881 opened Mar 29, 2025 by zhyncs
@zhyncs
1
[Bug] zmq.error.ZMQError: Cannot assign requested address (addr='tcp://addr:port')
#4877 opened Mar 29, 2025 by HoyTiger
5 tasks done
1
[Bug] Logprobs overflow to -3.4e+38 bug Something isn't working
#4876 opened Mar 29, 2025 by zhc7
5 tasks done
@Qiaolin-Yu
Add Docs about attention backend, maybe we need to add a comprehensive one with Support Matrix such as:
#4865 opened Mar 28, 2025 by hebiao064
3
[Bug] Executing Qwen2.5-Omni-7B on SGLang 0.4.4 post2: AttributeError: 'Qwen2_5OmniConfig' object has no attribute 'hidden_size'
#4862 opened Mar 28, 2025 by didier-durand
4 of 5 tasks
3
Deployment of DeepseekV3 on 2*H100 nodes is getting stuck.
#4857 opened Mar 28, 2025 by abhay-tih
@fzyzcjy
3
ProTip! Add no:assignee to see everything that’s not assigned.