Track an upstream SGLang fix for the local patch added in #2127.
resolve_waiting_queue_bootstrap() can build different candidate sets across TP ranks, causing some ranks to enter the collective while others skip it. The local workaround limits candidates to non-aborted pending_bootstrap requests.
Reference: #2127 (comment)
中文说明
跟踪 #2127 中本地补丁对应的 SGLang 上游修复。resolve_waiting_queue_bootstrap() 可能在不同 TP rank 上生成不一致的候选集合,导致 collective 不同步。当前临时方案仅保留未中止的 pending_bootstrap 请求。
Track an upstream SGLang fix for the local patch added in #2127.
resolve_waiting_queue_bootstrap()can build different candidate sets across TP ranks, causing some ranks to enter the collective while others skip it. The local workaround limits candidates to non-abortedpending_bootstraprequests.Reference: #2127 (comment)
中文说明
跟踪 #2127 中本地补丁对应的 SGLang 上游修复。
resolve_waiting_queue_bootstrap()可能在不同 TP rank 上生成不一致的候选集合,导致 collective 不同步。当前临时方案仅保留未中止的pending_bootstrap请求。