Skip to content

Commit 3955bf2

Browse files
[EPLB] Eplb Verify Fix (#4333)
### What this PR does / why we need it? Eplb Verify Fix ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? - vLLM version: v0.11.0 - vLLM main: vllm-project/vllm@2918c1b --------- Signed-off-by: shenchuxiaofugui <[email protected]> Signed-off-by: LI SHENGYONG <[email protected]> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1 parent 3deeea1 commit 3955bf2

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm_ascend/ops/fused_moe/fused_moe.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -257,7 +257,8 @@ def __init__(self, *args, **kwargs):
257257
dtype=torch.int64).npu()
258258

259259
eplb_enable = self.dynamic_eplb or (self.expert_map_path is not None)
260-
if eplb_enable and (not isinstance(self.quant_method,
260+
if eplb_enable and (not hasattr(self.quant_method, "quant_method") or
261+
not isinstance(self.quant_method.quant_method,
261262
AscendW8A8DynamicFusedMoEMethod)):
262263
raise ValueError("Eplb supports only w8a8_dynamic quantization.")
263264

0 commit comments

Comments
 (0)