feat(npu): token-balanced async MoE microbatch split for DP+TP/SP - #152

feat(npu): token-balanced async MoE microbatch split for DP+TP/SP#152

ShwStone wants to merge 1 commit into

vllm-project:mainvllm-project/afd-plugin:mainfrom

ShwStone:tp-sp-microbatchShwStone/afd-plugin:tp-sp-microbatchCopy head branch name to clipboard