Skip to content

fix: correct 3D mRoPE position_ids sharding in context parallelism#1482

Open
HuiyingLi wants to merge 1 commit intomainfrom
mrope_cp_fix
Open

fix: correct 3D mRoPE position_ids sharding in context parallelism#1482
HuiyingLi wants to merge 1 commit intomainfrom
mrope_cp_fix

Commits

Commits on Mar 7, 2026