[release/0.4][Improvements] Run the DSA warmup phase on dense MHA instead of latent MQA - #1721

Open

ForFishes wants to merge 3 commits into

PaddlePaddle:release/0.4from

ForFishes:feat/hybrid-mla-phase2-dense-mha

Commits on Aug 12, 2026

[release/0.4][Improvements] Run the DSA warmup phase on dense MHA instead of latent MQA
ForFishes
committed
e6544ef
[release/0.4][Improvements] Fall back to pad_token_id=0 in the indexer loss mask
ForFishes
committed
a9088fe
[release/0.4][Improvements] Drop the resynced recompute/GA keys from the phase-2 drift sentinel
ForFishes
committed
ea48c10