Users/oyazdanb/multi node improve#60

Open

oyazdanb wants to merge 4 commits intomainfrom

users/oyazdanb/multi_node_improve

Commits on Jan 19, 2026

making main as similar as training_issue_repo
Sonbol Yazdanbakhsh
committed
debugging hang
Sonbol Yazdanbakhsh
committed
changing local_launch.sh to have more rccl flags and also adding rccl initialization warmup and a training warmup
Sonbol Yazdanbakhsh
committed

Commits on Jan 20, 2026

fixing the hang in rccl and organizing flags in set_env_variable.sh
Sonbol Yazdanbakhsh
committed