Skip to content

Pull requests: pytorch/torchtitan

New pull request New
40 Open 556 Closed
40 Open 556 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Introducing a generic ModelHandler interface. CLA Signed This label is managed by the Meta Open Source bot.
#823 opened Feb 6, 2025 by balancap • Draft
14
Support ZBVZeroBubbleSchedule CLA Signed This label is managed by the Meta Open Source bot.
#817 opened Feb 4, 2025 by H-Huang Loading…
1
2
[not for land] add repro script for https://github.com/pytorch/torchtitan/pull/808 CLA Signed This label is managed by the Meta Open Source bot.
#815 opened Feb 1, 2025 by danielvegamyhre • Draft
Add Dynamic Model Import and ModelSpec Definition CLA Signed This label is managed by the Meta Open Source bot.
#814 opened Jan 31, 2025 by fegin Loading…
35
[not for land yet] example of float8 with rowwise scaling CLA Signed This label is managed by the Meta Open Source bot.
#808 opened Jan 27, 2025 by vkuzo Loading…
22
[WIP][RFC] TorchFT integration CLA Signed This label is managed by the Meta Open Source bot.
#806 opened Jan 27, 2025 by fegin • Draft
Workaround for backends that don't support torch.uint64 CLA Signed This label is managed by the Meta Open Source bot.
#804 opened Jan 26, 2025 by Zhenbin-8 Loading…
2
[cp] Add cudnn attention support to Context Parallel CLA Signed This label is managed by the Meta Open Source bot.
#796 opened Jan 17, 2025 by XilunWu • Draft
[debug only] microbatching CLA Signed This label is managed by the Meta Open Source bot.
#795 opened Jan 16, 2025 by tianyu-l • Draft
Make CheckpointManager friendlier to custom StorageWriter/StorageReader CLA Signed This label is managed by the Meta Open Source bot.
#789 opened Jan 12, 2025 by dimdi-y Loading…
6
Register backward hook for the whole optim_dict to enable working at multi schedule pp CLA Signed This label is managed by the Meta Open Source bot.
#780 opened Jan 7, 2025 by mori360 • Draft
[Not for land] Integrate float8nocompile, an experimental feature for high performance CLA Signed This label is managed by the Meta Open Source bot.
#778 opened Jan 7, 2025 by danielvegamyhre Loading…
8
[PoC] Typed JobConfig CLA Signed This label is managed by the Meta Open Source bot.
#767 opened Jan 1, 2025 by jaysonfrancis Loading…
1
[MoE][PoC] Expert Parallel: dp2ep CLA Signed This label is managed by the Meta Open Source bot.
#732 opened Dec 12, 2024 by tianyu-l • Draft
[MoE][PoC] Expert Parallel: tp and tp2ep CLA Signed This label is managed by the Meta Open Source bot.
#731 opened Dec 12, 2024 by tianyu-l • Draft
[MoE][PoC] model code CLA Signed This label is managed by the Meta Open Source bot.
#730 opened Dec 12, 2024 by tianyu-l • Draft
4
First draft Auto-SAC workflow CLA Signed This label is managed by the Meta Open Source bot.
#710 opened Dec 2, 2024 by sanketpurandare • Draft
4
[WIP] Allow benchmark between multiple configs CLA Signed This label is managed by the Meta Open Source bot.
#703 opened Nov 26, 2024 by H-Huang Loading…
2
[WIP] Adding OBELICS DataLoader CLA Signed This label is managed by the Meta Open Source bot.
#663 opened Oct 30, 2024 by TJ-Solergibert Loading…
1
30
[not for land] torch.compile individual linears CLA Signed This label is managed by the Meta Open Source bot.
#661 opened Oct 29, 2024 by vkuzo Loading…
Init weights only if not loading a checkpoint CLA Signed This label is managed by the Meta Open Source bot.
#628 opened Oct 18, 2024 by carmocca • Draft
3
[DO NOT REVIEW] gaps to enable FDSP2 cpu offloading CLA Signed This label is managed by the Meta Open Source bot.
#622 opened Oct 16, 2024 by weifengpy Loading…
1
1
[not for land] TE experiments, take 2 CLA Signed This label is managed by the Meta Open Source bot.
#614 opened Oct 14, 2024 by vkuzo Loading…
[DO NOT REVIEW] --experimental.fsdp_sharding_on_largest_dim CLA Signed This label is managed by the Meta Open Source bot.
#607 opened Oct 9, 2024 by weifengpy Loading…
fix mixed precision for replicate / pure DDP CLA Signed This label is managed by the Meta Open Source bot.
#591 opened Sep 29, 2024 by 152334H Loading…
1
21
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.