Skip to content

Commit 3ba6274

Browse files
tushar00jaingithubsgi
authored andcommitted
add script to train with ft (pytorch#1812)
Summary: the script adds configuration options to run training locally with ft enabled --- [//]: # (BEGIN SAPLING FOOTER) Stack created with [Sapling](https://sapling-scm.com). Best reviewed with [ReviewStack](https://reviewstack.dev/pytorch/torchtitan/pull/1812). * pytorch#1840 * pytorch#1811 * pytorch#1810 * __->__ pytorch#1812 * pytorch#1809 --------- Co-authored-by: Tushar Jain <[email protected]>
1 parent 872d88c commit 3ba6274

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

torchtitan/models/llama3_ft/train_configs/debug_model.toml

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -91,3 +91,9 @@ num_fragments = 2
9191
semi_sync_method = "diloco"
9292
process_group = "nccl"
9393
process_group_timeout_ms = 10000
94+
<<<<<<< HEAD
95+
=======
96+
97+
[experimental]
98+
custom_args_module = "torchtitan.components.ft.config"
99+
>>>>>>> f63037ff (add script to train with ft (#1812))

0 commit comments

Comments
 (0)