Skip to content

Commit 6e1d910

Browse files
Update compress tutorial
Signed-off-by: Daniel Korzekwa <[email protected]>
1 parent 3917a78 commit 6e1d910

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

examples/compress/README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ In this example, we compress the [meta-llama/Llama-3.1-8B-Instruct](https://hugg
2626
3. Run the compression script.
2727

2828
```bash
29-
torchrun --nproc_per_node 1 examples/compress/main.py --config path/to/llama-3_1-8B_pruneffn_memory.yaml 2>&1 | tee ./log.txt | grep "Compress Progress"
29+
torchrun --nproc_per_node 2 examples/compress/main.py --config path/to/llama-3_1-8B_pruneffn_memory.yaml 2>&1 | tee ./log.txt | grep "Compress Progress"
3030
```
3131

3232
This will save the full output to `log.txt` and display the following progress on screen:
@@ -104,7 +104,7 @@ This assumes pruning, replacement library building, NAS scoring, and subblock st
104104
Set `target_memory: 96_000` in `llama-3_1-8B_pruneffn_memory.yaml`.
105105
106106
```bash
107-
torchrun --nproc_per_node 1 examples/compress/main.py --config path/to/llama-3_1-8B_pruneffn_memory.yaml --mip-only 2>&1 | tee ./log.txt | grep "Compress Progress"
107+
torchrun --nproc_per_node 2 examples/compress/main.py --config path/to/llama-3_1-8B_pruneffn_memory.yaml --mip-only 2>&1 | tee ./log.txt | grep "Compress Progress"
108108
```
109109
110110
This will generate the following network architecture (see `log.txt`):

0 commit comments

Comments
 (0)