Skip to content

Optimize multi-host TPU memory, step time, and checkpointing in dpsynth.text. - #262

Open
copybara-service[bot] wants to merge 1 commit into
mainfrom
cl/1002786541
Open

copybara-service[bot] wants to merge 1 commit into
mainfrom
cl/1002786541

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Oct 20, 2026 •

Copy link
Copy Markdown

Optimize multi-host TPU memory, step time, and checkpointing in dpsynth.text.

@copybara-service copybara-service Bot changed the title Skip initial step-1 checkpoint save and per-step PyTree packing in orbax_session. Skip redundant checkpoint saves and per-step PyTree packing in orbax_session, and enable use_flash_attention=True in load_gemma. Oct 20, 2026
@copybara-service copybara-service Bot changed the title Skip redundant checkpoint saves and per-step PyTree packing in orbax_session, and enable use_flash_attention=True in load_gemma. Optimize multi-host TPU memory, step time, and checkpointing in dpsynth.text. Oct 20, 2026
@copybara-service
copybara-service Bot force-pushed the cl/1002786541 branch 2 times, most recently from 448bc26 to acd0e03 Compare October 21, 2026 00:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants