Add option to predownload data from s3 at the start of each checkpoint.#280

GeorgiosSmyrnis wants to merge 6 commits intomainmlfoundations/open_lm:mainfrom

gsmyrnis/improve_s3_dlmlfoundations/open_lm:gsmyrnis/improve_s3_dlCopy head branch name to clipboard