gradient checkpoint #79
Description
allow an option for the gradient checkpoint. In general, if we turn on gradient checkpoint, we reduce VRAM usage a lot but also increase the computational speed.
{{ message }}
allow an option for the gradient checkpoint. In general, if we turn on gradient checkpoint, we reduce VRAM usage a lot but also increase the computational speed.