Does DeepSpeed of Pytorch-Lightning support BFloat16 now?

[ShaneTian]

How to configure BFloat16 in DeepSpeed of Pytorch-Lightning?

1. Pass to Trainer only: Trainer(..., precision="bf16", ...)
2. Configure in DeepSpeed config only:

   {
     "bf16": {
       "enabled": true
     }
   }

3. Both setup Trainer and DeepSpeed config

---

One more thing:
I did not find anything about bf16 in deepspeed, is it not supported now?
https://github.com/PyTorchLightning/pytorch-lightning/blob/2e5728a4841cb1d3b75123ac941cd36f681f9a11/pytorch_lightning/strategies/deepspeed.py#L652-L667

[rohitgr7]

will be added:
PR: Add bfloat16 support to DeepSpeedStrategy