When did the optimizer switch to SGD？

[yunbujian]

I set the initial lr=0.0001, final_lr=0.1,
but I still don't know when the optimizer will become SGD.
Do I need to improve my learning rate to the final learning rate manually?
thanks！

[jgvinholi]

There is no hard switch, but instead it is a smooth transition between the behavior of Adam and SGD.