Skip to content

Merge with Ranger or over9000 #20

@LifeIsStrange

Description

@LifeIsStrange

https://github.com/lessw2020/Ranger-Deep-Learning-Optimizer

mgrankin/over9000#4

I strongly believe that AdaBound would be better if it used RAdam instead of Adam.
It could merge with Lookahead too and LAMB.
Then we would have the best of both worlds and a beautiful example of scientific collaboration.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions