Computation Cost？

[jayyuci]

How long does it take to train on a single A100? Can I train it on a 4090 instead? I'd like to follow this paper if computation cost is affordable, thank you?

[JasonLiu324]

I have tried reproducing this work on 4090 24 GB and A100 40GB, but unfortunately it cannot work. It at least requires the GPU memory to be around 80GB.