🔬 Research: How do different activation functions (SiLU, GELU, ReLU²) affect training stability and convergence? #5
Description
We already have this research on the other repo, we will learn from it here
{{ message }}
We already have this research on the other repo, we will learn from it here