Nonlinear Activations for Neural Networks

Jjdhao's blog jdhao.github.io 2022/03/27

Non-linear activations are important in deep neural networks. It is important in the sense that without non-linear activation functions, even if you have many linear layers, the end results is like yo…