A Visual Understanding of Neural Networks

Relu- A nonlinear function

Activation Functions & Non-Linearity: Neural Networks 101