Why do we need activation functions?

The main idea of using neural networks is to learn complex nonlinear functions. The Nonlinearity comes only with the activation function without them we are just stacking up multiple linear layers.

Proposed by @Al_Grigor