Type of backpropagation where we use only a single training example for calculation of the gradient and update parameters.

Stochastic Gradient Descent.