#mini-batch gradient descent

The blog shows key differences between Batch, Stochastic, and Mini-Batch Gradient Descent. Discover how these optimization techniques impact ML model training.

In my previous post on gradient descent, I explained briefly what gradient descent means and what mathematical idea it holds. A basic gradient descent algorithm involves calculating derivatives of the cost function with respect to the parameters to be optimized. This derivative is calculated over the entire training set as a whole. Now if the data has samples in hundreds of thousands, the…