Sep 16, 2024
Choosing the Right Gradient Descent: Batch vs Stochastic vs Mini-Batch Explained
The blog shows key differences between Batch, Stochastic, and Mini-Batch Gradient Descent. Discover how these optimization techniques impact ML model training.
In my previous post on gradient descent, I explained briefly what gradient descent means and what mathematical idea it holds. A basic gradient descent algorithm involves calculating derivatives of the cost function with respect to the parameters to be optimized. This derivative is calculated over the entire training set as a whole. Now if the data has samples in hundreds of thousands, theโฆ
