Questions tagged [mini-batch-gradient-descent]
For questions about mini-batch (or batch) gradient descent, which is gradient descent with typically more than one sample of input-label pairs.
2 questions
11
votes
2
answers
6k
views
What exactly is averaged when doing batch gradient descent?
I have a question about how the averaging works when doing mini-batch gradient descent.
I think I now understood the general gradient descent algorithm, but only for online learning. When doing mini-...
- 445
10
votes
1
answer
12k
views
Is back-propagation applied for each data point or for a batch of data points?
I am new to deep learning and trying to understand the concept of back-propagation. I have a doubt about when the back-propagation is applied. Assume that I have a training data set of 1000 images ...
- 245