Questions tagged [batch-gradient-descent]

For questions about mini-batch (or batch) gradient descent, which is gradient descent with typically more than one sample of input-label pairs.

Filter by
Sorted by
Tagged with
2
votes
1answer
1k views

Is back-propagation applied for each data point or for a batch of data points?

I am new to deep learning and trying to understand the concept of back-propagation. I have a doubt about when the back-propagation is applied. Assume that I have a training data set of 1000 images ...
3
votes
2answers
353 views

What exactly is averaged when doing batch gradient descent?

I have a question about how the averaging works when doing mini-batch gradient descent. I think I now understood the general gradient descent algorithm, but only for online learning. When doing mini-...