Questions tagged [batch-learning]

For questions about machine learning algorithms that learn in batches of data rather than one example at a time (i.e. online learning). Batch learning can also be called offline learning and it is the common way of training machine learning models.

Filter by
Sorted by
Tagged with
1
vote
0answers
14 views

Why would a VAE train much better with batch sizes closer to 1 over batch size of 100+?

I've been training a VAE to reconstruct human names and when I train it on a batch size of 100+ after about 5 hours of training it tends to just output the same thing regardless of the input and I'm ...
2
votes
1answer
45 views

Is batch learning with gradient descent equivalent to “rehearsal” in incremental learning?

I am learning about incremental learning and read that rehearsal learning is retraining with old data. In essence, isn't this the exact same thing as batch learning (with stochastic gradient descent)? ...
0
votes
1answer
40 views

Why does the output shape of a Dense layer contain a batch size?

I understand that the batch size is the number of examples you pass into the neural network (NN). If the batch size is 10, it means you feed the NN 10 examples at once. Assuming I have an NN with a ...