Questions tagged [batch-size]

For questions related to the notion of batch size in machine learning.

Filter by
Sorted by
Tagged with
1
vote
0answers
44 views

Why would a VAE train much better with batch sizes closer to 1 over batch size of 100+?

I've been training a VAE to reconstruct human names and when I train it on a batch size of 100+ after about 5 hours of training it tends to just output the same thing regardless of the input and I'm ...
1
vote
0answers
15 views

Effect of Batch Size on a Translation Model's Validation Scores

This is a general question. I am training a neural machine translation model with different batch sizes: 16, 32, and 64 for the same amount of epochs (10). I am getting very low validation scores for ...
1
vote
1answer
62 views

Are there any rules for choosing batch size? [duplicate]

I am training a CNN with a batch size of 128, but I have some fluctuations in the validation loss, which are greater than one. I want to increase my batch size to 150 or 200, but, in the code examples ...
9
votes
2answers
18k views

How do I choose the optimal batch size?

Batch size is a term used in machine learning and refers to the number of training examples utilised in one iteration. The batch size can be one of three options: batch mode: where the batch size is ...
3
votes
2answers
3k views

Is there a way to translate the concept of batch size into reinforcement learning?

I am using a neural network as my function approximator for reinforcement learning. In order to get it to train well, I need to choose a good learning rate. Hand-picking one is difficult, so I read up ...