Questions tagged [batch-size]
For questions related to the notion of batch size in machine learning.
5
questions
1
vote
0answers
44 views
Why would a VAE train much better with batch sizes closer to 1 over batch size of 100+?
I've been training a VAE to reconstruct human names and when I train it on a batch size of 100+ after about 5 hours of training it tends to just output the same thing regardless of the input and I'm ...
1
vote
0answers
15 views
Effect of Batch Size on a Translation Model's Validation Scores
This is a general question.
I am training a neural machine translation model with different batch sizes: 16, 32, and 64 for the same amount of epochs (10).
I am getting very low validation scores for ...
1
vote
1answer
62 views
Are there any rules for choosing batch size? [duplicate]
I am training a CNN with a batch size of 128, but I have some fluctuations in the validation loss, which are greater than one. I want to increase my batch size to 150 or 200, but, in the code examples ...
9
votes
2answers
18k views
How do I choose the optimal batch size?
Batch size is a term used in machine learning and refers to the number of training examples utilised in one iteration. The batch size
can be one of three options:
batch mode: where the batch size is ...
3
votes
2answers
3k views
Is there a way to translate the concept of batch size into reinforcement learning?
I am using a neural network as my function approximator for reinforcement learning. In order to get it to train well, I need to choose a good learning rate. Hand-picking one is difficult, so I read up ...
