Questions tagged [batch-size]
For questions related to the notion of batch size in machine learning.
8
questions
0
votes
1answer
32 views
Will there be any changes in the model's performance due to the usage of very small batch sizes?
I am trying to run a code that has a batch size around 28. I can run the program on my GPU with this batch size.
But, when I modify the code for my requirements and try to run, it is showing an run-...
0
votes
0answers
18 views
The Effect of Batch Size in CNN Image Classifier, Given Different Image Domain
I am currently training image classifiers on CelebA face attribute dataset (Binary classifiers), which will be used on images generated by StyleGAN (that is trained on FFHQ256 dataset). These ...
3
votes
0answers
361 views
Why would a VAE train much better with batch sizes closer to 1 over batch size of 100+?
I've been training a VAE to reconstruct human names and when I train it on a batch size of 100+ after about 5 hours of training it tends to just output the same thing regardless of the input and I'm ...
0
votes
0answers
21 views
Effect of Batch Size on a Translation Model's Validation Scores
This is a general question.
I am training a neural machine translation model with different batch sizes: 16, 32, and 64 for the same amount of epochs (10).
I am getting very low validation scores for ...
1
vote
1answer
258 views
Are there any rules for choosing batch size? [duplicate]
I am training a CNN with a batch size of 128, but I have some fluctuations in the validation loss, which are greater than one. I want to increase my batch size to 150 or 200, but, in the code examples ...
5
votes
2answers
920 views
What is the purpose of the batch size in neural networks?
Why is a batch size needed to update the weights of a neural network?
According to that Youtube Video from 3B1B, the weights are updated by calculating the error between expectation and outcome of ...
12
votes
3answers
31k views
How do I choose the optimal batch size?
Batch size is a term used in machine learning and refers to the number of training examples utilised in one iteration. The batch size
can be one of three options:
batch mode: where the batch size is ...
3
votes
2answers
3k views
Is there a way to translate the concept of batch size into reinforcement learning?
I am using a neural network as my function approximator for reinforcement learning. In order to get it to train well, I need to choose a good learning rate. Hand-picking one is difficult, so I read up ...
