Questions tagged [batch-size]

For questions related to the notion of batch size in machine learning.

Filter by
Sorted by
Tagged with
0
votes
0answers
12 views

The Effect of Batch Size in CNN Image Classifier, Given Different Image Domain

I am currently training image classifiers on CelebA face attribute dataset (Binary classifiers), which will be used on images generated by StyleGAN (that is trained on FFHQ256 dataset). These ...
2
votes
0answers
171 views

Why would a VAE train much better with batch sizes closer to 1 over batch size of 100+?

I've been training a VAE to reconstruct human names and when I train it on a batch size of 100+ after about 5 hours of training it tends to just output the same thing regardless of the input and I'm ...
0
votes
0answers
17 views

Effect of Batch Size on a Translation Model's Validation Scores

This is a general question. I am training a neural machine translation model with different batch sizes: 16, 32, and 64 for the same amount of epochs (10). I am getting very low validation scores for ...
1
vote
1answer
145 views

Are there any rules for choosing batch size? [duplicate]

I am training a CNN with a batch size of 128, but I have some fluctuations in the validation loss, which are greater than one. I want to increase my batch size to 150 or 200, but, in the code examples ...
5
votes
2answers
901 views

What is the purpose of the batch size in neural networks?

Why is a batch size needed to update the weights of a neural network? According to that Youtube Video from 3B1B, the weights are updated by calculating the error between expectation and outcome of ...
10
votes
2answers
24k views

How do I choose the optimal batch size?

Batch size is a term used in machine learning and refers to the number of training examples utilised in one iteration. The batch size can be one of three options: batch mode: where the batch size is ...
3
votes
2answers
3k views

Is there a way to translate the concept of batch size into reinforcement learning?

I am using a neural network as my function approximator for reinforcement learning. In order to get it to train well, I need to choose a good learning rate. Hand-picking one is difficult, so I read up ...