Which one among the both should I consider for the batchsize Is it true that batch size of form $2^k$ gives better results?

Source Link

asked Dec 27, 2021 at 0:52

Which one among the both should I consider for the batchsize?

I am confused among the following in selecting the batch size for my model.

#1: powers of 2

I generally see that batch sizes are in powers of two: 32, 64, 128, 256.

#2: maximum GPU

Suppose my GPU allows a maximum batch size of 61. And it is not a power of two.

Which one should I apt? Is there anything like the powers of 2 will give relatively good results?