How can I estimate how long it will take to train a model with P params on D data points?
Assuming my GPU can do T teraflops, and I have a neural network with P params, which I wish to train on D data points per epoch, how can I have a rough order of magnitude how long it will take to train a complete epoch?