Questions tagged [epochs]
In terms of artificial neural networks, an epoch refers to the cycles through the full training dataset. Usually, training a neural network takes more than a few epochs. ... With a neural network, the goal of the model is generally to classify or generate material which is right or wrong.
7
questions
1
vote
1
answer
266
views
What is your training time of Resnet-18/Resnet-50 on Imagenet?
My training of Resnet-18 network on Imagenet using Tesla V100 seems to be quite slow (1 epoch is about 2,5 hours, batch 128). Increasing the number of GPUs does not seem to help.
What is your training ...
- 131
2
votes
1
answer
199
views
What is the reason we loop over epochs when training a neural network?
After reading through this thread and some other resources online, I still do not understand the role of epochs in training a neural network. I understand that one epoch is one iteration through the ...
- 21
0
votes
2
answers
167
views
Is there any relationship between the batch size and the number of epochs?
I am currently running a program with a batch size of 17 instead of batch size 32. The benchmark results are obtained at a batch size of 32 with the number of epochs 700.
Now I am running with batch ...
- 3,201
0
votes
1
answer
63
views
Does an increase in the number of epochs lead to complete breakdown?
Recently, I ran a code on my system that involves deep neural networks. The number of epochs provided by the designers are 301.
I tried to increase the number of epochs to 501. To my shock, the model ...
- 3,201
1
vote
1
answer
107
views
Why does the accuracy drop while the loss decrease, as the number of epochs increases?
I've been trying to find the optimal number of epochs that I should train my neural network (that I just implemented) for.
The visualizations below show the neural network being run with a variable ...
- 11
2
votes
1
answer
445
views
When is the loss calculated, and when does the back-propagation take place?
I read different articles and keep getting confused on this point. Not sure if the literature is giving mixed information or I'm interpreting it incorrectly.
So from reading articles my understanding (...
- 259
6
votes
2
answers
217
views
How to shorten the development time of a neural network?
I am developing an LSTM for sequence tagging. During the development, I do various changes in the system, for example, add new features, change the number of nodes in the hidden layers, etc. After ...
