Questions tagged [epochs]

In terms of artificial neural networks, an epoch refers to the cycles through the full training dataset. Usually, training a neural network takes more than a few epochs. ... With a neural network, the goal of the model is generally to classify or generate material which is right or wrong.

Filter by
Sorted by
Tagged with
1 vote
1 answer
266 views

What is your training time of Resnet-18/Resnet-50 on Imagenet?

My training of Resnet-18 network on Imagenet using Tesla V100 seems to be quite slow (1 epoch is about 2,5 hours, batch 128). Increasing the number of GPUs does not seem to help. What is your training ...
user avatar
  • 131
2 votes
1 answer
199 views

What is the reason we loop over epochs when training a neural network?

After reading through this thread and some other resources online, I still do not understand the role of epochs in training a neural network. I understand that one epoch is one iteration through the ...
user avatar
0 votes
2 answers
167 views

Is there any relationship between the batch size and the number of epochs?

I am currently running a program with a batch size of 17 instead of batch size 32. The benchmark results are obtained at a batch size of 32 with the number of epochs 700. Now I am running with batch ...
user avatar
  • 3,201
0 votes
1 answer
63 views

Does an increase in the number of epochs lead to complete breakdown?

Recently, I ran a code on my system that involves deep neural networks. The number of epochs provided by the designers are 301. I tried to increase the number of epochs to 501. To my shock, the model ...
user avatar
  • 3,201
1 vote
1 answer
107 views

Why does the accuracy drop while the loss decrease, as the number of epochs increases?

I've been trying to find the optimal number of epochs that I should train my neural network (that I just implemented) for. The visualizations below show the neural network being run with a variable ...
user avatar
  • 11
2 votes
1 answer
445 views

When is the loss calculated, and when does the back-propagation take place?

I read different articles and keep getting confused on this point. Not sure if the literature is giving mixed information or I'm interpreting it incorrectly. So from reading articles my understanding (...
user avatar
  • 259
6 votes
2 answers
217 views

How to shorten the development time of a neural network?

I am developing an LSTM for sequence tagging. During the development, I do various changes in the system, for example, add new features, change the number of nodes in the hidden layers, etc. After ...
user avatar