Skip to main content
added 65 characters in body
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

I once read somewhere that there is a range of learning rate within which learning is optimal in almost all the cases, but I can't find any literature about it. All I could get is the following graph from the paper: The need for small learning rates on large problems

enter image description here

IsIn the context of neural networks trained with gradient descent, is there a range of the learning rate, which should be used to savereduce the time of training time and get a good performance in almost all problems?

I once read somewhere that there is a range of learning rate within which learning is optimal in almost all the cases, but I can't find any literature about it. All I could get is the following graph from the paper: The need for small learning rates on large problems

enter image description here

Is there a range of learning rate which should be used to save the time of training?

I once read somewhere that there is a range of learning rate within which learning is optimal in almost all the cases, but I can't find any literature about it. All I could get is the following graph from the paper: The need for small learning rates on large problems

enter image description here

In the context of neural networks trained with gradient descent, is there a range of the learning rate, which should be used to reduce the training time and get a good performance in almost all problems?

Removed from Network Questions by nbro
edited tags
Link
nbro
  • 41.4k
  • 12
  • 114
  • 205
added 107 characters in body
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205

I once read somewhere that there is a range of learning rate within which learning is optimal in almost all the cases, but I can't find any literature about it. All I could get is the following graph from the paper: The need for small learning rates on large problemsThe need for small learning rates on large problems

enter image description here

Is there a range of learning rate which should be used to save the time of training?

I once read somewhere that there is a range of learning rate within which learning is optimal in almost all the cases, but I can't find any literature about it. All I could get is the following graph from the paper: The need for small learning rates on large problems

enter image description here

Is there a range of learning rate which should be used to save the time of training?

I once read somewhere that there is a range of learning rate within which learning is optimal in almost all the cases, but I can't find any literature about it. All I could get is the following graph from the paper: The need for small learning rates on large problems

enter image description here

Is there a range of learning rate which should be used to save the time of training?

reference to the graph (as stated in the first answer and verified by me)
Source Link
Loading
Became Hot Network Question
added 5 characters in body; edited tags
Source Link
nbro
  • 41.4k
  • 12
  • 114
  • 205
Loading
Source Link
Sadaf Shafi
  • 218
  • 2
  • 10
Loading