The learning rate in my model is
0.00001 and the gradients of the model is within the distribution of
[-0.0001, 0.0001]. Is it normal?
Artificial Intelligence Stack Exchange is a question and answer site for people interested in conceptual questions about life and challenges in a world where "cognitive" functions can be mimicked in purely digital environment. It only takes a minute to sign up.Sign up to join this community