I just learnt the math behind neural networks so please bear with my ignorance. I wonder if there is a precise definition for DNN.

Is it true that any neural network with more than 2 hidden layer can be named as a DNN, and training a NN with 2 hidden layers using Q-learning we are technically doing a type of deep reinforcement learning?

PS: If it is conceptually that simple why do common people regard deep learning like something done by archmages in ivory towers.


I don't think there is a fixed threshold that differentiates between Shallow and Deep Learning, but I would say that a 2 layer NN should not be considered deep. But now-a-days, almost all NN architectures are studied under the umbrella of Deep Learning.

And yes, training a 2 hidden layers NN using Q-learning would technically mean doing deep RL.

I guess it is conceptually simple but making NN perform optimally is an art. Tuning hyperparameters or debugging NN can be tough and one learns with experience. I guess others in the community would be much more suited to answer this question. But these were my 2 cents.

| improve this answer | |

Not the answer you're looking for? Browse other questions tagged or ask your own question.