Many researchers in deep learning research come up with new architectures.

The architectures are (just) combinations of few existing layers.

Along with their mathematical intuition, in general, do they visualize intermediate steps by execution and then (do trial and error) brute force for achieving the state-of-art architectures?

Visualizing intermediate steps refers to printing outputs in the proper format for analyzing them.

  • $\begingroup$ This question seems to be related/similar to this, this and this. $\endgroup$
    – nbro
    Jul 30 at 12:19
  • $\begingroup$ Moreover, note that the term "feature map" only typically applies to convolutional neural networks. If you're referring only to CNNs, it's better that you edit your post to clarify that. Also, what do you mean by "visualize intermediate steps", do you mean the outputs of a hidden layer? I also roughly understand what you mean by brute-force, but it may be better to given example to clarify what you mean in that case too. $\endgroup$
    – nbro
    Jul 30 at 12:23
  • $\begingroup$ Okay @nbro. I will improve the question. $\endgroup$
    – hanugm
    Jul 30 at 12:29

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.