Questions tagged [residual-networks]

For questions related to residual networks (ResNets), introduced in "Deep Residual Learning for Image Recognition" (2015) by Kaiming He et al. and that won the first place at "Large Scale Visual Recognition Challenge 2015" (ILSVRC2015).

Filter by
Sorted by
Tagged with
2
votes
2answers
64 views

What is the name of this neural network architecture with layers that are also connected to non-neighbouring layers?

Consider a feedforward neural network. Suppose you have a layer of inputs, which is feedforward to a hidden layer, and feedforward both the input and hidden layers to an output layer. Is there a name ...
4
votes
1answer
90 views

Why do ResNets avoid the vanishing gradient problem?

I read that, if we use the sigmoid or hyperbolic tangent activation functions in deep neural networks, we can have some problems with the vanishing of the gradient, and this is visible by the shapes ...
12
votes
2answers
610 views

Should deep residual networks be viewed as an ensemble of networks?

The question is about the architecture of Deep Residual Networks (ResNets). The model that won the 1-st places at "Large Scale Visual Recognition Challenge 2015" (ILSVRC2015) in all five main tracks: ...