The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [dropout]

For questions related to dropout, which refers to the dropping out units (both hidden and visible) in a neural network (NN), during training of the NN, so that to avoid overfitting. So, dropout is thus a regularisation technique.

Filter by
Sorted by
Tagged with
1
vote
1answer
59 views

Dropout causes too much noise for network to train

I am using dropout of different values to train my network. The problem is, dropout is contributing almost nothing to training, either causing so much noise the error never changes, or seemingly ...
3
votes
2answers
496 views

Is pooling a kind of DropOut

If I got well the global idea of DropOut it allows to improve the sparsity of the information that come from one layer to another by setting some weights to zero. In another hand, pooling, let's say ...
1
vote
1answer
25 views

To remove neural-network units or to increase drop-out?

When adding dropout to a neural network, we are randomly removing a fraction of the connections (setting those weights to zero for that specific weight update iteration). If the dropout probability is ...
2
votes
2answers
115 views

Price Movement Forecasting Issue

I am working on a project for price movement forecasting and I am stuck with poor quality predictions. At every time-step I am using an LSTM to predict the next 10 time-steps. The input is the ...
1
vote
1answer
68 views

Usefulness of Dropout for non-overfitting network

My neural network is simple enough and does not overfit. Dropout is a regularization technique for reducing overfitting in neural networks From Wikipedia Adding Dropout in a non-overfitting ...
9
votes
1answer
1k views

Why do you not see dropout layers on reinforcement learning examples?

I've been looking at reinforcement learning, and specifically playing around with creating my own environments to use with the OpenAI Gym AI. I am using agents from the stable_baselines project to ...
8
votes
1answer
111 views

5 years later, are maxout networks dead, and why?

Maxout networks were a simple yet brilliant idea of Goodfellow et al. from 2013 to max feature maps to get a universal approximator of convex activations. The design was tailored for use in ...
2
votes
1answer
197 views

Action Probability with Thompson Sampling in Deep Reinforcement Learning

In some implementations of off-policy Q learning we need to know the action probabilities given by the behavior policy mu(a) (e.g., if we want to use importance ...
4
votes
2answers
601 views

What to do if CNN cannot overfit a training set on adding dropout?

I have been trying to use CNN for a regression problem. I followed the standard recommendation of disabling dropout and overfitting a small training set prior to trying for generalization. With a 10 ...
2
votes
1answer
683 views

What are the counterparts of non-linearities and dropout in fully convolutional networks?

I am trying to replicate the fully convolutional networks (FCN) concept described here for semantic segmentation. It seems people have successfully trained such models by removing fully connected ...
4
votes
1answer
554 views

Does a bias also have a chance to be dropped out in Dropout layer?

Suppose that you have 80 neurons in a layer, where one neuron is bias. Then you add a dropout layer after the activation function of this layer. In this case, does it have a chance to drop out the ...