Questions tagged [standardisation]
The standardisation tag has no usage guidance.
9
questions
0
votes
0
answers
530
views
How to normalize rewards in REINFORCE?
I'm trying to solve a reinforcement learning problem using a Monte Carlo policy gradient algorithm and, more specifically, REINFORCE, with rewards attributed to individual moves instead of applied to ...
1
vote
1
answer
650
views
How to scale all positive continuous reward?
My RL project has all positive continuous rewards for every step and the goal is to have the maximum cumulative reward (episodic reward). The problem is that the rewards are too close and all between ...
1
vote
0
answers
42
views
Why do you calculate the mean and standard deviation over the complete dataset before training rather than for every batch?
In most implementations of neural networks the features are scaled to make the optimization of the loss function as stable as possible.
Mostly a min-max scaler is used. Alternatively, there is also a ...
1
vote
0
answers
81
views
For image preprocessing, is it better to use normalization or standartization?
For a neural network model that classifies images, is it better to use normalization (dividing by 255.0) or using standardization (subtract mean and divide by STD)?
When I started learning ...
1
vote
1
answer
523
views
How to normalize images before training?
I have seen people normalize images by just dividing 255. But why? Why not use mean normalization or Z-score Normalization? I also came across this StackOverflow topic while searching but the answers ...
2
votes
1
answer
403
views
Why does batch norm standardize with sample mean/variance, when it also learns parameters to scale the mean/variance?
Batch norm is a normalizing layer that is shown to help deep networks learn faster and with higher generalization accuracy. It normalizes the activations of the previous layer to a mean $\beta$ and ...
-1
votes
1
answer
305
views
Is it necessary to standardise the expected output
Normalisation transform data into a range:
$$X_i = \dfrac{X_i - Min}{Max-Min}$$
Practically, I found out that the model doesn't generalise well when using normalisation of input data, instead of ...
1
vote
0
answers
49
views
Wouldn't training the model with this data lead to inaccuracies since the testing data would not be normalized in a similar way?
I was trying to normalize my input data images for feeding to my convolutional neural network and wanted to use standardize my input data.
I referred to this post, which says that ...
2
votes
1
answer
1k
views
In transfer learning, should we apply standardization if the pre-trained model was (or not) trained with standardised data?
Assume one is using transfer learning via a model which was trained on ImageNet.
Assume that the pre-processing, which was used to achieve the pre-trained model, contained z-score standardization ...