Questions tagged [standardisation]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
530 views

How to normalize rewards in REINFORCE?

I'm trying to solve a reinforcement learning problem using a Monte Carlo policy gradient algorithm and, more specifically, REINFORCE, with rewards attributed to individual moves instead of applied to ...
Mastiff's user avatar
  • 121
1 vote
1 answer
650 views

How to scale all positive continuous reward?

My RL project has all positive continuous rewards for every step and the goal is to have the maximum cumulative reward (episodic reward). The problem is that the rewards are too close and all between ...
fardis nadimi's user avatar
1 vote
0 answers
42 views

Why do you calculate the mean and standard deviation over the complete dataset before training rather than for every batch?

In most implementations of neural networks the features are scaled to make the optimization of the loss function as stable as possible. Mostly a min-max scaler is used. Alternatively, there is also a ...
flomax's user avatar
  • 11
1 vote
0 answers
81 views

For image preprocessing, is it better to use normalization or standartization?

For a neural network model that classifies images, is it better to use normalization (dividing by 255.0) or using standardization (subtract mean and divide by STD)? When I started learning ...
artas2357's user avatar
  • 153
1 vote
1 answer
523 views

How to normalize images before training?

I have seen people normalize images by just dividing 255. But why? Why not use mean normalization or Z-score Normalization? I also came across this StackOverflow topic while searching but the answers ...
Baran Aldemir's user avatar
2 votes
1 answer
403 views

Why does batch norm standardize with sample mean/variance, when it also learns parameters to scale the mean/variance?

Batch norm is a normalizing layer that is shown to help deep networks learn faster and with higher generalization accuracy. It normalizes the activations of the previous layer to a mean $\beta$ and ...
user3667125's user avatar
  • 1,560
-1 votes
1 answer
305 views

Is it necessary to standardise the expected output

Normalisation transform data into a range: $$X_i = \dfrac{X_i - Min}{Max-Min}$$ Practically, I found out that the model doesn't generalise well when using normalisation of input data, instead of ...
Dan D.'s user avatar
  • 1,283
1 vote
0 answers
49 views

Wouldn't training the model with this data lead to inaccuracies since the testing data would not be normalized in a similar way?

I was trying to normalize my input data images for feeding to my convolutional neural network and wanted to use standardize my input data. I referred to this post, which says that ...
user33681's user avatar
2 votes
1 answer
1k views

In transfer learning, should we apply standardization if the pre-trained model was (or not) trained with standardised data?

Assume one is using transfer learning via a model which was trained on ImageNet. Assume that the pre-processing, which was used to achieve the pre-trained model, contained z-score standardization ...
Gal Avineri's user avatar