# Tag Info

Accepted

### What is "conditioning" on a feature?

This is conditioning in the sense of conditional probability. The idea is that the authors have some "standard physically-inspired features". They are splitting the data up into bins based on the ...
• 8,877
Accepted

### Should I grey-scale the coloured frames/channels to build the approximation of the state?

We can't say for sure which approach would work best in the general case. If you have domain knowledge, you can make a better guess. You'll basically want to answer the question: which information is ...
• 9,379

### How should I deal with variable-length inputs for neural networks?

The most common way people deal with inputs of varying length is padding. You first define the desired sequence length, i.e. the input length you want your model to have. Then any sequences with a ...
• 3,093
Accepted

### How to solve the problem of too big activations when using genetic algorithms to train neural networks?

Your inputs should stay in a low range. Ideally for neural networks, the inputs are normalised to mean 0, standard deviation 1. I suspect this applies equally well to GA-driven NNs as gradient-driven ...
• 23.8k
Accepted

### Does the term "data augmentation" imply increasing the training dataset?

I'm not familiar with any "authoritative" single definition somewhere, or not sure who used the term first, but I would personally indeed agree with the reviewer you mention. In fact I've ...
• 9,379

### Why do we normalize data in a deep neural network?

I answered a similar question earlier and here is a piece of my answer that i think covers your question: Batch normalization's assistance to neural networks wasn't really understood for the longest ...
• 2,249

### Would this relatively small dataset be enough to train a CNN?

Your data set would be what is called "unbalanced' and this can lead to problems in developing an accurate classifier. The best thing to do (which you might not be able to do) is to find more ...
• 624
Accepted

### Does data skew matter in classification problem?

Yes. Skewed data is one of the biggest problems in AI applications. As you rightly identified, the real world distribution is skewed. Doing a random sampling results in one major issue of an uneven ...
Accepted

### How does the RL agent understand motion if it gets only one image as input?

In the article Playing Atari with Deep Reinforcement Learning, Mnih et al, 2013, which was a major outbreak in Deep Reinforcement learning (especially in Deep Q learning), they don't feed only the ...
• 571

### How to perform prediction when some features have missing values?

You should look into "missing values". This is an entire research field in itself. First, you need to identify the type of missing values: They can be missing purely at random. Whether they ...

### Why do we resize images before using them for object detection?

There are different questions and even different lines of thought here. Let's go through them On resizing Why do we need to resize? To fit the network input which is fixed when nets are no Fully ...
• 1,018
Accepted

### Why is the short-time Fourier transform used for preprocessing audio samples?

Fourier transform is used to transform audio data to get more information (features). For example, raw audio data usually represented by a one-dimensional array, ...
• 2,551
Accepted

### How should I encode the input which are 5 cards from a deck of 52 cards?

Depends on how your game is played. Is there any meaning assigned to the order of cards, or are all 5 played simultaneously? If order matters, use 5 one-hot vectors so you can choose how to order them,...
• 923

### Do I need to use a pre-processed dataset to classify comments?

Here's a list of some of the best python libraries for natural language processing. Natural Language Toolkit (nltk) Covers all the basic functions and NLP tools ...
Accepted

### When should I use feature learning as opposed to feature engineering?

manual feature engineering started becoming obsolete That is wrong. Any suggestion on when to use manual feature engineering, feature learning or a combination of the two? Deep learning is ...
• 1,007

### Is text preprocessing really all that necessary for NLP?

It all depends on the quality of data. Due to old rule "Garbage in, garbage out" link , if you have bad quality data(data redundancy, unstructured data, too much memory, etc) your results won't be ...
• 143
Accepted

### How to rescale data to its original range after MinMaxScaler?

You can use the function inverse_transform of the created MinMaxScaler object. See also this Stack Overflow question for other ...
• 33.8k

### How should I deal with variable input sizes for a neural network classifier?

It is much simpler to process the data in a different way. Since you're using temporal data a common practice is to define a priori a minimum time-step, usually called $\textit{granularity}$, which ...
• 3,513

### Is it recommended to remove stop words before named entity recognition?

It depends how you recognise the entities. If you do a simple gazetteer lookup, then it could be faster, as you have fewer tokens to deal with. However, if you use contextual rules, then stop words ...
• 5,062

### How to automatically detect and correct false information in columnar data?

While I can see that there are some heuristics that can tell you whether an entry is 'weird', I don't see any way that you can correct this. Where would you get a correct value from? I would perhaps ...
• 5,062
Accepted

### How to define the "Pre-Processing" in machine learning?

Data preprocessing consists of all those techniques used to generate the final datasets (with an appropriate size, structure, and format) for the machine learning algorithms or models. Data ...
• 33.8k

### Are my steps correct for a proper classification of a sick brain?

It looks like everything you want is available with the Deep Learning Toolkit (DLTK) for Medical Imaging There is also a blog: An Introduction to Biomedical Image Analysis with TensorFlow and DLTK ...
• 1,423
Accepted

### Is it necessary to standardise the expected output

It depends, as mentioned in the comments, on your model and labels. For example, how would you use standardization on a multi-classification problem? Generally, standardization is more favorable for ...
• 303
Accepted

### When to convert data to word embeddings in NLP

If you have to move a lot of data around during training (like retrieving batches from disk/network/what have you), it's much faster to do so as a rank-3 tensor of [batches, documents, indices] than ...
• 426
Accepted

### How to mathematically describe the convolution operation (with a Gaussian kernel)?

Mathematically, the convolution is an operation that takes two functions, $f$ and $g$, and produces a third function, $h$. Concisely, we can denote the convolution operation as follows f \circledast ...
• 33.8k
Accepted

### How robust are deep networks to class imbalance?

@nbro pointed out the paper A systematic study of the class imbalance problem in convolutional neural networks, which tested class imbalance LeNet for MNIST, on a custom CNN for CIFAR-10, and on ...
• 1,230
Accepted

### In OCR, how should I deal with the warped text on the sides of oval objects?

There are many papers on this but the following is a good start: How to unwrap wine labels programmatically. The author includes source code in Python. You mentioned you do not want to do a ...
• 1,423
Accepted

### Does feature scaling have any benefits if all features are on the same scale?

If all you features are binary, then, you don't need to apply normalization on them. Since their values are on the same scale already.