Questions tagged [data-preprocessing]

For questions related to the concept of data pre-processing, which includes, for example, cleaning, instance selection, normalization, transformation, feature extraction or selection.

Filter by
Sorted by
Tagged with
0
votes
0answers
10 views

Is there any reason to believe a ml pipeline that works on dataset A will work on dataset B where both have similar meta features?

I’m working on generating an automl pipeline(a combination of data cleaning and transformation algorithms applied to a dataset then generate a model) that works on a new dataset by looking for past ...
0
votes
1answer
22 views

How to rescale data to its original range after MinMaxScaler?

I'm using sklearn's MinMaxScaler in order to scale my data down. However, it would be nice to be able to rescale it back to its original range. Is there any way I ...
3
votes
1answer
52 views

Why do we normalize data in a deep neural network?

I have asked this question a number of times, but I always get confusing answers to this, like "normalized data works better", "data lives in the same scale" How can ...
1
vote
1answer
40 views

Do I need to use a pre-processed dataset to classify comments?

I want to use Machine Learning for text classification, more precisely, I want to determine whether a text (or comment) is positive or negative. I can download a dataset with 120 million comments. I ...
1
vote
2answers
35 views

Are there tools to help clean a large dataset so that it only contains faces?

I have a fairly large dataset consisting of different images with and without persons that I want to use for a project. The problem is that I only want the pictures that contain faces, and it is best ...
1
vote
2answers
52 views

What is the impact of scaling the features on the performance of the model?

I am trying to generate a model that uses several physicochemical properties of a molecule (including number of atoms, number of rings, volume, etc.) to predict a numeric value $Y$. I would like to ...
1
vote
1answer
68 views

When should I use feature learning as opposed to feature engineering?

With the advancement of deep learning and a few others automated features learning techniques, manual feature engineering started becoming obsolete. Any suggestion on when to use manual feature ...
2
votes
0answers
140 views

Preprocessing of training dataset for machine learning

I'm developing a log analyzer to predict and find errors in an equipment. Each logged data contains the following format: ...