Questions tagged [feature-engineering]

For questions related to feature engineering, which is the process of using domain knowledge to extract features from raw data via data mining techniques.

Filter by
Sorted by
Tagged with
0 votes
1 answer
33 views

Non constant Feature Importance

I have a financial dataset which has 10 years worth of data. The aim is to build a regressor capable of predicting next year sales. So, if I want to predict sales for 2024, I could use data from 2023, ...
Nick's user avatar
  • 1
0 votes
0 answers
14 views

Feature engineering - filter out columns based on linear correlation result

Besides the other factors (such as domain knowledge), is there any rule of thumb or best practices to keep/remove features that were identified with high correlation between each other? The problem is,...
Echo's user avatar
  • 101
0 votes
0 answers
22 views

Could converting features into PCs, where #PCs = #features, improve model performance?

Let's say I have a dataset with some number of features (e.g., 10) and a target variable. I create 10 PCs from the dataset excluding the target variable. Then, I run a few classification algorithms (...
BigMistake's user avatar
0 votes
1 answer
22 views

Can we generate labels for an unlabelled dataset by doing some feature engineering?

I am very new to ML and currently, I am working on building a model that can predict recurring blood donors (a classification problem). I have a dataset which consists of 25 features (gender, height, ...
stkmnd's user avatar
  • 1
0 votes
1 answer
51 views

permutation importance shuffling

When calculating permutation importance for a certain feature, that feature is shuffled randomly and predictions with the shuffled feature are compared to predictions with the feature in its original ...
catasaurus's user avatar
0 votes
0 answers
7 views

How can I normalize features while preserving information about the original values?

I am trying to feed a neural network stock prices of an instrument. To ensure training stability, I normalize the inputs to have mean=0 and std=1. However, I thought that for stock prices, the ...
Quantum's user avatar
  • 121
0 votes
1 answer
35 views

Feature Extraction for timeseries temperature signal [closed]

i have two temperature signals from which one is sensitive toward a specific event. I would like to know what other features can be useful to extract apart from: Angles (between the two). Slopes ( ...
Mirza's user avatar
  • 61
1 vote
0 answers
27 views

Best feature engineering approach for interest-based age classification

I have a dataset which has users (rows) with the list of their interests (IABs), which looks like this ...
theodre7's user avatar
1 vote
1 answer
50 views

Features for a Content-Based recommendation system

I'm working on a hybrid recommendation system (collaborative and content-based) for an online ordering/shopping app. So far I've managed to identify a data-source for the collaborative model (likely ...
S_Khan's user avatar
  • 11
1 vote
0 answers
75 views

Understanding the features given in Example 13.1 of Sutton and Barto

I'm struggling to understand the notation used to represent the features within Example 13.1 (Short corridor with switched actions" in the Sutton and Barto RL book. I assume as it is a free pdf ...
topher217's user avatar
  • 111
1 vote
1 answer
285 views

Feature Engineering on transactional dataset clustering

I have a data set with transactions details from different business (roughly 1 thousand business entities). Each row is a transaction. The structure of the dataset is as follows: client_id Sex Age ...
Juan Ignacio Rojo's user avatar
0 votes
1 answer
31 views

How to handle list features in clustering?

I have a dataset where one of the features is a list. Example: ...
Bob Sacamano's user avatar
0 votes
1 answer
37 views

How can I vectorize fictional single word (not sentence!) for classification?

I am working on fictional single words (names) generator that have to sound like words from a given sample. I have the generator up and running that gives reasonable words 70% of time. I thought of ...
PiotrK's user avatar
  • 101
0 votes
1 answer
95 views

Sensible integer embedding/encoding for distinguishing elements of a set?

I am trying to train a model that takes in a set of feature vectors (which comes with an ID to uniquely identify elements of the set) and outputs a target for each element in the set (in a permutation-...
XYZT's user avatar
  • 101
2 votes
2 answers
91 views

Are derived or computed inputs bad for CNNs?

I am building a CNN and am wondering if inputting derived or computed inputs are generally bad for the effectiveness of CNNs? Or just NNs in general? By derived or computed values I mean data that is ...
NullFucksException's user avatar
2 votes
0 answers
84 views

Is it a good practice to split sparse from dense features?

I have a mixture of real (float) and categorical features to use as input in a neural network. I encode the categorical features using one-hot / multi-hot encoding. If I want to use all the features ...
Michael's user avatar
  • 159
0 votes
1 answer
52 views

Generating a dataset from data with "assumed" lables

I've got a task similar to the following: Out of x amount of people, I need to predict, who could be a good athlete and who not. The thing is, I don't have data on the athletic performance of those ...
Chris's user avatar
  • 103
2 votes
1 answer
129 views

What can be an example for the prior knowledge used in Deep Learning systems?

It is known that machine learning algorithms expect feature engineering as an initial step. Now, consider the following paragraph, taken from 1.1 The deep learning revolution of the textbook named ...
hanugm's user avatar
  • 3,820
1 vote
0 answers
156 views

How to pass variable length data as feature to a neural network?

I am working on building a model to classify the type of touch the user makes(Long Press, Left Swipe, Right swipe and so on). I have data with features that characterise the user's touch, like ...
Ravish Jha's user avatar
0 votes
0 answers
47 views

Does randomly adding hand-engineered features increase the CNN's sample efficiency/performance?

It is a known fact that preprocessing images using CV techniques will improve CNN performance (see this answer). But what happens when you feed in the entire image and the filtered image randomly to ...
desert_ranger's user avatar
2 votes
1 answer
3k views

How does a decision tree split a continuous feature?

Decision trees learn by measuring the quality of a split through some function, apply this to all features and you get the best feature to split on. However, with a continuous feature it becomes ...
Recessive's user avatar
  • 1,386
2 votes
1 answer
1k views

Feeding CNN FFT of an image, a dumb idea?

My dataset consists of about 40,000 200x200px grayscale images of centered blobs bathed in noise and occasional artifacts like stripes other blobs of different shapes and sizes, fuzzy speckles and so ...
Dumitrescu Calin's user avatar
0 votes
0 answers
55 views

Do the training and test datasets need to be equally preprocessed as one whole dataset?

I have developed, trained and tested an NLP model. It is persisted in a pickle file. The model contains the data preprocessing function that includes text cleaning and new features engineered with ...
Annalix's user avatar
  • 101
1 vote
1 answer
93 views

Is it a good practice to pad signal before feature extraction?

Is padding, before feature extraction with VGGish, a good practice? Our padding technique is to find the longest signal (which is loaded .wav signal), and then, in ...
Dawid_K's user avatar
  • 13
2 votes
2 answers
218 views

Is feature engineer an important step for a deep learning approach?

I'd like to ask you if feature engineering is an important step for a deep learning approach. By feature engineering I mean some advanced preprocessing steps, such as looking at histogram ...
Daviiid's user avatar
  • 573
4 votes
2 answers
976 views

When is it necessary to manually extract features to feed into the neural network rather than providing raw data?

Usually, Neural Networks uses raw data. You do not need to extract features manually. NN's can find & extract good features which is a pattern of an image, signal or any kind of data. When we ...
dasmehdix's user avatar
  • 257
2 votes
0 answers
85 views

How to find good features for a linear function approximation in RL with large discrete state set?

I've recently read much about feature engineering in continuous (uncountable) feature spaces. Now I am interested what methods exist in the setting of large discrete state spaces. For example consider ...
s1624210's user avatar
  • 121
1 vote
1 answer
50 views

Does feature scaling have any benefits if all features are on the same scale?

By scaling features, we can prevent one feature from dominating the decisions of a model. For example, say heights (cm), and age (years) are two features in my data. Since range of heights is larger ...
SpiderRico's user avatar
3 votes
1 answer
72 views

Is automated feature engineering a path to general AI?

I recently came across the featuretools package, which facilitates automated feature engineering. Here's an explanation of the package: https://towardsdatascience....
SuperCodeBrah's user avatar
3 votes
1 answer
131 views

How to perform prediction when some features have missing values?

Sorry if this is too noob question, I'm just a beginner. I have a data set with companies' info. There are 2 kinds of features: financial (revenue and so on) and general info (like the number of ...
Denis Ka's user avatar
1 vote
1 answer
190 views

How to deal with Unix timestamps features of sequences, which will be classified with RNNs?

I want to use RNN for classifying whole sequences of events, generated by website visitors. Each event has some categorical properties and a Unix timestamp: ...
Alena Volkova's user avatar
0 votes
0 answers
29 views

What are some solutions for dealing with time series data that are recorded at uneven intervals?

Let's say I have a time series data which is a bunch of observations that occur at different time stamps and intervals. For example, my observations come from a camera located at a traffic ...
confused's user avatar
  • 143
2 votes
2 answers
3k views

Why are decision trees and random forests scale invariant?

Feature scaling, in general, is an important stage in the data preprocessing pipeline. Decision Tree and Random Forest algorithms, though, are scale-invariant - i.e. they work fine without feature ...
stoic-santiago's user avatar
2 votes
0 answers
30 views

Visualisation for Features to Predict Timeseries Data

I have a course assignment to use an LSTM to predict the movement directions of stock prices. One of the things I am asked to do is provide a visualization to compare the predictive powers of a set of ...
georgi koyrushki's user avatar
2 votes
0 answers
37 views

How to feed key-value features (aggregated data) to LSTM?

I have the following time-series aggregated input for an LSTM-based model: ...
Maximus's user avatar
  • 121
1 vote
1 answer
122 views

Can feature engineering change the selection of the model according to the minimum description length?

The definition of MDL according to these slides is: The minimum description length (MDL) criteria in machine learning says that the best description of the data is given by the model which ...
user avatar
1 vote
2 answers
197 views

Can neural networks be used to find features importance?

I am wondering if I can use neural networks to find features importances in similar manner as it can be done for random forests or decision trees and if so, how to do it? I would like to use it on ...
GKozinski's user avatar
  • 1,250