Questions tagged [feature-selection]

For questions related to the concept of feature selection (also known as variable selection or attribute selection), which is the process of selecting a subset of relevant features (a.k.a. variables or predictors) for use in model construction.

Filter by
Sorted by
Tagged with
11
votes
4answers
224 views

How do I select the relevant features of the data?

Recently I was working on a problem to do some cost analysis of my expenditure for some particular resource. I usually make some manual decisions from the analysis and plan accordingly. I have a big ...
7
votes
1answer
318 views

How come that the addition of features can decrease the performance of a neural network?

I have a Remaining Useful Life (RUL) prediction problem that I want to solve. When I added two or more features as inputs to my ANN, the accuracy of my ANN has been decreased. More precisely, I've ...
7
votes
3answers
103 views

How much can the addition of new features improve the performance?

How much can the addition of new features improve the performance of the model during the optimization process? Let's say I have a total of 10 features. Suppose I start the optimisation process using ...
3
votes
1answer
92 views

What is a good descriptor for similar objects?

I am developing an image search engine. The engine is meant to retrieve wrist watches based on the input of the user. I am using SIFT descriptors to index the elements in the database and applying ...
3
votes
2answers
70 views

How can I minimize the number of answers that are relevant to a machine learning model?

Problem: We have a fairly big database that is built up by our own users. The way this data is entered is by asking the users 30ish questions that all have around 12 answers (x, a, A, B, C, ..., H). ...
3
votes
1answer
79 views

What is the $\ell_{2, 1}$ norm?

I'm reading this paper and it says: In this paper, we present a multi-class embedded feature selection method called as sparse optimal scoring with adjustment (SOSA), which is capable of addressing ...
3
votes
2answers
61 views

How to recognize non-circular radial symmetry in images?

This is a question about pattern recognition and feature extraction. I am familiar with Hough transforms, the Fast Radial Transform and variants (e.g., GFRS), but these highlight circles, spheres, ...
3
votes
0answers
46 views

How should I select the features for predicting diseases?

My aim is to create a trained model for predicting diseases. Now diseases are classified based on the following criteria in general: Causes of the Disease Pathogenesis (the mechanism by which the ...
3
votes
0answers
61 views

Feature Selection using Monte Carlo Tree Search

I'm trying to tackle the problem of feature selection as an RL problem, inspired by the paper Feature Selection as a One-Player Game. I know Monte-Carlo tree search (MCTS) is hardly RL. So, I used ...
2
votes
1answer
19 views

Should I use my redundant feature as an auxiliary output or as another input feature?

For example, given a face image, and you want to predict the gender. You also have age information for each person, should you feed the age information as input or should you use it as auxiliary ...
2
votes
0answers
12 views

Visualisation for Features to Predict Timeseries Data

I have a course assignment to use an LSTM to predict the movement directions of stock prices. One of the things I am asked to do is provide a visualization to compare the predictive powers of a set of ...
2
votes
0answers
8 views

How can Cat Swarm Algorithm (CSO) used for feature selection?

Cat swarm optimization (CSO) is a novel metaheuristic for evolutionary optimization algorithms based on swarm intelligence which proposed in 2006. See Feature Selection of Support Vector Machine Based ...
1
vote
1answer
64 views

How does the decision tree implicitly do feature selection?

I was talking with an ex-fellow worker and he told me that the decision tree implicitly applies a feature selection. He told me that the most important feature is higher in the tree because of the ...
1
vote
2answers
44 views

How to analyze data before going for machine learning training?

For example, I have the following csv: training.csv I want to know how I can determine which column will be the best feature for getting the output prediction before I go for machine training. Please ...
1
vote
1answer
73 views

When should I use feature learning as opposed to feature engineering?

With the advancement of deep learning and a few others automated features learning techniques, manual feature engineering started becoming obsolete. Any suggestion on when to use manual feature ...
1
vote
2answers
78 views

Can neural networks be used to find features importance?

I am wondering if I can use neural networks to find features importances in similar manner as it can be done for random forests or decision trees and if so, how to do it? I would like to use it on ...
1
vote
0answers
10 views

Feature extraction for exponentially damped signals

I am looking into exponentially damped signals where it is a stationary signal (after implementing the Adfuller statistical test) and I would like to look into how can I extract meaningful features ...
1
vote
0answers
44 views

What are examples of commonly used feature and readout maps?

It is well-known that deep feedforward networks can approximate any continuous function from $\mathbb{R}^k$ to $\mathbb{R}^l$, (uniformly on compacts). However, in practice feature maps are ...
1
vote
0answers
31 views

Interpretability of feature weights from Gaussian process classifier

Suppose I trained a Gaussian process classifier with a linear kernel (using GPML toolbox) and got some feature weights for each input feature. My question is then: Does it/When does it make sense ...
1
vote
0answers
16 views

How to combine features with different temporal scale in machine learning

We have various types of data features with different temporal scale. For example, some of them describe the state per second while others may describe the state per day or per month from another ...
1
vote
2answers
30 views

What features should a dataset to predict monthly retail sales for a motorcycle spare parts shop have?

I am making an AI model to predict monthly retail sales of a motor cycle spare parts shop, for that to be possible I have to first create a dataset. The problem I am facing is what features should the ...
1
vote
0answers
52 views

Adding features in TensorFlow playground

I am trying to solve the spiral exercise in TensorFlow but I can not add features like in this answer https://ai.stackexchange.com/a/10000/22691. How can I do that?
1
vote
1answer
53 views

Feature selection of an acoustic voice dataset for classification

I'm trying to gain some insight into acoustic voice data composed of 19 features. I want to understand what features contribute most for classification. ADDED: Most features are related with the ...
1
vote
1answer
28 views

Problem extracting features from convolutional layer where the dimensions are big for feature maps

I have trained a convolutional neural network on images to detect emotions. Now I need to use the same network to extract features from the images and use the features to train an LSTM. The problem is:...
0
votes
1answer
34 views

Can an artificial network create a rule from rule components?

If an antecedent in a rule involves $m$ two-state features and results in consequences from a set of $n$ possible ones, we have $2^{m+n}$ permutations, which are, in a sense, be categories. If ...
0
votes
0answers
11 views

What are swarm optimization techniques used for: training the ANN by weight optimization or for feature selection?

Swarm intelligence (SI) is the collective behavior of decentralized, self-organized systems, natural or artificial. The concept is employed in work on artificial intelligence. SI-based algorithms, ...
0
votes
2answers
21 views

Binarize ConvNet Feature vector [closed]

Given a pre-trained CNN model, I extract feature vector of 3450 reference images FV_R as follows: ...