All Questions
73 questions
1
vote
1
answer
101
views
When is adding a feature useless?
I'm building a model, where, from a feature set A, I want to predict a target set C. I need to understand if another feature set B, together with A, can improve my model performances, instead of using ...
1
vote
2
answers
65
views
Feature scaling strategy for many feature with very large variation between them?
I was running into a situation in which my input feature experience a very large variation in term of magnitude.
Particularly, consider feature 1 belong to group 1 and feature 2 3 4 belong to group 2,
...
4
votes
1
answer
7k
views
What are bag-of-features in computer vision?
In computer vision, what are bag-of-features (also known as bag-of-visual-words)? How do they work? What can they be used for? How are they related to the bag-of-words model in NLP?
2
votes
2
answers
152
views
Can we train the model to detect real users with only positive labels?
We have hundreds of thousands of customers records, and we need to take the benefits of our data to train a model that will recognize fake entries or unrealistic ones for our platform, where customers ...
3
votes
1
answer
77
views
How are small scale features represented in an Inverse Graphics Network (autoencoder)?
This post refers to Fig. 1 of a paper by Microsoft on their Deep Convolutional Inverse Graphics Network:
https://www.microsoft.com/en-us/research/wp-content/uploads/2016/11/kwkt_nips2015.pdf
Having ...
5
votes
0
answers
69
views
Training and inference for highly-context-sensitive information
What is the best way to train / do inference when the context matters highly as to what the inferred result should be?
For example in the image below all people are standing upright, but because of ...
5
votes
1
answer
2k
views
What is "conditioning" on a feature?
On page 98 of Jet Substructure at the Large Hadron Collider: A Review of Recent Advances in Theory and Machine Learning the author writes;
Redacted phase space: Studying the distribution of inputs ...
3
votes
1
answer
83
views
Do the eigenvectors represent the original features?
I've got a test dataset with 4 features and the PCA produces a set of 4 eigenvectors, e.g.,
...
0
votes
1
answer
90
views
What is the correct name for state explosion from sensor discretization?
The position of a robot on a map contains of an x/y value, for example $position(x=100.23,y=400.78)$. The internal representation of the variable is a 32bit float which is equal to 4 byte in the RAM ...
1
vote
0
answers
104
views
How can I use gradient boosting with multiple features?
I'm trying to use gradient boosting and I'm using sklearn's GradientBoostingClassifier class.
My problem is that I'm having a data frame with 5 columns and I want ...
1
vote
1
answer
71
views
When doing binary classification with neural networks, how can I order the importance of the features for a class?
I have a simple neural network for binary classification.
The input features include age, sex, economic situation, illness, disability, etc. The output is simply 1 and 0.
I would like to order the ...
2
votes
0
answers
90
views
Does coarse coding with radial basis function generate fewer features?
I am learning about discretization of the state space when applying reinforcement learning to continuous state space. In this video the instructor, at 2:02, the instructor says that one benefit of ...
2
votes
1
answer
328
views
If I wanted to calculate multiple feature maps in a convolutional layer, should the filters be trained individually?
Assume I have an input of size $32 \times 32 \times 3$ and pass it to a convolution layer. Now, if my kernel size were to be $5 \times 5 \times 3$ and the depth of my convolution layer were to be 1, ...
2
votes
2
answers
687
views
Is the number of feature maps equal to the number of kernels in the LeNet 5 architecture?
In LeNet 5's first layer, the number of feature maps is equal to the number of kernels. However, the second convolutional layer has a depth different from the 3rd layer. Does the filter size dictate ...
1
vote
1
answer
511
views
How can $\nabla \hat{v}\left(S_{t}, \mathbf{w}_{t}\right)$ be 1 for $S_{t}$ 's group's component and 0 for the other components?
In Sutton's RL:An introduction 2nd edition it says the following(page 203):
State aggregation is a simple form of generalizing function approximation in which states are grouped together, with one ...
1
vote
1
answer
5k
views
What is a temporal feature?
What is a temporal feature, what features make something temporal in nature? Is this problem agnostic? How does it change from different fields of study?
2
votes
2
answers
466
views
How do neural networks weigh multiple inputs/features of different dimensionality?
I am confused about how neural networks weigh different features or inputs.
Consider this example. I have 3 features/inputs: an image, a dollar amount, and a rating. However, since one feature is an ...
1
vote
2
answers
250
views
Which neuron represents which part of the input?
In a neural network, each neuron represents some part of the input. For example, in the case of a MNIST digit, consider the stem of the number 9. Each neuron in the NN represents some part of this ...
2
votes
1
answer
562
views
Does the correlation between inputs affect the model performance?
I'm currently working on a regression problem and I have 10 inputs/attributes.
What should I do if there are correlations between different features of the input data? Does the correlation between ...
4
votes
1
answer
76
views
When working with time-series data, is it wrong to use different time-steps for the features and target?
When working with time-series data, is it wrong to use daily prices as features and the price after 3 days as the target?
Or should I use the next-day price as a target, and, after training, predict 3 ...
5
votes
1
answer
2k
views
How to handle varying types and length of inputs in a feedforward neural network?
After learning the basics of neural networks and coding one working with the MNIST dataset, I wanted to go to the next step by making one which is able to play a game. I wanted to make it work on a ...
8
votes
2
answers
304
views
How to design a neural network that gets the author name of a piece of art as input?
I'm building a neural net to predict the value of a piece of art with a wide range of inputs (size, art medium, etc.) and I would like to include the author as an input as well (it is often a huge ...
6
votes
1
answer
505
views
How to add more features to the input of a machine learning algorithm?
I am trying to perform a binary classification of tweets using machine learning.
The usual way of doing this seems to be putting a hand-classified tweet's words into a big vector, then use that ...