# Questions tagged [decision-trees]

For question involving decision trees in any form of AI.

11 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
97 views

### Why do we use a weighted average of child entropies when we calculate information gain?

In the decision tree algorithm, why do we use a weighted average of child entropies when we calculate information gain? What is wrong about using the arithmetic mean of entropies?
• 31
684 views

### Why information gain with entropy as impurity function can't be used as a splitting method for Decision Tree Regression?

In Decision Tree Regression, we can use 'Reduction in Variance' or MSE (Mean Squared Errors) as splitting methods. There are methods like Gini Index, Information Gain, Chi-Square for splitting on ...
• 43
88 views

### How can I classify instances into two categories and then into sub-categories, when the number of features is high?

I'm working with a problem where I have a lot of variables for different cases of different users. Depending on the values of the different variables of a concrete user in a concrete case, the ...
63 views

### What kind of decision rule algorithm is usable in this situation?

I am trying to write an AI to a game, where there is no real adversary. This means, that only the AI player has choices in which move to perform, his opponent may or may not react to the move the AI ...
141 views

### How can I minimize the number of answers that are relevant to a machine learning model?

Problem: We have a fairly big database that is built up by our own users. The way this data is entered is by asking the users 30ish questions that all have around 12 answers (x, a, A, B, C, ..., H). ...
3k views

### How does a decision tree split a continuous feature?

Decision trees learn by measuring the quality of a split through some function, apply this to all features and you get the best feature to split on. However, with a continuous feature it becomes ...
• 1,346
1 vote
35 views

### What is the concept of pruning a tree in Machine Learning regression problems?

What is the concept of pruning a tree in Machine Learning regression problems? I am confused and a simple explanation would be great.
• 11
1 vote
293 views

### How to determine if a decision tree is the (globally) optimal tree?

BACKGROUND: When constructing decision trees, the features are selected at various nodes based on whether it optimally splits the samples at that level (i.e., locally) using some user-chosen metric ...
• 922
1 vote
19 views

### Optimize parametric Log-Likelihood with a Decision Tree

Suppose there are some objects with features, and the target is parametric density estimation. Density estimation is model-based. Parameters are obtained by maximizing log-likelihood. \$LL = \sum_{i \...
• 11
19 views