Questions tagged [decision-trees]
For question involving decision trees in any form of AI.
11
questions with no upvoted or accepted answers
3
votes
0
answers
97
views
Why do we use a weighted average of child entropies when we calculate information gain?
In the decision tree algorithm, why do we use a weighted average of child entropies when we calculate information gain? What is wrong about using the arithmetic mean of entropies?
- 31
2
votes
0
answers
684
views
Why information gain with entropy as impurity function can't be used as a splitting method for Decision Tree Regression?
In Decision Tree Regression, we can use 'Reduction in Variance' or MSE (Mean Squared Errors) as splitting methods. There are methods like Gini Index, Information Gain, Chi-Square for splitting on ...
- 43
2
votes
0
answers
88
views
How can I classify instances into two categories and then into sub-categories, when the number of features is high?
I'm working with a problem where I have a lot of variables for different cases of different users. Depending on the values of the different variables of a concrete user in a concrete case, the ...
- 121
2
votes
0
answers
63
views
What kind of decision rule algorithm is usable in this situation?
I am trying to write an AI to a game, where there is no real adversary. This means, that only the AI player has choices in which move to perform, his opponent may or may not react to the move the AI ...
- 143
2
votes
2
answers
141
views
How can I minimize the number of answers that are relevant to a machine learning model?
Problem:
We have a fairly big database that is built up by our own users.
The way this data is entered is by asking the users 30ish questions that all have around 12 answers (x, a, A, B, C, ..., H). ...
2
votes
1
answer
3k
views
How does a decision tree split a continuous feature?
Decision trees learn by measuring the quality of a split through some function, apply this to all features and you get the best feature to split on.
However, with a continuous feature it becomes ...
- 1,346
1
vote
1
answer
35
views
What is the concept of pruning a tree in Machine Learning regression problems?
What is the concept of pruning a tree in Machine Learning regression problems? I am confused and a simple explanation would be great.
- 11
1
vote
1
answer
293
views
How to determine if a decision tree is the (globally) optimal tree?
BACKGROUND: When constructing decision trees, the features are selected at various nodes based on whether it optimally splits the samples at that level (i.e., locally) using some user-chosen metric ...
- 922
1
vote
0
answers
19
views
Optimize parametric Log-Likelihood with a Decision Tree
Suppose there are some objects with features, and the target is parametric density estimation. Density estimation is model-based. Parameters are obtained by maximizing log-likelihood.
$LL = \sum_{i \...
- 11
0
votes
0
answers
19
views
Confusion about the code for choosing "stumps" in Adaboost algorithm
(I actually asked the following question on Stack Overflow and Cross Validated Exchange for more than a month:
https://stackoverflow.com/questions/76842431/confusion-about-the-code-for-choosing-...
- 101
0
votes
1
answer
74
views
Why don't we wait if there is no patrons, in this decision tree from Russel and Norvig's book?
I'm reading Russel-Norvig's book about artificial intelligence and now at chapter decision tree where this figure is shown:
So far I understood it. This decision tree should answer the question if we ...
- 131