Questions tagged [id3-algorithm]

For questions related to the ID3 (Iterative Dichotomiser 3) algorithm, which is a decision tree algorithm, so it can be used to learn a decision tree from a dataset. The ID3 algorithm was also developed in 1986 by Ross Quinlan.

Filter by
Sorted by
Tagged with
5
votes
2answers
321 views

Are decision tree learning algorithms deterministic?

Are decision tree learning algorithms deterministic? Given a fixed dataset, do they always produce a tree with the same structure? What about the random forest?
1
vote
1answer
540 views

What is the intuition behind the entropy formula used in the ID3 algorithm?

What is the intuition behind the following entropy formula used in the ID3 algorithm? $$ \text{info}(D) = -\sum_{i=1}^m p_i \log_2(p_i) $$