2
$\begingroup$

Decision trees learn by measuring the quality of a split through some function, apply this to all features and you get the best feature to split on.

However, with a continuous feature it becomes problematic because there are an infinite number of ways you can split the feature. How is the optimal split for a continuous feature chosen?

Improve this question
$\endgroup$
1

1 Answer 1

Reset to default
-2
$\begingroup$

Decision tree can be utilized for both classification(categorical) and regression(continuous) type of problems. The decision criterion of decision tree is different for continuous feature as compared to categorical.

The algorithm used for continuous feature is Reduction of variance. For continuous feature, decision tree calculates total weighted variance of each splits. The minimum variance from these splits is chosen as criteria to split.

look into this decision tree basics article, section 3

Improve this answer
$\endgroup$
1
  • 4
    $\begingroup$ Maybe you should elaborate more on what you mean by "minimum variance from these splits". The variance of which random variable? $\endgroup$
    – nbro
    Jul 31, 2021 at 12:38

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .