0
$\begingroup$

Is information gain only calculated using decrease in entropy of a dataset?

If I calculate it using the decrease in Gini Impurity, before and after the split, can it not be considered information gain?

$\endgroup$

1 Answer 1

1
$\begingroup$

Information gain is a very specific measure in information theory, thus the entropy definition... for sure, the decrease in Gini index can be seen as a proxy for it

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .