4
$\begingroup$

I want to know if there is a measure of how well two classes in Y are separable (linearly or not) based on their features in X. Easiest way of explaining this is to compare it to correlation coefficients, the higher the correlation the higher possiblity for successful regression based on given feature (at least in theory).

Is there any measure that will tell me how well classes are separated based on input data features, before training a ML model?

$\endgroup$
1
  • $\begingroup$ You can use a different measure for the decision tree. Anyhow, it's an ML model. $\endgroup$
    – OmG
    Commented Oct 20, 2019 at 21:18

1 Answer 1

2
$\begingroup$

Are you thinking something like Information Gain?

Information Gain basically uses the concept of information entropy to determine if splitting a variable is useful.

$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .