I have a dataset with 2,23,586 samples out of which i used 60% for training and 40% for testing. I used 5 classifiers individually, SVM, LR, decision tree, random forest and boosted decision trees. SVM and LR performed well with close to 0.9 accuracy and recall also 0.9 but tree based classifiers reported an accuracy of 0.6. After a careful observation, I found out that SVM and LR did not predict the labels of 20,357 samples identically. So Can I apply voting and resolve this conflict wrt prediction outcome? Can this conflict be due to an imbalanced dataset?

  • $\begingroup$ welcome to AI SE. Your question is ok, but the title could be more descriptive to your problem. Could you please clarify it a little bit? $\endgroup$
    – mico
    Commented Jan 13, 2018 at 14:09
  • $\begingroup$ How many of the 20357 cases that SVM and LR fails has been correctly classified by the remainder methods? $\endgroup$ Commented Feb 13, 2018 at 20:44
  • $\begingroup$ Your question leaves a lot of questions, but will try to assist in what l understood. when gathering your data please try by all means to make sure that there are equal samples per channels and monitor your model for label leaking $\endgroup$ Commented Jun 19, 2018 at 7:56

1 Answer 1


Yes, you can. There are a lot of different techniques, usually called Ensemble Methods.

A better approach might be to use something like AdaBoost along with a cheaper method like the decision trees you looked at. AdaBoost explicitly tries to train classifiers to correctly handle different parts of the data, rather than hoping that different methods turn out to do so by chance.


You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .