1 vote

Given a dataset of people with and without cancer, should I split it into training and test datasets such that the same person is not in both?

we are recognizing the disease, not the person. If you're training a computer vision model with only images and no auxiliary information then a randomized sampling should be enough to prevent the ...
1 vote

how to decide the optimum model?

Testing each time on a test set is against the point of a train-val-test split. The reason test is important, is that you are only supposed to test on it when you think your model is good and ready ...
  • 2,299

Only top scored, non community-wiki answers of a minimum length are eligible