I have asked a question here, and one of the comments suggested that this is a case of severe overfitting. I made a neural network, which uses residual boosting (which is done via a KNN), and I am still just able to get < 50% accuracy on the test set.
What should I do?
I tried everything from reducing the number of epochs to replacing some layers with dropout.
Here is the source code.