I'm currently trying to predict 1 output value with 52 input values. The problem is that I only have around 100 rows of data that I can use.

Will I get more accurate results when I use a small architecture than when I use multiple layers with a higher amount of neurons?

Right now, I use 1 hidden layer with 1 neuron, because of the fact that I need to solve (in my opinion) a basic regression problem.


I'm not aware of a direct way for finding the best NN architecture for a given task, but the recommended way, as far as I know, is to devise a network that can overfit the training data, and then apply regularization on top of it.

That way, you can be almost sure you're not underfitting/underperforming due to network capacity.


It's harder to overfit it certainly!

I mean practically speaking there has to be some assumptions on the generation model of your data, either explicit or implicit.

I would try probably 1-2 layer network first(maybe your data is linearly separable if you're lucky).


Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.