Questions tagged [underfitting]

For questions related to the concept of underfitting in machine learning, which occurs when a machine learning model is not able to learn.

Filter by
Sorted by
Tagged with
1
vote
0answers
28 views

Identifying if a model is over or under-fitting via graphs

I am working on a Neural Network and have plotted the performance of my model. However the plots seem not to fit the "trends" (which help you identify the issue with your model) presented in ...
1
vote
0answers
28 views

Underfitting a single batch: Can't cause autoencoder to overfit multi-sample batches of 1d data. How to debug?

TL;DR I am unable to overfit batches with multiple samples using autoencoder. Fully connected decoder seems to handle more samples per batch than conv decoder, but then also fails when number of ...
3
votes
1answer
216 views

Is there a connection between the bias term in a linear regression model and the bias that can lead to under-fitting?

Here is a linear regression model $$y = mx + b,$$ where $b$ is known as $y$-intercept, but also known as the bias [1], $m$ is the slope, and $x$ is the feature vector. As I understood, in machine ...
3
votes
0answers
84 views

Are there principled ways of tuning a neural network in case of overfitting and underfitting?

Whenever I tune my neural network, I usually take the common approach of defining some layers with some neurons. If it overfits, I reduce the layers, neurons, add dropout, utilize regularisation. ...
1
vote
2answers
794 views

Is my GRU model under-fitting given this plot of the training and validation loss?

I was running my gated recurrent unit (GRU) model. I wanted to get an opinion if my loss and validation loss graph is good or not, since I'm new to this and don't really know if that is considered ...
5
votes
1answer
83 views

Why would the application of boosting prevent underfitting?

"Why would the application of boosting prevent underfitting?" I read in some paper that applying boosting would prevent you from underfitting. Why is that? Source: https://www.cs.cornell.edu/...
1
vote
1answer
71 views

TensorFlow estimator DNNClassifier fails to fit simple data

The ready-to-use DNNClassifier in tf.estimator seems not able to fit these data: ...
1
vote
2answers
164 views

Which model is better given their training and validation errors?

Below you have the plots of the training and validation errors for two different models. Both plots show the RMSE values for the validation dataset versus the number of training epochs. It is observed ...