Questions tagged [regression]

For questions related to regression (both linear and non-linear) in the context of machine learning and AI.

Filter by
Sorted by
Tagged with
0
votes
2answers
34 views

How do we choose the activation function for each hidden node? [duplicate]

I am new to neural networks. I would like to use them as a fitting or forecasting method. A simple NN model that does not contain hidden layers, that is, the input nodes are directly connected to the ...
2
votes
0answers
11 views

How to choose the suitable Neural Network Architecture for Regression Tasks

so I'm working on a Project where I want to predict the Vehicle Position from the Vehicle Data like speed, acceleration etc.. now the data that I have comes also with a timestamp for each sample ( I ...
0
votes
1answer
43 views

TF Keras: How to turn this probability-based classifier into single-output-neuron label-based classifier

Here's a simple image classifier implemented in TensorFlow Keras (right click to open in new tab): https://colab.research.google.com/github/tensorflow/docs/blob/master/site/en/tutorials/quickstart/...
1
vote
2answers
36 views

How to express accuracy of a regression ANN that uses MSE loss function?

I have a regression MLP network with all input values between 0 and 1, and am using MSE for the loss function. The minimum MSE over the validation sample set comes to 0.019. So how to express the '...
0
votes
1answer
38 views

How many hidden layers are needed for this training data set

I'm trying to separate classes in 3D space, the data are as in the sketch below: There are 3 classes: 0,1,2; and with the look into the sketch, it seems that I need 3 planes to separate the classes, ...
2
votes
0answers
21 views

Can two neural networks be better instead of one with a categorical feature?

Let's assume, that I have a neural network with few numerical features and one binary categorical feature. The network in this case is used for regression. I wonder if such a neural network can ...
2
votes
0answers
19 views

Confidence Maps and Non-Linearity

I am currently trying to improve a CNN architecture that was proposed for generating depth images. The architecture was originally proposed for autonomous driving and it looks like following : The ...
1
vote
1answer
41 views

Have neural networks something to offer which goes beyond regression analysis?

Neural networks are perceived as a powerful regression tool. If a dataset contains of input/output relations, the neural network can adjust it's internal parameters to interpolate the missing data. In ...
2
votes
1answer
31 views

Can supervised learning be recast as reinforcement learning problem?

Let's assume that there is a sequence of pairs $(x_i, y_i), (x_{i+1}, y_{i+1}), \dots$ of observations and corresponding labels. Let's also assume that the $x$ is considered as independent variable ...
1
vote
0answers
75 views

Polynomial Regressor vs Neural Network Regressor

So as far as my knowledge (might be a bit vague and not mathematical) goes a Neural Network can and should only be able to approximate a bounded function, which is not the case of a Polynomial ...
1
vote
0answers
20 views

Literature on Sequence Regresssion

I have some rated time-sequential data and I would like to test if an ANN can learn a correlation between my measurements and ratings. I suspect I could just try a CNN where 1 Dimension is time or an ...
0
votes
0answers
33 views

Not able to properly tune Neural Network via Back Propagation properly

I have a custom code Neural Network(not using keras or any package...Trying to learn the essence of Neural Network from scratch)... Code can be found here I have the per iteration training output(<...
1
vote
0answers
37 views

What are the possible neural network architecture for linear regression or time series regression?

I started modeling a linear regression problem using dense layers (layers.dense), which works fine. I am really excited, and now I am trying to model a time series linear regression problem using CNN, ...
3
votes
1answer
51 views

What is the relationship between degrees of freedom and the size of the training dataset?

I am going through the book Pattern Recognition by Bishop. At one point he says For $M = 9$, the training set error goes to zero, as we might expect because this polynomial contains 10 degrees of ...
1
vote
1answer
13 views

Should I model a problem with quantised output as classification or regression?

Say I have some data I am trying to learn, and I'm aware that the output is quantised in some way, e.g. I can get only get discrete values (0.1, 0.2, 0.3...0.9) in a finite range. Would you treat ...
0
votes
1answer
28 views

How can I perform multivariable regression with neural networks?

I want to use a neural network to perform a multivariable regression, where my dataset contains multiple features, but I can't for the life of me figure it out. Every kind of tutorial on the internet ...
3
votes
1answer
66 views

Which models accept numerical parameters and produce a numerical output?

I need a model that will take in a few numerical parameters, and give back a numerical answer (Context: predicting a slope based on environmental factors without having to actually take measurements ...
0
votes
0answers
20 views

why my regression model predict every datapoint to the same value

I am trying to train a SVR but I found that with some combination of features, the trained SVR predict every point in test set to the same value. this problem occurs much more when I use linear kernel ...
0
votes
1answer
34 views

Decide Number of input Parameters and Output Parameters - ANN

I have to create a Neural Network for regression purpose. Basically, I created a Model which predict next 5 values when we give past 6 values. I want to make a change in this neural network. For ...
2
votes
4answers
104 views

How is regression machine learning?

In regression, in order to minimize an error function, a functional form of hypothesis $h$ must be decided upon, and it must be assumed (as far as I'm concerned) that $f$, the true mapping of instance ...
0
votes
0answers
15 views

Auto Regression Predicting large negative number

I am using Auto Regression for prediction Library: statsmodel Sample Python Code: ...
7
votes
2answers
196 views

Which predictive algorithm can be used to predict a number given other numbers?

I am currently searching for a supervised learning algorithm that can be used to predict the output given a large enough training set. Here's a simple example. Suppose the training dataset is ...
9
votes
3answers
577 views

Do I need classification or regression to predict the availability of a user given some features?

While studying data mining methods I have come to understand that there are two main categories: Predictive methods: Classification Regression Descriptive methods: Clustering Association rules ...