Skip to main content

Questions tagged [non-linear-regression]

In statistics, nonlinear regression is a form of regression analysis in which observational data are modeled by a function which is a nonlinear combination of the model parameters and depends on one or more independent variables. The data are fitted by a method of successive approximations. It is used in place when the data shows a curvy trend, and linear regression would not produce very accurate results when compared to non-linear regression.

Filter by
Sorted by
Tagged with
0 votes
0 answers
8 views

How do nonlinear relationships affect casuality determination

Let's assume that I have only one independent variable and one dependent, and I have a great model with minimal error which deals well with predicting. Let's also assume that I do no know the true ...
Igor's user avatar
  • 183
0 votes
0 answers
45 views

Find the relationship between data in this plot

Attached image. How would you find the relationship between independent variable (x) and dependent variable (y)? Is it linear or non-linear? What would the function looks like? P.S. I believe this is ...
DLCVIP007's user avatar
1 vote
1 answer
81 views

Optimizing a blackbox function with binary states

I have a non-linear black box function, which inputs a vector(size=250) and outputs a scalar value; f(x) = value. The x variable is a vector of size 250 and has ...
oakca's user avatar
  • 111
1 vote
0 answers
202 views

Active Learning regression with Random Forest

I have a dataset of about 8k points and I am trying to employ active learning with the random forest regressor. I have split the dataset to train and ...
ado sar's user avatar
  • 150
1 vote
1 answer
87 views

Does a second-order fully-connected layer have any uses?

I was thinking about implementing second-order regression via a fully-connected layer, and I came up with this: $X$ is the input data, shaped $(features, batch\_number)$. $w0$ is the bias, shaped $(...
HappyFace's user avatar
  • 113
1 vote
0 answers
167 views

Neural Network for Picking Parameters of a Nonlinear Function to Data Points

I'm trying to make a neural network in pytorch that picks the parameters of a nonlinear function, the radius and (x,y) center of a circle in the example below, based on a sample of values from the ...
mldichter's user avatar
6 votes
1 answer
2k views

What is the difference between neural networks and other ways of curve fitting?

For simplicity, let's assume we want to solve a regression problem, where we have one independent variable and one dependent variable, which we want to predict. Let's also assume that there is a ...
Igor's user avatar
  • 183
1 vote
1 answer
177 views

When are multiple hidden layers necessary?

I know that my question probably seems like being asked many times, but Ill try to be more speciffic: Limitations to my question: I am NOT asking about convolutional neural networks, so please, try ...
Igor's user avatar
  • 183
0 votes
3 answers
154 views

What ML algorithm should I use that suits this data?

What if I have some data, let's say I'm trying to answer if education level and IQ affect earnings, and I want to analyze this data and put in a regression model to predict earnings based on the IQ ...
JingleBells's user avatar
1 vote
1 answer
116 views

If features are always positives, why do we use RELU activation functions?

When does it happen that a layer (either first or hidden) outputs negative values in order to justify the use of RELU? As far as I know, features are never negative or converted to negative in any ...
sujeto1's user avatar
  • 129
1 vote
1 answer
3k views

solving xor function using a neural network with no hidden layers

xor is a non-linear dataset. It cannot be solved with any number of perceptron based neural network but when the perceptions are applied the sigmoid activation function, we can solve the xor dataset. ...
Hrushi's user avatar
  • 159
2 votes
0 answers
35 views

Regularization of non-linear parameters?

I was wondering whether it is possible to regularize (L1 or L2) non-linear parameters in a general regression model. Say, I have the following non-linear least squares cost function, where $p$ is a $...
David's user avatar
  • 21
2 votes
1 answer
773 views

What is the difference between linear and non-linear regression?

In machine learning, I understand that linear regression assumes that parameters or weights in equation should be linear. For Example: $$y = w_1x_1 + w_2x_2$$ is a linear equation where $x_1$ and $...
ka1shi's user avatar
  • 43
1 vote
2 answers
536 views

Which AI technique is best suited to discovering non-linear relationships in data?

I am interested in exploring whether AI techniques can derive hidden patterns of relationships in a data set. For example, from among house size, lot size, age of house and asking price, what formula ...
GGizmos's user avatar
  • 113
3 votes
3 answers
286 views

Is Deep Learning the repeated application of Linear Regression?

Is Deep Learning the repeated application of Linear Regression?
user8740537's user avatar