Questions tagged [linear-regression]

For questions related to the theory or application of linear regression.

Filter by
Sorted by
Tagged with
0
votes
1answer
32 views

What ML algorithm should I use that suits this data?

What if I have some data, let's say I'm trying to answer if education level and IQ affect earnings, and I want to analyze this data and put in a regression model to predict earnings based on the IQ ...
0
votes
0answers
44 views

Predict probability of user making a conversion

My dear friends, In the past couple of years I read a lot about AI with JS and some libraries like TensorFlow. I have great interest in the subject but never used it on a serious project. However, ...
1
vote
1answer
40 views

Do correlations matter when building neural networks?

I am new to working with neural networks. However, I have built some linear regression models in the past. My question is, is it worth looking for features with a correlation to my target variable as ...
1
vote
1answer
32 views

Why is the hypothesis function $h_{\theta}(x)$ equivalent to $E[y | x; \theta]$ in generalised linear models?

Reading through the CS229 lecture notes on generalised linear models, I came across the idea that a linear regression problem can be modelled as a Gaussian distribution, which is a form of the ...
1
vote
1answer
60 views

If features are always positives, why do we use RELU activation functions?

When does it happen that a layer (either first or hidden) outputs negative values in order to justify the use of RELU? As far as I know, features are never negative or converted to negative in any ...
1
vote
0answers
24 views

3d representation of a regression with two independent variables one of them is categorical and another is continuous

I have hopefully a fundamental question of Do I understand things right. (Thank you in advance and sorry for my English which might be not so good) 1-Preambula 1: I know that if we have 2 independent ...
1
vote
1answer
51 views

Is there any way to apply linear transformations on a vector other than matrix multiplication?

I am trying to optimize the cost function calculation in regression analysis using a non-matrix multiplication based approach. More specifically, I have a point $x = (1, 1, 2, 3)$, to which I want to ...
3
votes
0answers
56 views

How to implement Mean square error loss function in mini batch GD

I have a vectorized implementation of the neural network in c++. I successfully solve the classification problems of Fashion MNIST and CIFAR. Now I am modifying my code to do the Linear regression. I ...
2
votes
1answer
54 views

Do I need to denormalise results in linear regression?

I have learned so far how to linear regression with one or multiple features. So far, so good, everything seems to work fine, at least for my first simple examples. However, I now need to normalise ...
1
vote
0answers
27 views

What is the difference between an generalised estimating equation and a recurrent neural network?

What is the difference between a generalised estimating equation (GEE) model and a recurrent neural network (RNN) model, in terms of what these two models are doing? Apart from the differences in the ...
0
votes
0answers
18 views

Computing latent representation for multi-domain regression/classification

Suppose I have a dataset with (X, Y) training samples where X is a 1 dimension, and Y is also 1 dimension. Example: if this is a housing price dataset, X would be an area in square feet, and Y would ...
2
votes
1answer
75 views

What is the difference between linear and non-linear regression?

In machine learning, I understand that linear regression assumes that parameters or weights in equation should be linear. For Example: $$y = w_1x_1 + w_2x_2$$ is a linear equation where $x_1$ and $...
0
votes
2answers
147 views

How do we choose the activation function for each hidden node? [duplicate]

I am new to neural networks. I would like to use them as a fitting or forecasting method. A simple NN model that does not contain hidden layers, that is, the input nodes are directly connected to the ...
0
votes
2answers
34 views

Is it still called linear separation with a layer of more than 1 neuron

A single neuron will be able to do linear separation. For example, XOR simulator network: ...
0
votes
1answer
29 views

Solution to classify product names

I have a bunch of training data for classifying product names, around 30,000 samples. The task is to classify these product names into types of product, around 100 classes (single words). For example:...
1
vote
1answer
57 views

TensorFlow estimator DNNClassifier fails to fit simple data

The ready-to-use DNNClassifier in tf.estimator seems not able to fit these data: ...
2
votes
4answers
122 views

How is regression machine learning?

In regression, in order to minimize an error function, a functional form of hypothesis $h$ must be decided upon, and it must be assumed (as far as I'm concerned) that $f$, the true mapping of instance ...
2
votes
1answer
34 views

Calculating Parameter value Using Gradient Descent for Linear Regression Model

Consider the following data with one input (x) and one output (y): (x=1, y=2) (x=2, y=1) (x=3, y=2) Apply linear regression on this data, using the hypothesis $h_Θ(x) = Θ_0 + Θ_1 x$, where $...
4
votes
2answers
200 views

Is there a machine learning algorithm to find similar sales patterns?

I have a dataset as follows (and the table extends to include an extra 146 columns for companies 4-149) Is there an algorithm I could use effectively to find similar patterns in sales from the other ...
1
vote
1answer
52 views

Auto-regression - Reduce error in prediction

I am trying to develop a time series model using autoregression. The data set is like as follows ...
1
vote
0answers
120 views

Actor-critic algorithm using gaussian Radial Basis Function, Local Linear Regression and shallow Neural Network

I'm attempting to implement the actor-critic algorithm on Matlab using Radial Basis Function, Local Linear Regression, and shallow Neural Network for inverted pendulum system. the state space and the ...
0
votes
0answers
38 views

Can we compare MAE MSE results with categorical_crossentropy?

can i compare MAE and MSE loss results of a regression CNN with categorical_crossentropy loss of a classification CNN if they both have similar tasks? is yes how to?
1
vote
0answers
26 views

What Model Used for Forecasting Sales with Dynamic Holiday

I'm working on a project where I need to forecast sales data where I have history of 1 year (2017) daily data. I am new on Artificial Intelligence topic and after searching for a while, I think ARIMA ...
0
votes
2answers
94 views

How to make machine learning model that reports ambiguity of the input?

Suppose I want to build a neural network regression model that takes one input and return one output. Here's the training data: ...
2
votes
1answer
54 views

Will LMS always be convex function? If yes, then why do we change it for neural networks?

In LMS(least mean square) since, we use a quadratic error function, and quadratic functions are generally parabola in (some convex like shape). I wonder whether that is the reason why we use least ...
3
votes
2answers
170 views

What makes a machine learning algorithm a low variance one or a high variance one?

Some examples of low-variance machine learning algorithms include linear regression, linear discriminant analysis, and logistic regression. Examples of high-variance machine learning algorithms ...
2
votes
1answer
202 views

Does the correlation between inputs affect the model performance?

I'm currently working on a regression problem and I have 10 inputs/attributes. What should I do if there are correlations between different features of the input data? Does the correlation between ...
0
votes
1answer
33 views

Is there a relationship between the response and predictors?

I have been reading introduction to statistical learning, and I was going through multiple linear regression. This is the topic that I'm reading: As I was reading further, I encountered an equation ...
2
votes
1answer
72 views

Understanding the math behind using maximum likelihood for linear regression

I understand both terms, linear regression and maximum likelihood, but, when it comes to the math, I am totally lost. So I am reading this article The Principle of Maximum Likelihood (by Suriyadeepan ...
6
votes
3answers
874 views

What is the difference between hypothesis space and representational capacity?

I am reading Goodfellow et al Deeplearning Book. I found it difficult to understand the difference between the definition of the hypothesis space and representation capacity of a model. In Chapter 5,...
3
votes
2answers
1k views

Matrix Dimension for Linear regression coefficients

While reading about least squares implementation for machine learning I came across this passage in the following two photos: Perhaps I’m misinterpreting the meaning of beta but if X^T has dimension ...
5
votes
1answer
265 views

Regression on extreme values

I have a data set that looks like this: I would like to estimate a relationship between x-values and the corresponding 5% extreme y-values, something that might look like that : Do you have an idea ...
4
votes
1answer
852 views

How do you handle multiple categorical values in a single column for wide_deep model in tensorflow? [closed]

To start, let me just say that I am very new to tensorflow and Machine Learning in general. But, as part of my learning project I am trying to adapt the tensorflow wide and deep model to generate ...
6
votes
0answers
334 views

Can we use the recursive least squares as a learning algorithm to an ADALINE?

I'm new to neural network, I study electrical engineering, and I just started working with ADALINEs. I use Matlab, and in their Documentation they cite : However, here the LMS (least mean squares) ...
2
votes
2answers
462 views

How is direction of weight change determined by Gradient Descent algorithm

The result of gradient descent algorithm is a vector. So how does this algorithm decide the direction for weight change? We Give hyperparameters for step size. But how is the vector direction for ...
0
votes
1answer
76 views

multi vs one prediction using Regression

I was trying to build a prediction system where I have the input data arranged in multiple columns. The input data would be of the type where I have weather, service type (bronze, silver, gold), size(...
1
vote
2answers
61 views

In the multi-linear regression, how is the value of weight $b_2$ calculated?

In multivariate linear regression (linear regression with more than one variable) the model is $yi = b_0 + b_1x_{1i} + b_2x_{2i} + ...$ , and so on. But how is the $b_n$ value calculated iteratively? ...
3
votes
3answers
217 views

Understanding a few terms in Andrew Ng's definition of the cost function for linear regression

I have completed week 1 of Andrew Ng's course. I understand that the cost function for linear regression is defined as $J (\theta_0, \theta_1) = 1/2m*\sum (h(x)-y)^2$ and the $h$ is defined as $h(x) = ...
5
votes
1answer
779 views

What to do if CNN cannot overfit a training set on adding dropout?

I have been trying to use CNN for a regression problem. I followed the standard recommendation of disabling dropout and overfitting a small training set prior to trying for generalization. With a 10 ...
1
vote
0answers
23 views

Can number of Leads be predicted based on previous months

I have a sample set of data about Leads that gets generated every day. Leads are nothing but a user expressing request to be our partner or not. Sample data set is as shown below ...
3
votes
1answer
105 views

Predict value from image set

I have a large dataset of skin images, each one associated with a hydration value (percentage). Now I'm looking into predicting the hydration value from an image. My thinking: train a CNN on the ...
2
votes
1answer
40 views

How to choose evaluation functions for features, when network effects are in place (multi-agent systems)?

So, I have this huge amount of data, which has 7 vector features (float from 0 to 1). I am trying to build a kind of recommendation system, with a twist (it uses agents and negotiations and narratives;...
2
votes
0answers
71 views

What are suitable predictive analytics models for data from multiple sensors?

I am a newbie in the field of AI/ML. I am trying to implement predictive analytics model on the data generated and collected every minute from a device with sensors. I have two questions: What are ...
1
vote
2answers
178 views

Is Deep Learning the repeated application of Linear Regression?

Looking for an explanation of the linear regression estimation method in deep learning.
7
votes
5answers
2k views

Linear regression: why is distance *squared* used as an error metric?

Usually when performing linear regression predictions and gradient descent, the measure of the level of error for a particular line will be measured by the sum of the squared-distance values. Why ...
3
votes
1answer
139 views

With gradient descent w/MSE on a regression, must/should every Epoch use the exact same training samples?

Let's say I've got a training sample set of 1 million records, which I pull batches of 100 from to train a basic regression model using gradient descent and MSE as a loss function. Assume test and ...
3
votes
0answers
66 views

How exactly does a validation data-set work work in machine learning? [closed]

With typical machine learning you would usually use a training data-set to create a model of some kind, and a testing data-set to then test the newly created model. For something like linear ...