Questions tagged [logistic-regression]

The tag has no usage guidance.

15 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
0answers
376 views

What is the right formula for weight update rule in Logistic Regression using stochastic gradient descent

Apologies for the lengthy title. My question is about the weight update rule for logistic regression using stochastic gradient descent. I have just started experimenting on Logistic Regression. I ...
3
votes
1answer
79 views

What is meant by “the number of examples is reduced”, and why is this the case?

I am currently studying the paper Learning and Evaluating Classifiers under Sample Selection Bias by Bianca Zadrozny. In section 3.2. Logistic Regression, the author says the following: 3.2. Logistic ...
2
votes
0answers
36 views

Is logistic regression used for unconstrained or constrained optimisation problems?

Is logistic regression used for unconstrained or constrained optimization problems, and why?
2
votes
1answer
51 views

Is it compulsary to normalize the dataset if doing so can negatively impact a Binary Logistic regression performance?

I am using raw data set with 4 feature variables (Total Cholesterol, Systolic Blood Pressure, Diastolic Blood Pressure, and Cigraeette count) to do a Binominal Classification (find stroke likelihood) ...
2
votes
0answers
65 views

How to define cost function for custom nonlinear functions?

For logistic regression, the Cost function is defined as: \begin{equation} Cost(h_{\theta}(x)-y) = -ylog(h_{\theta}(x))-(1-y)log(1-h_{\theta}(x)) \end{equation} I now have a nonlinear function \begin{...
1
vote
0answers
19 views

Is it possible to compute the logical AND and OR with logistic regression?

It's easy to build a perceptron that can compute the logical AND and OR functions of its binary inputs. Logistic regression could be used as a binary classifier. $$z^{(i)} = w^T x^{(i)} + b$$ $$\hat{y}...
1
vote
0answers
21 views

Is the main difference between the logistic regression and the perceptron the activation function they use?

I went through a Stats StackExchange's post about the difference between logistic regression and perceptron, which is too long to get the key point. I'd like to consider the question in terms of the ...
1
vote
0answers
20 views

Neural network algorithm implementation for Iris dataset

I want to use Neural network algorithm over famous Iris dataset. Iris dataset attributes names sepal length in cm sepal width in cm petal length in cm petal width in cm Sample dataset: ...
1
vote
0answers
38 views

Given the same features, do logistic regression and neural networks produce the same output?

I have a binary classification problem. I have variables (features) var1, var2, var3, ..., var14. Using these variables (aka features) in a logistic regression, I get their weights. If I use the same ...
0
votes
0answers
22 views

Derivation of an probability expansion used in Word2Vec classifier model

We are using the following notations, for this question, to calculate the probability values \begin{array}{|c|c|} \hline \text{$w$} & \text{target word embedding vector} \\ \hline \text{$c$} &...
0
votes
0answers
19 views

Architecture for Logistic Regression with Arbitrary Number of Options

Suppose I want to design a neural network to choose one of several mutually exclusive options. This may normally be done via logistic regression, where the input of the network would be a [batch x ...
0
votes
0answers
22 views

How do we interpret the images of weights in logistic regression

The following images are a) The weights of a logistic regression model trained on MNIST. b) The sign of the weights of a logistic regression How do these images represent the weights? Would be ...
0
votes
0answers
69 views

How to frame this problem using RL?

How should this problem be framed in the domain of RL for preventing users from exceeding their bank account balance and being overdrawn? For example, a user has 1000 in an account, and proceeds to ...
0
votes
1answer
75 views

Hyper-plane in logistic regression vs linear regression for same number of features

Geometric interpretation of Logistic Regression and Linear regression is considered here. I was going through Logistic regression and Linear regression. In the optimization equation of both following ...
0
votes
0answers
35 views

How can the bias and the coefficient be calculated in logistic regression?

How can the bias, $b_0$, and the coefficient for the single input value, $b_1$, be calculated in logistic regression? I am trying to calculate these coefficients with pure Python. Can anybody ...