Skip to main content

Questions tagged [maximum-likelihood]

For questions related to maximum likelihood estimation (MLE), which is a frequentist approach for estimating the parameters of an assumed probability distribution given some observed data. This is done by maximizing a likelihood function so that, under the assumed statistical model, the observed data is most probable. The resulting estimate is known as the maximum likelihood estimate.

Filter by
Sorted by
Tagged with
4 votes
1 answer
49 views

Likelihood function for Gaussian Discriminant Analsis

Im trying to understand how the likelhood function for gaussian discriminant analysis is derived. I self studying Murphy's Probabilistic Machine learning, and in it, he states the likelihood function ...
turtle_in_mind's user avatar
1 vote
2 answers
75 views

"a good model (with low loss) is one that assigns a high probability to the true output $y$ for each corresponding input $\mathbf{x}$"?

Chapter 1.2.1.6 Maximum likelihood estimation of Probabilistic Machine Learning: An Introduction by Kevin P. Murphy says the following: When fitting probabilistic models, it is common to use the ...
The Pointer's user avatar
0 votes
1 answer
27 views

Can I sample finite or infinite images with AutoRegressive Models?

I'm learning about AutoRegressive Models used on images, and I've studied the training phase, where you model each pixel on the basis of the previous ones using a certain model architecture. My ...
SuperFluo's user avatar
1 vote
1 answer
61 views

I am confused of derivation steps of MAP for linear regression

I am taking ML course and I am confused about some derivations of math Could you explain the two steps I marked on the slides? For the first step, I thought $P(beta|X,y) = \frac{P(X,y|beta)P(beta)}{P(...
tesio's user avatar
  • 205
1 vote
0 answers
90 views

Is VAE the same as the E-step of the EM algorithm?

EM(Expectation Maximum) Target: maximize $p_\theta(x)$ $ p_\theta(x)=\frac{p_\theta(x, z)}{p_\theta(z \mid x)} \\\\$ Take log on both sides: $ \log p_\theta(x)=\log p_\theta(x, z)-\log p_\theta(z \...
Garfield's user avatar
1 vote
0 answers
22 views

Optimize parametric Log-Likelihood with a Decision Tree

Suppose there are some objects with features, and the target is parametric density estimation. Density estimation is model-based. Parameters are obtained by maximizing log-likelihood. $LL = \sum_{i \...
nekrald's user avatar
  • 11
1 vote
0 answers
30 views

Why can't recurrent neural network handle large corpus for obtaining embeddings?

In order to learn the embeddings, we need to train a model based on some objective function. The model can be an RNN and the objective function can be the likelihood. We learn the embeddings by ...
hanugm's user avatar
  • 3,890
0 votes
1 answer
107 views

Does the Bayesian MAP give a probability distribution over unseen t*?

I'm working my way through the Bayesian world. So far, I've understood that the MLE or the MPA are point estimates, therefore using such models just output one specific value and not a distribution. ...
Micha Christ's user avatar
3 votes
1 answer
329 views

How can a probability density value be used for the likelihood calculation?

Consider our parametric model $p_\theta$ for an underlying probabilistic distribution $p_{data}$. Now, the likelihood of an observation $x$ is generally defined as $L(\theta|x) = p_{\theta}(x)$. The ...
hanugm's user avatar
  • 3,890
2 votes
1 answer
101 views

What is emperical distribution in MLE?

I was reading the book Deep Learning by Ian Goodfellow. I had a doubt in the Maximum likelihood estimation section (Pg 131). I understand till the Eq 5.58 which describes what is being maximized in ...
ANIRUDH BUVANESH's user avatar
1 vote
0 answers
55 views

Estimating $\sigma_i$ according to maximum likelihood method

Let be a Bayesian multivariate normal distribution classifier with distinct covariance matrices for each class and isotropic, i.e. with equal values over the entire diagonal and zero otherwise, $\...
David's user avatar
  • 113
3 votes
0 answers
63 views

Is maximum likelihood estimation meaningless for a dataset of only outliers?

From my understanding, maximum likelihood estimation chooses the set of parameters for the estimator that maximizes likelihood with the ground truth distribution. I always interpreted it as the ...
ashenoy's user avatar
  • 1,419
2 votes
0 answers
214 views

Can the cross-entropy loss be used for a NLP task with LSTM?

I am trying to build an LSTM model to generate Shakspeare-like poems. I have training set $\{s_1,s_2, \dots,s_m\}$, which are sentences of Shakespeare poems, and each sentence contains words $\{w_1,...
Leey's user avatar
  • 43
1 vote
2 answers
270 views

Can maximum likelihood be used as a classifier?

I am confused in understanding the maximum likelihood as a classifier. I know what is Bayesian network and I know that ML is used for estimating the parameters of models. Also, I read that there are ...
Atena's user avatar
  • 131
3 votes
1 answer
217 views

What is the relationship between MLE and naive Bayes?

I have found various references describing Naive Bayes and they all demonstrated that it used MLE for the calculation. However, this is my understanding: $P(y=c|x)$ $\propto$ $P(x|y=c)P(y=c)$ with $...
Shrike Danny's user avatar
2 votes
1 answer
116 views

Understanding the math behind using maximum likelihood for linear regression

I understand both terms, linear regression and maximum likelihood, but, when it comes to the math, I am totally lost. So I am reading this article The Principle of Maximum Likelihood (by Suriyadeepan ...
xava's user avatar
  • 423