All Questions
Tagged with ce or cross-entropy
9 questions with no upvoted or accepted answers
3
votes
0
answers
3k
views
Focal Loss vs Weighted Cross Entropy Loss
Weighted Focal Loss is defined like so
$FL(p_t) = -\alpha_t log(p_t) (1-p_t)^\gamma $
Whereas weighted Cross Entropy Loss is defined like so
$CE(p_t) = -\alpha_t log(p_t)$
Some blog posts try to ...
- 789
3
votes
0
answers
379
views
How do I implement the cross-entropy-method for a RL environment with a continuous action space?
I found many tutorials and posts on how to solve RL environments with discrete action spaces using the cross entropy method (e.g., in this blog post for the OpenAI Gym frozen lake environment).
...
- 143
3
votes
0
answers
70
views
Is maximum likelihood estimation meaningless for a dataset of only outliers?
From my understanding, maximum likelihood estimation chooses the set of parameters for the estimator that maximizes likelihood with the ground truth distribution.
I always interpreted it as the ...
- 1,419
2
votes
1
answer
2k
views
How are weights for weighted x-entropy loss on imbalanced data calculated?
I am trying to build a classifier which should be trained with the cross entropy loss. The training data is highly class-imbalanced. To tackle this, I've gone through the advice of the tensorflow docs
...
- 21
2
votes
0
answers
222
views
Can the cross-entropy loss be used for a NLP task with LSTM?
I am trying to build an LSTM model to generate Shakspeare-like poems. I have training set $\{s_1,s_2, \dots,s_m\}$, which are sentences of Shakespeare poems, and each sentence contains words $\{w_1,...
- 43
1
vote
0
answers
21
views
What about the loss and custom metric with per-pair weights in multi-class classification?
Let's suppose that we have a multi-class classification problem with 5 classes: 0, 1, 2, 3, 4. The order is not random, they are neighbors. For example, imagine that a labelling is 1. If the ...
- 111
0
votes
0
answers
13
views
Incredibly High CrossEntropyLoss in Sequence-to-Sequence Generation
I'm trying to do SMILES chemical representation prediction from a large dataset (Around 5M Samples) to teach it do predict another downstream task. The model's part responsible for generating the data ...
- 101
0
votes
0
answers
80
views
Reinforcement learning - calculating policy gradient using cross entropy loss
I am writing a program that uses reinforcement learning and the policy gradient method to play Pong. It basically extends Andrej Karpathy's version (https://gist.github.com/karpathy/...
- 1
0
votes
0
answers
455
views
How to optimize ELBO(VAE's loss function)?
Suppose we've got the following formula:
$\log p(x;\theta)=\mathbb{E}_{q(z|x;\phi)}[\log p(x,z;\theta)-\log q(z|x;\phi)]+KL(q(z|x;\phi)||p(z|x;\theta))\\ \geq \mathbb{E}_{q(z|x;\phi)}[\log p(x,z;\...
- 11