All Questions
Tagged with cce or categorical-crossentropy
10 questions
0
votes
0
answers
17
views
Is sparse categorical crossentropy support arbitrary custom label encoding?
As we know that in AI tools like tensorflow has loss named sparse_categorical_crossentropy which bassically ...
1
vote
1
answer
310
views
Where can I find authentic references on "categorical cross entropy" and "categorical accuracy metric"?
My Python source code uses TensorFlow and Keras to implement a neural network.
The Keras source code uses something called "categorical cross-entropy" and "categorical accuracy metric&...
- 339
0
votes
0
answers
193
views
Why is the simplest U-Net architecture giving the best (but not good enough) results on a multi-class segmentation on microscopic data?
Currently, I'm trying to optimize a training process of a neural net to improve final results. The problem I'm dealing with is multiclass segmentation on microscopic data.
The paradox is that the best ...
- 11
0
votes
1
answer
613
views
Why does my neural network to solve the XOR problem always output 0.5?
I'm trying to create a neural network to simulate an XOR gate.
Here's my dataset:
...
1
vote
1
answer
4k
views
Is it appropriate to use a softmax activation with a categorical crossentropy loss?
I have a binary classification problem where I have 2 classes. A sample is either class 1 or class 2 - For simplicity, lets say they are exclusive from one another so it is definitely one or the other....
- 171
3
votes
1
answer
4k
views
Can the (sparse) categorical cross-entropy be greater than one?
I am using AlexNet CNN to classify my dataset which contains 10 classes and 1000 data for each class, with 60-30-10, splits for train, validation, and test. I used different batch sizes, learning ...
- 160
2
votes
1
answer
2k
views
How does the implementation of the VAE's objective function equate to ELBO?
For a lot of VAE implementations I've seen in code, it's not really obvious to me how it equates to ELBO.
$$L(X)=H(Q)-H(Q:P(X,Z))=\sum_ZQ(Z)logP(Z,X)-\sum_ZQ(Z)log(Q(Z))$$
The above is the definition ...
- 805
2
votes
1
answer
321
views
Why are there two versions of softmax cross entropy? Which one to use in what situation?
I have seen 2 forms of softmax cross-entropy loss and are confused by the two. Which one is the right one?
For example in this Quora answer, there are 2 answers:
$L(\mathbf{w})=\frac{1}{N} \sum_{n=1}^...
- 123
2
votes
1
answer
131
views
How should I penalize the model proportionally to the error?
I am making an MNIST classifier. I am using categorical cross-entropy as my loss function. I want to make it so that if the correct label is 3, then it will penalize the model less heavily if it ...
- 53
4
votes
3
answers
4k
views
In which cases is the categorical cross-entropy better than the mean squared error?
In my code, I usually use the mean squared error (MSE), but the TensorFlow tutorials always use the categorical cross-entropy (CCE). Is the CCE loss function better than MSE? Or is it better only in ...
- 1,318