All Questions
1 question
0
votes
0
answers
49
views
Should we sum or mean reduce the KL loss in Bayes by Backprop?
I'm unsure if you're supposed to use sum or mean reduction of KL loss for Bayes by Backprop. For example, the BayesianTorch library does both: it reduces by mean across each individual tensor (as seen ...
- 454