Questions tagged [perplexity]
For questions related to the concept of perplexity in machine learning, information theory and natural language processing.
3 questions
0
votes
1
answer
22
views
Is there any scientific work that has measured the perplexity achievable using just word2vec?
I know word2vec is not enough to achieve high quality text prediction just by itself. But has any scientific work tried to do it anyway, just to know what the baseline is that you have to beat with ...
- 111
1
vote
1
answer
79
views
How are perplexities over multiple instance aggregated?
The perplexity of the $i^{th}$ token in the $k^{th}$ sequence is
$$
P_{ki} = \frac{1}{p(t_{ki})}
$$
The perplexity aggregated for the $k^{th}$ sequence is then
$$
P_{k} = \left(\prod_{i=1}^N P_{ki}\...
- 210
8
votes
2
answers
2k
views
Why is the perplexity a good evaluation metric for chatbots?
A few papers I have come across say that BLEU is not an appropriate evaluation metric for chatbots, so they use the perplexity.
First of all, what is perplexity? How to calculate it? And why is ...
- 89