Questions tagged [pointwise-mutual-information]

Filter by
Sorted by
Tagged with
1
vote
1answer
45 views

How do very rare words tend to have very high PMI values?

Consider the following formulation for pointwise mutual information (PMI): $$\text{PMI}(w, c) = \dfrac{p(w, c)}{p(w)p(c)}$$ Suppose there are $W$ words with $C$ context words. Then one can write in ...