Questions tagged [entropy]

For questions about the concept of (information) entropy in the context of artificial intelligence.

Filter by
Sorted by
Tagged with
0
votes
0answers
17 views

Product of probabilities raised to own powers that can be used for entropy calculation

Suppose $X$ is a random variable taking $k$ values. $$Val(X) = \{x_1, x_2, x_3, \cdots, x_k\} $$ Then what is the following expression of $N(X)$ called in literature? What does it signify? $$ N(X) = \...