Questions tagged [entropy]

For questions about the concept of (information) entropy in the context of artificial intelligence.

Filter by
Sorted by
Tagged with
0 votes
1 answer

What does the product of probabilities raised to own powers used for entropy calculation quantify?

Suppose $X$ is a random variable taking $k$ values. $$Val(X) = \{x_1, x_2, x_3, \cdots, x_k\} $$ Then what is the following expression of $N(X)$ called in literature if exists? What does it signify? $$...
  • 3,391