Questions tagged [minimum-description-length]

For questions related to the minimum description length (MDL) principle, which is a formalization of Occam's razor in which the best hypothesis (a model and its parameters) for a given set of data is the one that leads to the best compression of the data. MDL was introduced in the paper "Modeling by shortest data description" by Jorma Rissanen in 1978.

1 question with no upvoted or accepted answers
Filter by
Sorted by
Tagged with

How does NN follows law of energy conservation?

Communication requires energy, and using energy requires communication. According to Shannon, the entropy value of a piece of information provides an absolute limit on the shortest possible average ...