2 votes

How can a machine learning problem be reduced as a communication problem?

Information-theoretic view of Bayesian learning I once heard that the problem of approximating an unknown function can be modeled as a communication problem. How is this possible? Yes, this is ...
  • 35.5k
1 vote

Can feature engineering change the selection of the model according to the minimum description length?

I think the wrong assumption here is that you've forgotten the cost of encoding the new features! MDL should be considered relative to the original or raw dataset. The idea is that you want to find ...

Only top scored, non community-wiki answers of a minimum length are eligible