1 vote

Is information gain only calculated using decrease in entropy of a dataset?

Information gain is a very specific measure in information theory, thus the entropy definition... for sure, the decrease in Gini index can be seen as a proxy for it
Alberto's user avatar
  • 1,905
1 vote
Accepted

How do I add Entropy to a PPO algorithm?

In the regular PPO formulation, which I don't believe is strictly following maximum-entropy RL, only the actor has the entropy term which is employed as a regularizer to favor exploration. (I guess ...
Luca Anzalone's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible