Timeline for Why does a PPO agent perform only the action that costs the least?
Current License: CC BY-SA 4.0
4 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Aug 11, 2022 at 5:49 | vote | accept | Francesco | ||
| Aug 10, 2022 at 18:28 | answer | added | mdc | timeline score: 1 | |
| Aug 6, 2022 at 0:14 | comment | added | mdc | The agent has probably learned that it's not worthwhile to explore further, and greedily minimizes cost by taking the least expensive action. I haven't looked at the environment, but one simple test could be to increase the entropy bonus of PPO, and see if the policy explores more (you can keep track of the policy's entropy to see if this is indeed the issue). | |
| Aug 5, 2022 at 18:06 | history | asked | Francesco | CC BY-SA 4.0 |