Skip to main content
4 votes

Why is my implementation of Q-learning not converging to the right values in the FrozenLake environment?

I was able to solve the problem. The main issue for non-convergence was that I was not decaying the learning rate appropriately. I put a decay rate of $-0.00005$ on the learning rate ...
abkds's user avatar
  • 191
3 votes

What should the discount factor for the non-slippery version of the FrozenLake environment be?

After trying to understand what was happening by going through the algorithm on paper (below), I found all values were the same, so greedifying with respect to the value function often just had the ...
Neil Slater's user avatar
  • 32.7k
1 vote

My first experience with gym environment has raised many questions, and I need some guidance

Q1. What is this gym environment warning all about, and how should it be properly addressed? The development of gym has ended I think. Anyway the error is about an ...
Luca Anzalone's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible