Mohith Kaameswaran Sakthivel
  • Member for 11 months
  • Last seen more than a week ago
Is the optimal policy the one with the highest accumulative reward (Q-Learning vs SARSA)?
2 votes

Adding to Neil's reply, though the path shown is optimal, following the so-called 'optimal path' will often result in sub-optimal returns because the action selection in this problem is stochastic due ...

View answer
In the MINE paper, why is $\hat{G}_B$ biased, and how does the exponential moving average reduce the bias?
Accepted answer
2 votes

The lower bound in MINE is as follows: $$\widehat{I(X;Z)}_n = \sup_{\theta\in\Theta} \mathbb{E}_{\mathbb{P}_{XZ}^{(n)}}[T_\theta] - \log{\mathbb{E}_{\mathbb{P}_X^{(n)} \otimes \hat{\mathbb{P}}_Z^{(n)}}...

View answer
What is the difference between Bayes-adaptive MDP and a Belief-MDP in Reinforcement Learning?
2 votes

Both Belief-MDPs and Bayes-Adaptive MDPs (BAMDPs) are special cases of POMDPs and their state space is augmented with a belief over their unobserved/hidden variables. In a belief-MDP, the hidden ...

View answer
What are the state-of-the-art meta-reinforcement learning methods?
1 votes

Meta-Reinforcement Learning can refer to a broad range of ideas. Also, different algorithms are SOTA under different evaluation metrics (sample efficiency, agent performance, adaptation speed on a new ...

View answer