Skip to main content
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity
  • Member for 2 years, 4 months
  • Last seen more than a week ago
0 votes
1 answer
65 views

What are disadvantages/limitations of Monte Carlo Tree Search in RL?

1 vote
1 answer
44 views

Confusing convention in Sutto-Barto on Monte Carlo Tree Search: is a leaf node a state leaf node or state-action leaf node?

-2 votes
1 answer
32 views

Unclear line in prioritized sweeping algorithm [closed]

-1 votes
0 answers
11 views

For simulated experience, Rollout algorithms = classical MC control? [closed]

-2 votes
0 answers
23 views

Advantage of Monte Carlo Tree Search over Rollout

0 votes
0 answers
36 views

What are the update equations for Double Expected Sarsa with an $\epsilon$-greedy target policy?

-1 votes
1 answer
74 views

Violation of Markov property

0 votes
1 answer
43 views

Confusing statement in Sutton-Barto on trajectory sampling

0 votes
0 answers
29 views

Confusing statement in Sutton-Barto on expected versus sample updates

0 votes
2 answers
70 views

Why is dynamic programming an example of planning?

0 votes
0 answers
12 views

Is this a typo in n-step tree backup section in Sutton-Barto?

1 vote
1 answer
21 views

Why is importance sampling ratio in n-step TD multiplying error rather than return n-step return?

0 votes
2 answers
26 views

Confusing points in Dyna-Q in Sutton-Barto about model, simulated experience and model predictions

0 votes
1 answer
19 views

Unclear points in Dyna Maze example in Sutton-Barto

0 votes
1 answer
17 views

Confusing point point in Dyna-Q

0 votes
1 answer
20 views

Unclear arrow in general Dyna architecture

0 votes
1 answer
27 views

What is the backed-up value in dynamic programming and the corresponding update based on this backed up value?

0 votes
0 answers
14 views

Are these typos in n-step tree backup section in Sutton-Barto?

0 votes
1 answer
40 views

Why no falling off cliff in SARSA for the example in Sutton-Barto?

0 votes
0 answers
15 views

Unclear point in n-step state value estimation

0 votes
0 answers
33 views

Sutton-Barto confusing notation for the target and behaviour policy in the expected sarsa

1 vote
2 answers
73 views

Why is there no exploration-optimality trade-off in Q-learning?

-1 votes
1 answer
41 views

Suppose action selection is greedy. Is Q-learning then exactly the same algorithm as Sarsa?

0 votes
1 answer
59 views

It is not clear why SARSA is on-policy but Q-learning off-policy

1 vote
1 answer
41 views

Unclear sentence in Sutton-Barto in Temporal-Difference chapter

0 votes
1 answer
17 views

Optimality of two policies versus variance of returns from a state

0 votes
0 answers
17 views

Properties of an example environment

0 votes
0 answers
25 views

Derivation of update rule for Off-policy TD(0) with importance sampling ratio

0 votes
0 answers
19 views

Pseudocode for batch TD(0)

1 vote
1 answer
43 views

How does the Belman optimality equation with altered transition probabilities in the second equation follow?