Skip to main content
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity
  • Member for 2 years, 5 months
  • Last seen more than a week ago
1 vote
1 answer
68 views

Suitability of Gaussian RBF (radial basis function) in SVM to separate the two classes

1 vote
1 answer
58 views

Confusing convention in Sutto-Barto on Monte Carlo Tree Search: is a leaf node a state leaf node or state-action leaf node?

1 vote
1 answer
24 views

Why is importance sampling ratio in n-step TD multiplying error rather than return n-step return?

0 votes
1 answer
74 views

What are disadvantages/limitations of Monte Carlo Tree Search in RL?

-2 votes
1 answer
35 views

Unclear line in prioritized sweeping algorithm [closed]

-1 votes
1 answer
78 views

Violation of Markov property

0 votes
1 answer
49 views

Confusing statement in Sutton-Barto on trajectory sampling

0 votes
0 answers
40 views

What are the update equations for Double Expected Sarsa with an $\epsilon$-greedy target policy?

0 votes
0 answers
31 views

Confusing statement in Sutton-Barto on expected versus sample updates

0 votes
2 answers
71 views

Why is dynamic programming an example of planning?

0 votes
0 answers
12 views

Is this a typo in n-step tree backup section in Sutton-Barto?

0 votes
1 answer
20 views

Unclear arrow in general Dyna architecture

0 votes
2 answers
28 views

Confusing points in Dyna-Q in Sutton-Barto about model, simulated experience and model predictions

0 votes
1 answer
17 views

Confusing point point in Dyna-Q

0 votes
1 answer
19 views

Unclear points in Dyna Maze example in Sutton-Barto

0 votes
1 answer
32 views

What is the backed-up value in dynamic programming and the corresponding update based on this backed up value?

0 votes
0 answers
14 views

Are these typos in n-step tree backup section in Sutton-Barto?

0 votes
1 answer
44 views

Why no falling off cliff in SARSA for the example in Sutton-Barto?

0 votes
0 answers
15 views

Unclear point in n-step state value estimation

0 votes
0 answers
33 views

Sutton-Barto confusing notation for the target and behaviour policy in the expected sarsa

1 vote
2 answers
83 views

Why is there no exploration-optimality trade-off in Q-learning?

0 votes
1 answer
123 views

What is a "multinomial model" in machine learning?

0 votes
1 answer
62 views

It is not clear why SARSA is on-policy but Q-learning off-policy

-1 votes
1 answer
42 views

Suppose action selection is greedy. Is Q-learning then exactly the same algorithm as Sarsa?

1 vote
1 answer
41 views

Unclear sentence in Sutton-Barto in Temporal-Difference chapter

0 votes
0 answers
26 views

Derivation of update rule for Off-policy TD(0) with importance sampling ratio

0 votes
1 answer
17 views

Optimality of two policies versus variance of returns from a state

0 votes
0 answers
17 views

Properties of an example environment

0 votes
1 answer
76 views

In k-NN, how does the condition $k(N)/N \to 0$ ensure that all the k nearest neighbors are close to a given test point $\mathbf{x}$?

0 votes
0 answers
20 views

Pseudocode for batch TD(0)