Skip to main content
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity
  • Member for 2 years, 4 months
  • Last seen more than a week ago
4 votes
4 answers
682 views

Is it possible that Precision and Recall increase together?

4 votes
3 answers
137 views

How can reward at time step $t$ can be a function of a state at time step $t+1$?

3 votes
2 answers
527 views

Why can we have misclassifications for a perfect model in logistic regression?

3 votes
2 answers
71 views

Confusing point in Sutton-Barto: replacing $a$ in $q(s,a)$ with a stochastic policy $\pi^\prime$

2 votes
1 answer
33 views

Why is there the potential problem of "learning only from the tails of episodes" in off-policy MC control?

2 votes
2 answers
201 views

Can mini-batches for stochastic gradient be balanced but not representative of the training data?

2 votes
1 answer
71 views

Why do we have $t$ as subscript in $V$ instead of $t+1$ in the expression of $G_{t:t+1}$?

1 vote
1 answer
88 views

MC control with exploring starts: do we need to update the current $\pi(S_0)$ to the randomly chosen $A_0$ as well?

1 vote
0 answers
92 views

Why does importance sampling ratio start and end one step later in off-policy SARSA given in Sutton-Barto's RL book?

1 vote
1 answer
66 views

Without planning, why does each episode only add one additional step to the policy?

1 vote
1 answer
87 views

How are these two equations for the optimal state-value function equivalent?

1 vote
1 answer
204 views

Why is $l$-step lookahead better in RL?

1 vote
1 answer
61 views

Unclear paragraph in Sutton-Barto on "Tile Coding"

1 vote
1 answer
185 views

Where is the problem: in batch TD(0) algorithm or in the code to solve AB problem in Sutton-Barto RL book?

1 vote
1 answer
46 views

Confusion in subscript for n-step TD(0)

1 vote
1 answer
55 views

How is the Markov property of a general state-space model derived?

1 vote
1 answer
440 views

What does stationary state distribution mean in reinforcement learning?

1 vote
1 answer
77 views

What is the difference between "base heuristic" and a "rollout algorithm" based on this base heuristic?

1 vote
1 answer
58 views

It is not clear why sequential improvement is violated in the constructed rollout algorithm

1 vote
1 answer
36 views

Is there validation data in K-fold cross-validation?

1 vote
2 answers
56 views

Is geodesic distance between two similar photos less than the Euclidean distance between them? If so, why?

1 vote
1 answer
79 views

What is $\mathbf{S}$ (sample covariance matrix) in image compression based on PCA?

1 vote
1 answer
72 views

Unclear points in scaled Euclidean distance

1 vote
1 answer
98 views

Meaning of "error on the test point x" in optimal classifier for binary classification

1 vote
1 answer
70 views

Unclear steps in derivation of normal equations in linear regression using linear algebra approach

1 vote
1 answer
119 views

Why is laplace distribution less sensitive to outliers than normal distribution?

1 vote
1 answer
39 views

How can we construct a skewed noise distribution using the maximum likelihood approach?

1 vote
1 answer
58 views

Suitability of Gaussian RBF (radial basis function) in SVM to separate the two classes

1 vote
1 answer
125 views

What is the optimal policy for this MDP?

1 vote
1 answer
43 views

How does the Belman optimality equation with altered transition probabilities in the second equation follow?