Skip to main content
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity's user avatar
DSPinfinity
  • Member for 2 years, 4 months
  • Last seen more than a week ago
0 votes
2 answers
50 views

What is the logic in including/not including subscript $\pi$ in in "E" for value functions? [closed]

0 votes
1 answer
60 views

It is not clear why SARSA is on-policy but Q-learning off-policy

0 votes
1 answer
45 views

In Sutton-Barto a confusing point regarding $\epsilon$-soft policies in the proof for optimality of MC control without exploring starts

0 votes
2 answers
90 views

Textbooks (or other sources) on deep reinforcement learning which explain theory along with good examples

0 votes
0 answers
19 views

Pseudocode for batch TD(0)

0 votes
0 answers
25 views

Derivation of update rule for Off-policy TD(0) with importance sampling ratio

0 votes
0 answers
17 views

Properties of an example environment

0 votes
1 answer
17 views

Optimality of two policies versus variance of returns from a state

0 votes
1 answer
49 views

Where can I find good sources (textbook, lecture notes, etc) on multi-armed bandits?

0 votes
1 answer
47 views

What does "Clustering features based on their values across objects rather than clustering objects ($X^T$ rather than$ X$)" mean?

0 votes
1 answer
110 views

What is a "multinomial model" in machine learning?

0 votes
1 answer
145 views

How is back propagation applied in case the activation function is not differentiable?

0 votes
1 answer
76 views

In k-NN, how does the condition $k(N)/N \to 0$ ensure that all the k nearest neighbors are close to a given test point $\mathbf{x}$?

0 votes
2 answers
219 views

is there a mathematical explanation of precision and recall tradeoff?

0 votes
0 answers
17 views

Why are projected variables in canonical correlation analysis uncorrelated?

0 votes
0 answers
14 views

Why is $z$ considered a random variable in the following formulation of Locally Linear Embedding Problem?

0 votes
0 answers
14 views

Why is k=1 in linear discriminant analysis for two classes?

0 votes
0 answers
35 views

How can one use reinforcement learning for optimal parameter determination to minimize output in dynamical systems?

0 votes
2 answers
129 views

How do we define greedy action for policy improvement for a given stochastic policy?

0 votes
1 answer
36 views

What is wrong in reasoning here in classification for defect detection?

0 votes
0 answers
52 views

Unclear points on feature extraction for a set of scenarios

0 votes
0 answers
21 views

In $n$ dimensions, why do we need at least $n+1$ sample points to have covariance of sample data non-singular?

0 votes
0 answers
11 views

Why is the feature direction chosen in the direction associated with largest eigenvalue of $\Sigma_T$ in case of more than two classes?

0 votes
1 answer
27 views

What is $D_i$ in "Common Principal Components Analysis"?

0 votes
0 answers
8 views

What is $D_i$ in "Common Principal Components Analysis"?

0 votes
1 answer
64 views

What are the formulas for the MAE , MSE when output is a vector?

0 votes
0 answers
31 views

Why does in feature embedding the similarities between instances in the new space respects the original pairwise similarities?

0 votes
1 answer
43 views

Time index in TD(0) return

0 votes
1 answer
115 views

How is the first line obtained and where is the information $v_{\pi}(x_k)=v_{\pi'}(x_k)$ used in the following derivation regarding greedy policy?

0 votes
1 answer
56 views

Why does $\alpha=1$ mean batch MC Learning?