nbro's user avatar
nbro's user avatar
nbro's user avatar
nbro
  • Member for 7 years, 5 months
  • Last seen this week
97 votes
3 answers
85k views

What is self-supervised learning in machine learning?

38 votes
5 answers
19k views

What is the difference between latent and embedding spaces?

29 votes
1 answer
17k views

What is the Bellman operator in reinforcement learning?

28 votes
1 answer
23k views

What is the credit assignment problem?

24 votes
5 answers
21k views

What is non-Euclidean data?

22 votes
3 answers
5k views

Why doesn't Q-learning converge when using function approximation?

18 votes
3 answers
3k views

Which explainable artificial intelligence techniques are there?

18 votes
3 answers
5k views

What is geometric deep learning?

16 votes
3 answers
4k views

Is the optimal policy always stochastic if the environment is also stochastic?

14 votes
3 answers
6k views

Why exactly do neural networks require i.i.d. data?

14 votes
1 answer
8k views

What is the relation between online (or offline) learning and on-policy (or off-policy) algorithms?

14 votes
1 answer
14k views

How can the convolution operation be implemented as a matrix multiplication?

13 votes
3 answers
968 views

Why teaching only search algorithms in a short introductory AI course?

12 votes
4 answers
3k views

What are the purposes of autoencoders?

8 votes
1 answer
2k views

Which machine learning models are universal function approximators?

8 votes
3 answers
16k views

What is the difference between a stochastic and a deterministic policy?

8 votes
1 answer
8k views

What is the difference between a stationary and a non-stationary policy?

7 votes
2 answers
2k views

How are the reward functions $R(s)$, $R(s, a)$ and $R(s, a, s')$ equivalent?

7 votes
1 answer
3k views

Why does a negative reward for every step really encourage the agent to reach the goal as quickly as possible?

6 votes
1 answer
1k views

What is the return-to-go in reinforcement learning?

6 votes
1 answer
562 views

What is the relation between a policy which is the solution to a MDP and a policy like $\epsilon$-greedy?

5 votes
1 answer
2k views

What is a graph neural network?

5 votes
1 answer
6k views

How can we use linear programming to solve an MDP?

5 votes
1 answer
121 views

Why should we study causation in artificial intelligence?

5 votes
2 answers
2k views

Do convolutional neural networks perform convolution or cross-correlation?

5 votes
1 answer
2k views

Which paper introduced the term "softmax"?

4 votes
1 answer
6k views

What are bag-of-features in computer vision?

4 votes
1 answer
503 views

Why do we have two similar action selection strategies for UCB1?

4 votes
1 answer
444 views

How are afterstate value functions mathematically defined?

4 votes
1 answer
687 views

Is there any difference between a control and an action in reinforcement learning?