# All Questions

6,637 questions
Filter by
Sorted by
Tagged with
966 views

### How does one prove comprehension in machines?

Say we have a machine and we give it a task to do (vision task, language task, game, etc.), how can one prove that a machine actually know's what's going on/happening in that specific task? To narrow ...
7 views

### How Training of the “Attention model” in “ Attention is all you need” paper done? What are Keys, Values?

I have recently encountered the paper on NLP. It is very new to me and I am still unable to see how that works. I have used all the resources over there from the original paper to Youtube videos and ...
7 views

### What is Annotation in Machine Learning and Types of Data Annotation in ML?

Annotation means, in machine language simply making the things visible, recognizable or understandable in image annotation, pictures, documents and videos by highlighting or marking or adding ...
14 views

### Is there any difference between averaged reward and averaged return in reinforcement learning?

reading the Sutton book on Reinforcement learning, I understood reward and return as the same thing. However, in Section 5.6 of the book, 3rd line, first para, it is written: ...
86 views

### How can neural networks approximate any continuous function but have $\mathcal{VC}$ dimension only proportional to their number of parameters?

Neural networks typically have $\mathcal{VC}$ dimension that is proportional to their number of parameters and inputs. For example, see the papers Vapnik-Chervonenkis dimension of recurrent neural ...
17 views

### why going for “average rewards” than “discounting rewards” in continuous function approximation control problem (Reinforcement learning)

I am studying reinforcement learning for a month by following David silvers's lectures in you-tube and "Sutton and Brato's Introduction to reinforcement learning book"(latest edition) and I came ...
3k views

### How do I keep track of already visited states in breadth-first search?

I was trying to implement the breadth-first search (BFS) algorithm for the sliding blocks puzzle (number type). Now, the main thing I noticed is that, if you have a $4 \times 4$ board, the number of ...
20 views

### Can we solve an $8 \times 8$ sliding puzzle using hill climbing?

Can we solve an $8 \times 8$ sliding puzzle using a random-restart hill climbing technique (steepest-ascent)? If yes, how much computing power will this need? And what is the maximum $n \times n$ that ...