Questions tagged [definitions]

For questions about the definition of terms used in artificial intelligence research and development, including the definition of intelligence, algorithms, jargon, principles, methodologies, mathematical terms, concepts, topologies, architectures, designs, jargon, and AI domains such as robotics, network training, or automated vehicles.

11 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
5
votes
0answers
86 views

Are all fully observable environments episodic?

According to the definition of a fully observable environment in Russell & Norvig, AIMA (2nd ed), pages 41-44, an environment is only fully observable if it requires zero memory for an agent to ...
3
votes
0answers
45 views

How exactly does self-play work, and how does it relate to MCTS?

I am working towards using RL to create an AI for a two-player, hidden-information, a turn-based board game. I have just finished David Silver's RL course and Denny Britz's coding exercises, and so am ...
3
votes
1answer
88 views

What is local consistency in constraint satisfaction problems?

In the Constraint Propagation in CSP, it is often stated that pre-processing can solve the whole problem, so no search is required at all. And the key idea is local consistency. What does this ...
3
votes
0answers
85 views

What is a generalized MDP?

What is a generalized MDP? How is it different than a "regular" MDP? How does it generalise the notion of an MDP? Why do we need a generalised MDP? Do generalised MDPs have some practical usefulness ...
2
votes
0answers
27 views

What exactly does meta-learning in reinforcement learning setting mean?

We can use DDPG to train agents to stack objects. And stacking objects can be viewed as first grasping followed by pick and place. In this context, how does meta-reinforcement learning fit? Does it ...
2
votes
0answers
30 views

What is the return-to-go in reinforcement learning?

In reinforcement learning, the return is defined as some function of the rewards. For example, you can have the discounted return, where you multiply the rewards received at later time steps by ...
2
votes
1answer
49 views

What are proxy reward functions?

The understanding I have is that they somehow adjust the objective to make it easier to meet, without changing the reward function. ... the observed proxy reward function is the approximate solution ...
2
votes
0answers
62 views

What is the meaning of the words 'bias' and 'variance' in RL?

In algorithms like MC/TD (tabular value approximation) two of the metrics used to measure their performance are the bias and the variance. What do these terms mean? And which characteristic of the ...
2
votes
0answers
129 views

What is a conditional random field?

I new in machine learning, especially in Conditional Random Fields (CRF). I have read several articles and papers and in there is always associated with HMM and sequences classification. I don't ...
1
vote
0answers
583 views

Is my understanding of the differences between MDP, Semi MDP and POMDP correct?

I just wanted to confirm that my understanding of the different Markov Decision Processes are correct, because they are the fundamentals of reinforcement learning. Also, I read a few literature ...
0
votes
0answers
44 views

Pooling vs Subsampling: Multiple Definitions?

I have seen people using pooling and subsampling synonymously. I have also seen people use them as different processes. I am not sure though if I have correctly inferred what they mean, when they use ...