14 votes
Accepted

What algorithms are considered reinforcement learning algorithms?

The dynamic programming (DP) algorithms like policy iteration (PI) and value iteration (VI) are often presented in the context of reinforcement learning (in particular, in the book Reinforcement ...
nbro's user avatar
  • 40.2k
13 votes
Accepted

What is "planning" in the context of reinforcement learning, and how is it different from RL and SL?

The concept of "planning" is not just related to RL. In general (as the name suggests), planning consists in creating a "plan" which you will use to reach a "goal". The ...
nbro's user avatar
  • 40.2k
5 votes
Accepted

What AI technique should I use to assign a person to a task?

What you have could be well described as a Task Allocation problem, which is studied as part of the planning subfield of AI. Chapters 10 & 11 of Russell & Norvig provide a good overview of ...
John Doucette's user avatar
4 votes
Accepted

Is there any AI system for finding the best way to schedule university classes?

Welcome to AI.SE @Israr Ali. The problem of scheduling a timetable is an example of a constraint satisfaction problem, a topic long studied in AI. There are many possible techniques to apply to this ...
John Doucette's user avatar
4 votes
Accepted

MCTS: How to choose the final action from the root

By far the most commonly used strategy is to select the child with the highest number of visits. This is as described in the 2008 paper you linked. It's also what's referred to as the "robust child" ...
Dennis Soemers's user avatar
  • 10.2k
4 votes

What algorithms are considered reinforcement learning algorithms?

In Reinforcement Learning: An Introduction the authors suggest that the topic of reinforcement learning covers analysis and solutions to problems that can be framed in this way: Reinforcement ...
Neil Slater's user avatar
  • 31.7k
3 votes
Accepted

FastDownward PDDL Planner Limitations

You have stumbled upon a common drawback of the vast majority of modern planning technology. The "flattening" you refer to is actually called "grounding" in the community. Indeed, ...
haz's user avatar
  • 191
3 votes

What is the difference between search and planning?

What is planning? Planning (aka automated planning or AI planning) is the process of searching for a plan, which is a sequence of actions that bring the agent/world from an initial state to one or ...
nbro's user avatar
  • 40.2k
3 votes

How does a PDDL solver find a solution for a given problem?

The question doesn't really make sense: PDDL is a description language that is used to formulate a problem. This description then is the input to a planner; how the planner arrives at the intended ...
Oliver Mason's user avatar
  • 5,397
2 votes

How to transform a PDDL to search?

Not all search is planning (is A connected to B), but all planning is search (how do I get from this to that). Here's an example in Prolog with a domain described in terms of actions, when they are ...
Paul Brown's user avatar
2 votes
Accepted

Several questions related to UCT and MCTS

Is this the only big difference? Or in other words, can I do the same implementation as in a simple MCTS with the 4 stages: selection, expansion, simulation and backpropagation, where the result of ...
Dennis Soemers's user avatar
  • 10.2k
2 votes
Accepted

How to interpret the output plan of the fast-downward planner

Fun domain! You shouldn't have to be parsing the FD output for the plan. Just use --plan-file plan.out as a command-line option to write the plan to the ...
haz's user avatar
  • 191
2 votes
Accepted

Is the distribution of state-action pairs from sample based planning accurate for small experience sets?

I am aware that as the experience set grows the Central Limit Theorem will come into play and the distribution of experience will more accurately represent the true environment's state-actions-...
David's user avatar
  • 4,770
1 vote

Isn't a simulation a great model for model-based reinforcement learning?

I will give one perspective on this from the domain of robotics. You are right that most RL agents are trained in simulation particularly for research papers, because it allows researchers to in ...
adamconkey's user avatar
1 vote
Accepted

Can't solve Towers of Hanoi in PDDL

Ah hah! The way I had defined the disks made d5 the LARGEST disk, not the smallest. So, the last few lines of the file should be: ...
Michael's user avatar
  • 131
1 vote

Can two planning PDDL actions be taken simultaneously?

First place to look is how the preconditions/effects of different actions interact.
haz's user avatar
  • 191
1 vote
Accepted

Can PDDL be utilized for action recognition?

I don't know of any work on this with respect to PDDL, but this is very similar to a conceptual dependency application called SAM (Script Applier Mechanism). Conceptual Dependency (CD) models actions ...
Oliver Mason's user avatar
  • 5,397
1 vote

What algorithms are considered reinforcement learning algorithms?

It seems that another rather controversial point is about the inclusion of evolutionary algorithms as Reinforcement Learning ones. Sutton & Barto do not. They argue that And also: Other people ...
Hermes Morales's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible