Questions tagged [hierarchical-rl]
For questions related to hierarchical reinforcement learning algorithms.
10
questions
5
votes
1answer
113 views
Should I model my problem as a semi-MDP?
I have a system (like a bank) that people (customers) are entered into the systems by a Poisson process, so the time between the arrival of people (two consecutive customers) will be a random variable....
4
votes
1answer
2k views
What are options in reinforcement learning?
According to a lecture about Reinforcement Learning, the concept of options allows searching the state space of an agent much faster. The lecture came from Nptel [1] (National Program on Technology ...
4
votes
1answer
129 views
How can I design a hierarchy of agents each of which with different goals?
I read some light material earlier about the possibility of building a hierarchy of agents, where the agents at the leaves solve primitive tasks while higher-level agents are optimized for ...
3
votes
2answers
335 views
How can I design a reinforcement learning model for a game with multiple complex actions taken at a time?
I have a steady hex-map and turn-based wargame featuring WWII carrier battles.
On a given turn, a player may choose to perform a large number of actions. Actions can be of many different types, and ...
3
votes
0answers
90 views
Can one agent command another agent in a multi-agent reinforcement learning setting? [closed]
In reinforcement learning, an agent is usually fully autonomous and independent. It executes actions on the environment, but no other agent can control, explore or command this agent.
In multi-agent ...
2
votes
0answers
30 views
Where does the hierarchical reinforcement learning framework name “MAXQ” come from?
I've been researching different frameworks for hierarchical RL (mainly options, HAMs, and MAXQ) and noticed that both options and HAMs have names that relate to how they function. I can't seem to find ...
2
votes
0answers
18 views
Alternatives to Hierarchical RL for centralized control tasks?
Consider a problem where the agent must learn to control a hierarchy of agents acting against another such agent in a competitive environment. The agents on each team need to learn cooperate in order ...
1
vote
1answer
37 views
How to detect entities in Montezuma's Revenge environment
I'm thinking of implementing "Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivation" paper. In this paper authors used some custom object ...
0
votes
0answers
25 views
Hierarchical reinforcement learning for combinatorial complexity
I want to try a hierarchical reinforcement learning (HRL) approach to hard logical problems with combinatorial complexity, i.e. games like chess or Rubik's cube. The majority of HRL papers I have ...
0
votes
0answers
32 views
How to train a hierarchical DQN to play the Montezuma's Revenge game?
Would anybody share the experience on how to train a hierarchical DQN to play the Montezuma's Revenge game? How should I design the reward function? How should I balance the anneal rate of the two-...
