2 votes

How do I get started with multi-agent reinforcement learning?

After checking the Internet, you will probably find several resources such as https://github.com/mohammadasghari/dqn-multi-agent-rl https://rlss.inria.fr/files/2019/07/RLSS_Multiagent.pdf https://...
penkovsky's user avatar
  • 264
2 votes

Why can I still easily beat my Q-learning agent that was trained against another Q-learning agent to play tic tac toe?

I couldn't add a comment because of my low reputation but you can check this. It is about the state space. https://math.stackexchange.com/questions/485752/tictactoe-state-space-choose-calculation
Molnár István's user avatar
2 votes
Accepted

How can rewards and loss calculation be extended to multiple agents in a vanilla policy gradient RL setting?

Yes, this can be done and is widely applied in recent literature on multi-agent RL, at least with the collaborative setting where agents are optimizing a shared reward. This is also known as parameter ...
mikkola's user avatar
  • 580
2 votes

How to model a multi-agent reinforcement learning problem where actions of different agents can take different durations?

You could take a look into options, (discrete-time) semi-MDPs, and multi-agent RL. An option is a generalisation of an action. Mathematically, it's defined as a tuple $\langle\mathcal{I}, \pi, \beta\...
nbro's user avatar
  • 40.2k
1 vote

RL framework to optimize my custom multi-agent simulator

Disclaimer: I have only experience with the first three frameworks. Among those three, I would suggest RLlib for the multi-agent situation: Distributed training based on Ray library Out-of-box ...
penkovsky's user avatar
  • 264
1 vote

Is there a multi-agent deep reinforcement learning algorithm which is for environments with only discrete action spaces (Not hybrid)?

A natural policy to act in an environment with discrete action space would be a softmax. This paper describes a method that uses the idea of centralized training, and I believe could be used in your ...
Felipe Costa's user avatar

Only top scored, non community-wiki answers of a minimum length are eligible