Questions tagged [multi-agent-systems]

For questions related to multi-agent systems (MAS), which are systems that involve multiple agents (each of them can have different skills) that cooperate with each other and interact with the environment. There are several challenges faced by MAS, including coordination between agents, security, and task allocation. Multi-agent systems have been applied in areas such as computer science, civil engineering, and electrical engineering.

23 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
4 votes
2 answers
154 views

How to represent players in a multi agent environment so each model can distinguish its own player

So I have 2 models trained with the DQN algorithm that I want to train in a multi-agent environment to see how they react with each other. The models were trained in an environment consisting of 0's ...
Milky's user avatar
  • 41
4 votes
0 answers
248 views

Multi Agent Sokoban Search Solvers state of the art

I also asked this question here but I'm repeating it on this SE because I feel it is more relevant. No intention to spam. I am researching into coding a solver for a variant of the Sokoban game with ...
Panos Filianos's user avatar
2 votes
0 answers
77 views

What place do Agent Communications Language have in Multi-Agent Systems nowadays?

I am currently working on implementing a Multi-Agent System for Smart Grids. There's a lot of literature for that and some things confuse me. I have read that there is FIPA, which aimed to create a ...
Heckspoiler's user avatar
2 votes
0 answers
554 views

Designing Policy-Network for Deep-RL with Large, Variable Action Space

I am attempting a project involving training an agent to play a game using deep reinforcement learning. This project has a few features that complicate the design of the neural network: The action ...
bluekaterpillar's user avatar
2 votes
0 answers
134 views

How does heuristic work with multiple agents?

I have a question for heuristic search with multiple agents. I know how heuristic search works with one agent (ex. one Pacman) but I don't really understand it with multiple agents. Let's say we have ...
anthino12's user avatar
  • 121
2 votes
0 answers
128 views

What are the examples of agents that is represent these characteristics?

I'm looking for examples of AI systems or agents that best represent these five characteristics (one example for each characteristics): Reactivity Proactivity Adaptability Sociability Autonomy It ...
user30118's user avatar
2 votes
0 answers
102 views

How does Friend-or-Foe Q-learning intuitively work?

I read about Q-Learning and was reading about multi-agent environments. I tried to read the paper Friend-or-Foe Q-learning, but could not understand anything, except for a very vague idea. What does ...
Harris Pat's user avatar
2 votes
0 answers
82 views

Algorithms for multiple agents problems

Can anyone recommend a reinforcement learning algorithm for a multi-agent environment? In my simplified example, I'm implementing a Q-Learning system with different 10 agents. The agents compete for ...
patrickandroid's user avatar
1 vote
0 answers
28 views

How to correctly train policies in multi-agent RL?

I am diving into Multi-Agent Reinforcement Learning and after reading some literature, I would like to clarify some approaches because I am not quite sure. Now for the following two cases it is clear ...
thsolyt's user avatar
  • 11
1 vote
1 answer
96 views

What is the relation between non-stationarity and "a moving target problem" in multi-agent reinforcement learning?

If single-agent RL algorithms such as Q-learning is applied to multi-agent systems (e.g. Markov games), the environment from the perspective of the agent is non-stationary, and the agent is faced with ...
Necron's user avatar
  • 11
1 vote
0 answers
143 views

Has anyone here tried to implement MADDPG for a different environment and succeeded?

Has anyone tried implementing the multi-agent RL algorithm MADDPG (I've linked the paper below)? The paper seems to have a good amount citations, and they do have their code on github. However, a few ...
Confuse's user avatar
  • 111
1 vote
0 answers
71 views

Book/course recommendation on game theory application to multi-agent system (reinforcement learning)

Is there any great game theory book or course that discusses the application of game theory to modern reinforcement learning or multi-agent systems? Or a classic reference book that can help me get a ...
Maybe's user avatar
  • 471
1 vote
0 answers
271 views

How to parallelize multi-agent DDPG (MADDPG)

I am experimenting with MADDPG algorithm implemented in this repo. Since there were only a few agents (2-3) in the implementation (also in the original paper) steps like parameter updates, action ...
Mika's user avatar
  • 341
1 vote
0 answers
285 views

RLLib - What exactly do the avail_action and action_embed_size represent? How do they work with the action_mask to phase out invalid actions?

So, I'm fairly new to reinforcement learning and I needed some help/explanations as to what the action_mask and avail_action fields alongside the action_embed_size actually mean in RLlib (the ...
Akshay Ghosh's user avatar
1 vote
0 answers
45 views

Why is the number of examined nodes $ O(b^{3d/4})$ in $\alpha$-$\beta$ pruning?

I'm taking a course 'Introduction to AI' and, in one of the tutorials, it was written that when pruning the game tree using $\alpha$-$\beta$ boundaries, the number of nodes that will be developed, ...
E. Ginzburg's user avatar
1 vote
0 answers
27 views

How would I design a finite budget, cascaded multi agent deep reinforcement learning model?

In most of the multi-agent reinforcement learning models I've found, it seems to generate the observations for each of the agents simultaneously and then uses a centralized critic to assess all of the ...
AI92's user avatar
  • 111
1 vote
0 answers
27 views

Are there any board game appropriate to examine the performance of multiple agents that cooperate both inter-group and intra-group?

I want to find out scenarios that useful to examine the performance of intra-group and inter-group cooperation in MARL. Specifically, I prefer a board game (like sudoku) that is suitable for the ...
Jarvis's user avatar
  • 41
1 vote
0 answers
34 views

Do I need to maintain a separate population in each distributed environment when implementing PBT in a MARL context?

I have questions regarding on how to implement PBT as described in Algorithm 1 (on page 5) in the paper, Population Based Training of Neural Networks to train agents in a MARL (multi-agent ...
Huan's user avatar
  • 161
1 vote
2 answers
422 views

Formal proof that every purely reactive agent has behaviorally equivalent standard agent

It kind of makes sense intuitively but I'm not sure about a formal proof. I'll start with briefly listing definitions from Intro to Multiagent systems, Wooldridge, 2002 and then give you my reasoning ...
aidar_ms's user avatar
1 vote
0 answers
114 views

What is the best method to deal with heterogeneous multi agent system MAS?

Heterogeneity: Based on the heterogeneity of agents MAS can be divided into two categories namely: homogeneous and heterogeneous. Homogeneous MAS include agents that all have the same characteristics ...
I_Al-thamary's user avatar
0 votes
0 answers
35 views

Are there assumptions made about Self-Play that don't hold up in regular MA competition?

I read about this paper Efficient Competitive Self-Play Policy Optimization which proposes an algorithm for training a population of agents with self-play using a perturbation based matchmaking ...
kitaird's user avatar
  • 115
0 votes
1 answer
121 views

How to implement a rule-based decision maker for an agent-based model?

I had no idea that there is a stack exchange community for A.I. :-/ So I repost this question here in hope of some guidelines. I tried to delve into the materials discussed in AI: A Modern Approach ...
Vector Zita's user avatar
0 votes
0 answers
596 views

RLlib's Multi-agent PPO continuous actions turn into nan

After some amount of training on a custom Multi-agent sparse-reward environment using RLlib's (1.4.0) PPO network, I found that my continuous actions turn into nan (explodes?) which is probably caused ...
hridayns's user avatar
  • 233