Questions tagged [multi-agent-systems]

For questions related to multi-agent systems (MAS), which are systems that involve multiple agents (each of them can have different skills) that cooperate with each other and interact with the environment. There are several challenges faced by MAS, including coordination between agents, security, and task allocation. Multi-agent systems have been applied in areas such as computer science, civil engineering, and electrical engineering.

Filter by
Sorted by
Tagged with
3
votes
1answer
43 views

How does the Alpha Zero's move encoding work?

I am a beginner in AI. I'm trying to train a multi-agent RL algorithm to play chess. One issue that I ran into was representing the action space (legal moves/or honestly just moves in general) ...
1
vote
0answers
16 views

How would I design a finite budget, cascaded multi agent deep reinforcement learning model?

In most of the multi-agent reinforcement learning models I've found, it seems to generate the observations for each of the agents simultaneously and then uses a centralized critic to assess all of the ...
0
votes
0answers
26 views

Control Strategy for Multi-Agent Systems

I am working on a smart grid system which can be modeled with multiple agents interacting with each other. The agents are physically coupled with non-linearities, the action of one agent has a direct ...
2
votes
0answers
34 views

What place do Agent Communications Language have in Multi-Agent Systems nowadays?

I am currently working on implementing a Multi-Agent System for Smart Grids. There's a lot of literature for that and some things confuse me. I have read that there is FIPA, which aimed to create a ...
2
votes
1answer
33 views

Is there multi-agent reinforcement learning model in which (some of the) reward is given by other agent and not by the external environment?

The traditional setting of multiagent reinforcement learning (MARL) is the mode in which there is set of agents and external environment. And the reward is given to each agent - individually or ...
1
vote
0answers
71 views

Designing Policy-Network for Deep-RL with Large, Variable Action Space

I am attempting a project involving training an agent to play a game using deep reinforcement learning. This project has a few features that complicate the design of the neural network: The action ...
0
votes
0answers
21 views

Optimal path finding in multiagent game with collision avoidance

What algorithm to use when to find the optimal path from a starting point to the end point in a multiagent game with collision avoidance? I am in control of the agent while having zero ideas of where ...
0
votes
1answer
33 views

How to train the NN of simple agents given a reward system?

I'm not an expert in AI or NN, I gathered most of the information I have from the internet, and I'm looking for advice and guidance. I'm trying to design a NN that is going to be used by all the ...
0
votes
1answer
154 views

How to handle a changing in the Reinforcement Learning environment where there is increasing or decreasing in number of agents?

I'm working in A2C and I have an environment where there is increasing or decreasing in the number of agents. The action space in the environment will not change but the state will change when new ...
0
votes
0answers
21 views

Are my agents sharing common critic in the following Multiagent DDPG implementation?

I wanted to have a common critic for all my agents so I defined it as following but because the critic will be changing while training in every iteration, I am not sure if all agents still share the ...
3
votes
1answer
253 views

Why is tic-tac-toe considered a non-deterministic environment?

I have been reading about deterministic and stochastic environments, when I came up with an article that states that tic-tac-toe is a non-deterministic environment. But why is that? An action will ...
3
votes
1answer
85 views

Can AlphaZero considered as Multi-Agent Deep Reinforcement Learning?

Can AlphaZero considered as Multi-Agent Deep Reinforcement Learning? I could not find a clear answer on this. I would say yes it is Multi Agent Learning, as there are two Agents playing against each ...
0
votes
0answers
50 views

How is centralised training and decentralised execution in multi agent reinforcement learning implemented?

In the paper Bayesian Action Decoder for Deep Multi-Agent Reinforcement Learning, it is written We allow centralised training but require decentralised execution, from which follows that the policies ...
0
votes
0answers
33 views

Is there a multi-agent version of EXP3?

The EXP3 algorithm as given in the figure below (taken from Adversarial Bandits and the Exp3 Algorithm) is to solve the adversarial bandits for the single-player case. What happens if there are ...
1
vote
1answer
56 views

What is the relation between multi-agent learning and reinforcement learning?

What is the relation between multi-agent learning and reinforcement learning? Is one a sub-field of the other? For instance, would it make sense to state that your research interest are multi-agent ...
2
votes
0answers
39 views

How does heuristic work with multiple agents?

I have a question for heuristic search with multiple agents. I know how heuristic search works with one agent (ex. one Pacman) but I don't really understand it with multiple agents. Let's say we have ...
1
vote
1answer
72 views

Shouldn't the utility function of two-player zero-sum games be in the range $[-1, 1]$?

In Appendix B of MuZero, they say In two-player zero-sum games the value functions are assumed to be bounded within the $[0, 1]$ interval. I'm confused about the boundary: Shouldn't the value/...
1
vote
0answers
22 views

Are there any board game appropriate to examine the performance of multiple agents that cooperate both inter-group and intra-group?

I want to find out scenarios that useful to examine the performance of intra-group and inter-group cooperation in MARL. Specifically, I prefer a board game (like sudoku) that is suitable for the ...
1
vote
0answers
25 views

Do I need to maintain a separate population in each distributed environment when implementing PBT in a MARL context?

I have questions regarding on how to implement PBT as described in Algorithm 1 (on page 5) in the paper, Population Based Training of Neural Networks to train agents in a MARL (multi-agent ...
2
votes
1answer
37 views

Agents meeting in a directed connected graph

I've just started learning AI and I have a certain problem: We have directed connected graph, where nodes are places one can go to and edges are the "roads" between places. We have K agents whose ...
1
vote
2answers
148 views

Formal proof that every purely reactive agent has behaviorally equivalent standard agent

It kind of makes sense intuitively but I'm not sure about a formal proof. I'll start with briefly listing definitions from Intro to Multiagent systems, Wooldridge, 2002 and then give you my reasoning ...
2
votes
0answers
42 views

What are the examples of agents that is represent these characteristics?

I'm looking for examples of AI systems or agents that best represent these five characteristics (one example for each characteristics): Reactivity Proactivity Adaptability Sociability Autonomy It ...
5
votes
1answer
163 views

How would one implement a multi-agent environment with asynchronous action and rewards per agent?

In a single agent environment, the agent takes an action, then observes the next state and reward: ...
1
vote
1answer
102 views

What is the difference between multi-agent and multi-modal systems?

The Wikipedia definitions are as follows Multi-agent systems - A multi-agent system is a computerized system composed of multiple interacting intelligent agents. Multi-modal interaction - Multimodal ...
4
votes
1answer
78 views

How to represent players in a multi agent environment so each model can distinguish its own player

So I have 2 models trained with the DQN algorithm that I want to train in a multi-agent environment to see how they react with each other. The models were trained in an environment consisting of 0's ...
3
votes
0answers
87 views

Can one agent command another agent in a multi-agent reinforcement learning setting? [closed]

In reinforcement learning, an agent is usually fully autonomous and independent. It executes actions on the environment, but no other agent can control, explore or command this agent. In multi-agent ...
2
votes
0answers
91 views

How does Friend-or-Foe Q-learning intuitively work?

I read about Q-Learning and was reading about multi-agent environments. I tried to read the paper Friend-or-Foe Q-learning, but could not understand anything, except for a very vague idea. What does ...
4
votes
0answers
155 views

Multi Agent Sokoban Search Solvers state of the art

I also asked this question here but I'm repeating it on this SE because I feel it is more relevant. No intention to spam. I am researching into coding a solver for a variant of the Sokoban game with ...
1
vote
0answers
51 views

What is the best method to deal with heterogeneous multi agent system MAS?

Heterogeneity: Based on the heterogeneity of agents MAS can be divided into two categories namely: homogeneous and heterogeneous. Homogeneous MAS include agents that all have the same characteristics ...
3
votes
1answer
2k views

How to deal with the terminal state in SARSA in a multi-agent setting?

I'm training a SARSA agent to update a Q function, but I'm confused about how you handle the final state. In this case, when the game ends and there is no $S'$. For example, the agent performed an ...
2
votes
1answer
107 views

Convergence in multi-agent environment

I have a multi-agent environment where agents are trying to optimise the overall energy consumption of their group. Agents can exchange energy between themselves (actions for exchange of energy ...
2
votes
0answers
69 views

Algorithms for multiple agents problems

Can anyone recommend a reinforcement learning algorithm for a multi-agent environment? In my simplified example, I'm implementing a Q-Learning system with different 10 agents. The agents compete for ...
1
vote
1answer
76 views

Can Q-learning working in a multi agent environment where every agent learns a behaviour independently?

I am currently exploring multi-agent reinforcement learning. I have multiple agents that communicate with each other and a central service that maintains the environment state. The central service ...
3
votes
0answers
112 views

Jason/AgentSpeak trying to synchronize agents [closed]

I'm trying to implement a tree sort for 8 numbers. I've created 15 tree nodes agents and one manager agent. What I'm trying to achieve is to synchronize leaves in the tree and send their generated ...
2
votes
1answer
212 views

Agent collision avoidance java

I am working with a project which is a agent based pedestrian simulation in Java and its is animated with the help of JavaFX. I've tried to read all the social force model papers but my understanding ...
2
votes
1answer
47 views

How to choose evaluation functions for features, when network effects are in place (multi-agent systems)?

So, I have this huge amount of data, which has 7 vector features (float from 0 to 1). I am trying to build a kind of recommendation system, with a twist (it uses agents and negotiations and narratives;...
1
vote
3answers
125 views

To what extent can artificially intelligent agents reliably predict trends in financial markets?

I've gotten curious about this topic and am wondering what the stack exchange community has to say about it. Also, does anyone know of any professors/researchers who have published papers pertaining ...
4
votes
1answer
126 views

How can I design a hierarchy of agents each of which with different goals?

I read some light material earlier about the possibility of building a hierarchy of agents, where the agents at the leaves solve primitive tasks while higher-level agents are optimized for ...
2
votes
1answer
759 views

Goal oriented Action Planning with multiple Agents

I'm a little bit stuck: I implemented an AI with GOAP (Goal oriented Action Planning, http://alumni.media.mit.edu/~jorkin/gdc2006_orkin_jeff_fear.pdf) for a simulation game. That works fine. Now I ...
7
votes
1answer
22k views

What are some examples of intelligent agents for each intelligent agent class?

There are several classes of intelligent agents, such as: simple reflex agents model-based reflex agents goal-based agents utility-based agents learning agents Each of these agents behaves slightly ...
6
votes
2answers
165 views

Would a general-purpose AI need to collaborate?

Human beings are more productive in groups than individually, possibly due to the fact that there is a limit to how much one human brain can improve itself in terms of speed of computation and areas ...
5
votes
1answer
109 views

How can thousand-robot swarm coordinate their moves without bumping into each other?

How can a swarm of small robots (like Kilobots) walking close to each other achieve collaboration without bumping into each other? For example, one study shows programmable self-assembly in a thousand-...
12
votes
7answers
369 views

Are there any decentralized examples of AI systems with blockchain technology?

Has there been any attempts to deploy AI with blockchain technology? Are there any decentralized examples of AI networks with no central point of control with AI nodes acting independently (but ...