English
Related papers

Related papers: Distributed Policy Synthesis of Multi-Agent System…

200 papers

A central task in control theory, artificial intelligence, and formal methods is to synthesize reward-maximizing strategies for agents that operate in partially unknown environments. In environments modeled by gray-box Markov decision…

Machine Learning · Computer Science 2023-04-25 Christel Baier , Clemens Dubslaff , Patrick Wienhöft , Stefan J. Kiebel

Coordination of distributed agents is required for problems arising in many areas, including multi-robot systems, networking and e-commerce. As a formal framework for such problems, we use the decentralized partially observable Markov…

Artificial Intelligence · Computer Science 2014-01-16 Daniel S. Bernstein , Christopher Amato , Eric A. Hansen , Shlomo Zilberstein

Deception is helpful for agents masking their intentions from an observer. We consider a team of agents deceiving their supervisor. The supervisor defines nominal behavior for the agents via reference policies, but the agents share an…

Optimization and Control · Mathematics 2024-10-28 Caleb Probine , Mustafa O. Karabag , Ufuk Topcu

This paper introduces Multi-Agent MDP Homomorphic Networks, a class of networks that allows distributed execution using only local information, yet is able to share experience between global symmetries in the joint state-action space of…

Machine Learning · Computer Science 2022-05-02 Elise van der Pol , Herke van Hoof , Frans A. Oliehoek , Max Welling

This paper develops a general framework for multi-agent control synthesis, which applies to a wide range of problems with convergence guarantees, including those with time-varying objective functions. The proposed framework achieves…

Systems and Control · Electrical Eng. & Systems 2026-05-04 Ruoyu Lin , Gennaro Notomista , Magnus Egerstedt

Computational agents support humans in many areas of life and are therefore found in heterogeneous contexts. This means they operate in rapidly changing environments and can be confronted with huge state and action spaces. In order to…

Artificial Intelligence · Computer Science 2023-08-31 Nicole Merkle , Ralf Mikut

We study distributed algorithms for solving global optimization problems in which the objective function is the sum of local objective functions of agents and the constraint set is given by the intersection of local constraint sets of…

Optimization and Control · Mathematics 2015-03-14 Ilan Lobel , Asuman Ozdaglar , Diego Feijer

We develop a probabilistic control algorithm, $\texttt{GTLProCo}$, for swarms of agents with heterogeneous dynamics and objectives, subject to high-level task specifications. The resulting algorithm not only achieves decentralized control…

Systems and Control · Electrical Eng. & Systems 2021-07-01 Franck Djeumou , Zhe Xu , Murat Cubuktepe , Ufuk Topcu

We introduce a formalism modelling communication of distributed agents strictly in continuous-time. Within this framework, we study the problem of synthesising local strategies for individual agents such that a specified set of goal states…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-08 Holger Hermanns , Jan Krčál , Steen Vester

We formalise and study multi-agent timed models MAPTs (Multi-Agent with timed Periodic Tasks), where each agent is associated to a regular timed schema upon which all possibles actions of the agent rely. MAPTs allow for an accelerated…

Multiagent Systems · Computer Science 2019-11-19 Johan Arcile , Raymond Devillers , Hanna Klaudel

Given a Markov decision process (MDP) $M$ and a formula $\Phi$, the strategy synthesis problem asks if there exists a strategy $\sigma$ s.t. the resulting Markov chain $M[\sigma]$ satisfies $\Phi$. This problem is known to be undecidable…

Logic in Computer Science · Computer Science 2022-05-02 Benjamin Bordais , Damien Busatto-Gaston , Shibashis Guha , Jean-François Raskin

One of the key challenges for multi-agent learning is scalability. In this paper, we introduce a technique for speeding up multi-agent learning by exploiting concurrent and incremental experience sharing. This solution adaptively identifies…

Multiagent Systems · Computer Science 2017-03-07 Dan Garant , Bruno da Silva , Victor Lesser , Chongjie Zhang

We study a large-scale patrol problem with state-dependent costs and multi-agent coordination.We consider heterogeneous agents, rather general reward functions, and the capabilities of tracking agents' trajectories.Given the complexity and…

Optimization and Control · Mathematics 2024-12-12 Jing Fu , Zengfu Wang , Jie Chen

Motivated by the post-disaster distribution system restoration problem, in this paper, we study the problem of synthesizing the optimal policy for a Markov Decision Process (MDP) from a sequence of goal sets. For each goal set, our aim is…

Systems and Control · Electrical Eng. & Systems 2024-04-09 İlker Işık , Onur Yigit Arpali , Ebru Aydin Gol

This paper presents a fully automated procedure for controller synthesis for a general class of multi-agent systems under coupling constraints. Each agent is modeled with dynamics consisting of two terms: the first one models the coupling…

Systems and Control · Computer Science 2017-03-28 Alexandros Nikou , Shahab Heshmati-alamdari , Christos Verginis , Dimos V. Dimarogonas

This paper addresses the multi-agent control problem under global temporal logic tasks, considering agents with heterogeneous capabilities. These global tasks involve not only absolute and relative temporal and spatial constraints, but also…

Systems and Control · Electrical Eng. & Systems 2024-11-15 Tiange Yang , Yuanyuan Zou , Jinfeng Liu , Shaoyuan Li , Xiaohu Zhao

In this paper, scalable controller design to achieve output synchronization for a heterogeneous discrete-time nonlinear multi-agent system is considered. The agents are assumed to exhibit potentially nonlinear dynamics but share linear…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Xin Mao , Dan Wang , Wei Chen , Li Qiu

Existing works on multi-agent time-varying optimization allow agents to asynchronously communicate and/or compute, but do not allow asynchronous sampling of objectives. Sampling can be difficult to synchronize, and we therefore present a…

Optimization and Control · Mathematics 2025-08-21 Gabriel Behrendt , Zachary I. Bell , Matthew Hale

Distributed optimization problems have received much attention due to their privacy preservation, parallel computation, less communication, and strong robustness. This paper presents and studies the time-varying distributed optimization…

Optimization and Control · Mathematics 2025-03-18 Wan-ying Li , Nan-jing Huang

We introduce a novel distributed sampled-data control method tailored for heterogeneous multi-agent systems under a global spatio-temporal task with acyclic dependencies. Specifically, we consider the global task as a conjunction of…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Gregorio Marchesini , Siyuan Liu , Lars Lindemann , Dimos V. Dimarogonas