English
Related papers

Related papers: Distributed Policy Synthesis of Multi-Agent System…

200 papers

We introduce a technique for synthesis of control and communication strategies for a team of agents from a global task specification given as a Linear Temporal Logic (LTL) formula over a set of properties that can be satisfied by the…

Robotics · Computer Science 2011-11-10 Yushan Chen , Xu Chu Ding , Calin Belta

The main goal of this paper is to investigate continuous-time distributed dynamic programming (DP) algorithms for networked multi-agent Markov decision problems (MAMDPs). In our study, we adopt a distributed multi-agent framework where…

Systems and Control · Electrical Eng. & Systems 2024-06-14 Donghwan Lee , Han-Dong Lim , Do Wan Kim

This paper extends off-policy reinforcement learning to the multi-agent case in which a set of networked agents communicating with their neighbors according to a time-varying graph collaboratively evaluates and improves a target policy…

Machine Learning · Computer Science 2019-11-20 Wesley Suttle , Zhuoran Yang , Kaiqing Zhang , Zhaoran Wang , Tamer Basar , Ji Liu

Designing control policies for large, distributed systems is challenging, especially in the context of critical, temporal logic based specifications (e.g., safety) that must be met with high probability. Compositional methods for such…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Krishna C. Kalagarla , Matthew Low , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

We consider the problem of decomposing a global task assigned to a multi-agent system, expressed as a formula within a fragment of Signal Temporal Logic (STL), under range-limited communication. Given a global task expressed as a…

Systems and Control · Electrical Eng. & Systems 2025-08-19 Gregorio Marchesini , Siyuan Liu , Lars Lindemann , Dimos V. Dimarogonas

In this paper, we study asynchronous consensus problems of continuous-time multi-agent systems with discontinuous information transmission. The proposed consensus control strategy is implemented only based on the state information at some…

Dynamical Systems · Mathematics 2007-05-23 Feng Xiao , Long Wang

Steady-state synthesis aims to construct a policy for a given MDP $D$ such that the long-run average frequencies of visits to the vertices of $D$ satisfy given numerical constraints. This problem is solvable in polynomial time, and…

Multiagent Systems · Computer Science 2025-05-21 Martin Jonáš , Antonín Kučera , Vojtěch Kůr , Jan Mačák

Designing tests to evaluate if a given autonomous system satisfies complex specifications is challenging due to the complexity of these systems. This work proposes a flow-based approach for reactive test synthesis from temporal logic…

Formal Languages and Automata Theory · Computer Science 2024-04-16 Josefine B. Graebener , Apurva S. Badithela , Denizalp Goktas , Wyatt Ubellacker , Eric V. Mazumdar , Aaron D. Ames , Richard M. Murray

We consider a network of agents whose objective is for the aggregate of their states to converge to a solution of a linear program in standard form. Each agent has limited information about the problem data and can communicate with other…

Optimization and Control · Mathematics 2014-05-06 Dean Richert , Jorge Cortes

We study a decentralized dispatch coordination problem in a multi-agent supply chain setting with shared logistics capacity. We propose symmetric (identical) dispatch strategies for all agents, enabling efficient coordination without…

Multiagent Systems · Computer Science 2025-04-29 Sagar Sudhakara

In large-scale systems there are fundamental challenges when centralised techniques are used for task allocation. The number of interactions is limited by resource constraints such as on computation, storage, and network communication. We…

Artificial Intelligence · Computer Science 2022-05-12 Niall Creech , Natalia Criado Pacheco , Simon Miles

Metric Temporal Logic can express temporally evolving properties with time-critical constraints or time-triggered constraints for real-time systems. This paper extends the Metric Interval Temporal Logic with a distribution eventuality…

Formal Languages and Automata Theory · Computer Science 2021-05-12 Lening Li , Jie Fu

In hierarchical planning for Markov decision processes (MDPs), temporal abstraction allows planning with macro-actions that take place at different time scale in form of sequential composition. In this paper, we propose a novel approach to…

Optimization and Control · Mathematics 2019-07-24 Xuan Liu , Jie Fu

Controller synthesis is a theoretical approach to the systematic design of discrete event systems. It constructs a controller to provide feedback and control to the system, ensuring it meets specified control specifications. Traditional…

Multiagent Systems · Computer Science 2025-09-03 Ruohan Huang , Zining Cao

We consider the synthesis problem of a multi-agent system under signal temporal logic (STL) specifications representing bounded-time tasks that need to be satisfied recurrently over an infinite horizon. Motivated by the limited approaches…

Systems and Control · Electrical Eng. & Systems 2024-04-29 Eleftherios E. Vlahakis , Lars Lindemann , Dimos V. Dimarogonas

We consider a discrete-time linear-quadratic Gaussian control problem in which we minimize a weighted sum of the directed information from the state of the system to the control input and the control cost. The optimal control and sensing…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Murat Cubuktepe , Takashi Tanaka , Ufuk Topcu

We consider qualitative strategy synthesis for the formalism called consumption Markov decision processes. This formalism can model dynamics of an agents that operates under resource constraints in a stochastic environment. The presented…

Artificial Intelligence · Computer Science 2021-05-06 František Blahoudek , Petr Novotný , Melkior Ornik , Pranay Thangeda , Ufuk Topcu

This article investigates the consensus tracking problem of multi-agent systems under jointly connected topology through automated synthesis of Lyapunov functions. Based on the proposed distributed nonlinear control protocol, several…

Optimization and Control · Mathematics 2026-05-28 Shuyuan Zhang , Lei Wang , Qing-Guo Wang

The effects of policy sharing between agents in a multi-agent dynamical system has not been studied extensively. I simulate a system of agents optimizing the same task using reinforcement learning, to study the effects of different…

Multiagent Systems · Computer Science 2008-12-10 Jake Ellowitz

We consider the synthesis of distributed implementations for specifications in parameterized temporal logics such as PROMPT-LTL, which extends LTL by temporal operators equipped with parameters that bound their scope. For single process…

Logic in Computer Science · Computer Science 2018-02-28 Swen Jacobs , Leander Tentrup , Martin Zimmermann