English
Related papers

Related papers: Locally Interdependent Multi-Agent MDP: Theoretica…

200 papers

Modern distributed software systems often operate in dynamic environments in which operation conditions change continuously and subsystems may come and go at will, e.g. intelligent traffic management and multi-robot systems. To manage these…

Multiagent Systems · Computer Science 2019-09-10 Danny Weyns , Flavio Oquendo

We consider the quasi-deterministic behavior of systems with a large number, $n$, of deterministically interacting constituents. This work extends the results of a previous paper [J. Stat. Phys. 99:1225-1249 (2000)] to include vector-valued…

Statistical Mechanics · Physics 2021-04-28 Brian R. La Cour , William C. Schieve

Recent multi-agent actor-critic methods have utilized centralized training with decentralized execution to address the non-stationarity of co-adapting agents. This training paradigm constrains learning to the centralized phase such that…

Multiagent Systems · Computer Science 2019-10-09 Kevin Corder , Manuel M. Vindiola , Keith Decker

We consider the localization problem between agents while they run a formation control algorithm. These algorithms typically demand from the agents the information about their relative positions with respect to their neighbors. We assume…

Systems and Control · Electrical Eng. & Systems 2019-09-20 Leonardo Colombo , Hector Garcia de Marina , María Barbero Liñán , David Martín de Diego

This work presents a distributed MPC-based approach to solving the problem of multi-agent point-to-point transition with optimization-based collision avoidance. The problem is formulated, motivated by the work on collision avoidance for…

Robotics · Computer Science 2021-08-04 Adarsh Patnaik , Ashish Ranjan Hota

Distributed decision making in multi-agent networks has recently attracted significant research attention thanks to its wide applicability, e.g. in the management and optimization of computer networks, power systems, robotic teams, sensor…

Optimization and Control · Mathematics 2018-11-13 Carlo Cenedese , Yu Kawano , Sergio Grammatico , Ming Cao

We present a decentralized ergodic control policy for time-varying area coverage problems for multiple agents with nonlinear dynamics. Ergodic control allows us to specify distributions as objectives for area coverage problems for nonlinear…

Robotics · Computer Science 2018-08-29 Ian Abraham , Todd D. Murphey

We consider the dynamic multichannel access problem, which can be formulated as a partially observable Markov decision process (POMDP). We first propose a model-free actor-critic deep reinforcement learning based framework to explore the…

Information Theory · Computer Science 2018-10-10 Chen Zhong , Ziyang Lu , M. Cenk Gursoy , Senem Velipasalar

Factored decentralized Markov decision process (Dec-MDP) is a framework for modeling sequential decision making problems in multi-agent systems. In this paper, we formalize the learning of numerical methods for hyperbolic partial…

Machine Learning · Computer Science 2022-10-17 Yiwei Fu , Dheeraj S. K. Kapilavai , Elliot Way

We propose a decentralized game-theoretic framework for dynamic task allocation problems for multi-agent systems. In our problem formulation, the agents' utilities depend on both the rewards and the costs associated with the successful…

Multiagent Systems · Computer Science 2021-08-19 Efstathios Bakolas , Yoonjae Lee

Adaptive model predictive control (MPC) robustly ensures safety while reducing uncertainty during operation. In this paper, a distributed version is proposed to deal with network systems featuring multiple agents and limited communication.…

Systems and Control · Electrical Eng. & Systems 2024-04-17 Anilkumar Parsi , Ahmed Aboudonia , Andrea Iannelli , John Lygeros , Roy S. Smith

In many real-world decision problems there is partially observed, hidden or latent information that remains fixed throughout an interaction. Such decision problems can be modeled as Latent Markov Decision Processes (LMDPs), where a latent…

Machine Learning · Computer Science 2024-06-27 Jeongyeol Kwon , Shie Mannor , Constantine Caramanis , Yonathan Efroni

In this paper, we investigate learning temporal abstractions in cooperative multi-agent systems, using the options framework (Sutton et al, 1999). First, we address the planning problem for the decentralized POMDP represented by the…

Artificial Intelligence · Computer Science 2020-03-23 Jhelum Chakravorty , Nadeem Ward , Julien Roy , Maxime Chevalier-Boisvert , Sumana Basu , Andrei Lupu , Doina Precup

Decentralized stochastic control problems with local information involve problems where multiple agents and subsystems which are coupled via dynamics and/or cost are present. Typically, however, the dynamics of such couplings is complex and…

Optimization and Control · Mathematics 2024-06-03 Zachary Selk , Serdar Yüksel

This work studies a multi-agent Markov decision process (MDP) that can undergo agent dropout and the computation of policies for the post-dropout system based on control and sampling of the pre-dropout system. The central planner's…

Systems and Control · Electrical Eng. & Systems 2024-09-24 Carmel Fiscko , Soummya Kar , Bruno Sinopoli

Large Language Model (LLM) based multi-agent systems (MAS) have shown promise in tackling complex tasks, but often rely on predefined roles and centralized coordination, limiting their adaptability to evolving challenges. This paper…

Artificial Intelligence · Computer Science 2025-09-04 Siyuan Lu , Jiaqi Shao , Bing Luo , Tao Lin

Smart active matter has the ability to control its motion guided by individual policies to achieve collective goals. We introduce a theoretical framework to study a decentralized learning process in which agents can locally exchange…

Statistical Mechanics · Physics 2025-07-08 Gerhard Jung , Misaki Ozawa , Eric Bertin

We study the problem of decentralized constrained POMDPs in a team-setting where the multiple non-strategic agents have asymmetric information. Strong duality is established for the setting of infinite-horizon expected total discounted…

Optimization and Control · Mathematics 2023-08-01 Nouman Khan , Vijay Subramanian

Challenges in real-world robotic applications often stem from managing multiple, dynamically varying entities such as neighboring robots, manipulable objects, and navigation goals. Existing multi-agent control strategies face scalability…

Robotics · Computer Science 2024-02-29 Tianxu An , Joonho Lee , Marko Bjelonic , Flavio De Vincenti , Marco Hutter

We introduce a distributed control architecture for a class of heterogeneous, nonlinear dynamical agents moving in the "string" formation, while guaranteeing trajectory tracking, collision avoidance and the preservation of the formation's…

Systems and Control · Computer Science 2018-06-19 Serban Sabau , Irinel-Constantin Morarescu , Lucian Busoniu , Ali Jadbabaie