English
Related papers

Related papers: Locally Interdependent Multi-Agent MDP: Theoretica…

200 papers

We study model-based learning of finite-window policies in tabular partially observable Markov decision processes (POMDPs). A common approach to learning under partial observability is to approximate unbounded history dependencies using…

Machine Learning · Computer Science 2026-04-02 Philip Jordan , Maryam Kamgarpour

In this paper, we investigate a decentralized stochastic control problem with two agents, where a part of the memory of the second agent is also available to the first agent at each instance of time. We derive a structural form for optimal…

Optimization and Control · Mathematics 2022-06-14 Aditya Dave , Nishanth Venkatesh , Andreas A. Malikopoulos

The planning domain has experienced increased interest in the formal synthesis of decision-making policies. This formal synthesis typically entails finding a policy which satisfies formal specifications in the form of some well-defined…

Artificial Intelligence · Computer Science 2021-11-30 George K. Atia , Andre Beckus , Ismail Alkhouri , Alvaro Velasquez

One important challenge for a set of agents to achieve more efficient collaboration is for these agents to maintain proper models of each other. An important aspect of these models of other agents is that they are often partial and…

Artificial Intelligence · Computer Science 2014-11-06 Yu Zhang , Subbarao Kambhampati

Experimental advances enabling high-resolution external control create new opportunities to produce materials with exotic properties. In this work, we investigate how a multi-agent reinforcement learning approach can be used to design…

Statistical Mechanics · Physics 2021-11-15 Shriram Chennakesavalu , Grant M. Rotskoff

Decentralized multi-agent navigation under uncertainty is a complex task that arises in numerous robotic applications. It requires collision avoidance strategies that account for both kinematic constraints, sensing and action execution…

Robotics · Computer Science 2025-08-01 Stepan Dergachev , Konstantin Yakovlev

Partial observability and uncertainty are common problems in sequential decision-making that particularly impede the use of formal models such as Markov decision processes (MDPs). However, in practice, agents may be able to employ costly…

Machine Learning · Computer Science 2023-12-19 Merlijn Krale , Thiago D. Simão , Jana Tumova , Nils Jansen

This paper makes the first attempt to show how information exchange rules represented by a network having multiple layers (multiplex information networks) can be designed for enabling spatially evolving multiagent formations. Toward this…

Optimization and Control · Mathematics 2015-07-21 Dzung Tran , Tansel Yucelen

This paper considers a novel approach to scalable multiagent resource allocation in dynamic settings. We propose an approximate solution in which each resource consumer is represented by an independent MDP-based agent that models expected…

Artificial Intelligence · Computer Science 2014-07-08 Hadi Hosseini , Jesse Hoey , Robin Cohen

We introduce an expressive framework and algorithms for the semi-decentralized control of cooperative agents in environments with communication uncertainty. Whereas semi-Markov control admits a distribution over time for agent actions,…

Artificial Intelligence · Computer Science 2026-03-13 Mahdi Al-Husseini , Mykel J. Kochenderfer , Kyle H. Wray

In this article, we are interested in planning problems where the agent is aware of the presence of an observer, and where this observer is in a partial observability situation. The agent has to choose its strategy so as to optimize the…

Artificial Intelligence · Computer Science 2025-11-24 Salomé Lepers , Vincent Thomas , Olivier Buffet

We propose a framework for the decentralized control of a team of agents that are assigned local tasks expressed as Linear Temporal Logic (LTL) formulas. Each local LTL task specification captures both the requirements on the respective…

Systems and Control · Computer Science 2014-05-09 Meng Guo , Jana Tumova , Dimos V. Dimarogonas

Motivated by the control theoretic distinction between controllable and uncontrollable events, we distinguish between two types of agents within a multi-agent system: controllable agents, which are directly controlled by the system's…

Artificial Intelligence · Computer Science 2014-11-17 R. I. Brafman , M. Tennenholtz

Goal-conditioned dynamic manipulation is inherently challenging due to complex system dynamics and stringent task constraints, particularly in deformable object scenarios characterized by high degrees of freedom and underactuation. Prior…

Robotics · Computer Science 2025-05-26 Guanzhou Lan , Yuqi Yang , Anup Teejo Mathew , Feiping Nie , Rong Wang , Xuelong Li , Federico Renda , Bin Zhao

For autonomous agents to successfully operate in real world, the ability to anticipate future motions of surrounding entities in the scene can greatly enhance their safety levels since potentially dangerous situations could be avoided in…

Machine Learning · Computer Science 2019-06-04 Yeping Hu , Wei Zhan , Liting Sun , Masayoshi Tomizuka

We address the issue of identifying conditions under which the centralized solution to the optimal multi-agent persistent monitoring problem can be recovered in a decentralized event-driven manner. In this problem, multiple agents interact…

Optimization and Control · Mathematics 2017-08-23 Nan Zhou , Christos G. Cassandras , Xi Yu , Sean B. Andersson

In a multi-agent setting, the optimal policy of a single agent is largely dependent on the behavior of other agents. We investigate the problem of multi-agent reinforcement learning, focusing on decentralized learning in non-stationary…

Artificial Intelligence · Computer Science 2019-10-01 Anahita Mohseni-Kabir , David Isele , Kikuo Fujimura

This paper addresses the problem of decentralized tube-based nonlinear Model Predictive Control (NMPC) for a class of uncertain nonlinear continuous-time multi-agent systems with additive and bounded disturbance. In particular, the problem…

Systems and Control · Computer Science 2019-09-05 Alexandros Nikou , Dimos V. Dimarogonas

Many real-world multi-agent systems exhibit nonlinear dynamics and complex inter-agent interactions. As these systems increase in scale, the main challenges arise from achieving scalability and handling nonconvexity. To address these…

Optimization and Control · Mathematics 2025-10-22 Taehyun Yoon , Augustinos D. Saravanos , Evangelos A. Theodorou

Self-organization is a process where a stable pattern is formed by the cooperative behavior between parts of an initially disordered system without external control or influence. It has been introduced to multi-agent systems as an internal…

Artificial Intelligence · Computer Science 2021-05-27 Jieting Luo , Beishui Liao , John-Jules Meyer