English
Related papers

Related papers: Continuous-Time Distributed Dynamic Programming fo…

200 papers

In this paper, we study a mean-variance optimization problem in an infinite horizon discrete time discounted Markov decision process (MDP). The objective is to minimize the variance of system rewards with the constraint of mean performance.…

Optimization and Control · Mathematics 2017-08-24 Li Xia

In this paper, we introduce a nonlinear distributed model predictive control (DMPC) algorithm, which allows for dissimilar and time-varying control horizons among agents, thereby addressing a common limitation in current DMPC schemes. We…

Systems and Control · Electrical Eng. & Systems 2024-10-15 Paula Chanfreut , José M. Maestre , Quanyan Zhu , W. P. M. H. Heemels

We study the problem of designing an optimal sequence of incentives that a principal should offer to an agent so that the agent's optimal behavior under the incentives realizes the principal's objective expressed as a temporal logic…

Optimization and Control · Mathematics 2019-03-20 Yagiz Savas , Vijay Gupta , Melkior Ornik , Lillian J. Ratliff , Ufuk Topcu

In this work, we proposed a new dynamic distributed planning approach that is able to take into account the changes that the agent introduces on his set of actions to be planned in order to take into account the changes that occur in his…

Artificial Intelligence · Computer Science 2024-03-05 Zakaria Tolba

We study a general class of dynamic multi-agent decision problems with asymmetric information and non-strategic agents, which includes dynamic teams as a special case. When agents are non-strategic, an agent's strategy is known to the other…

Multiagent Systems · Computer Science 2018-12-05 Hamidreza Tavafoghi , Yi Ouyang , Demosthenis Teneketzis

Current approaches to multi-agent cooperation rely heavily on centralized mechanisms or explicit communication protocols to ensure convergence. This paper studies the problem of distributed multi-agent learning without resorting to…

Multiagent Systems · Computer Science 2025-08-19 Caroline Wang , Ishan Durugkar , Elad Liebman , Peter Stone

We consider a network of agents whose objective is for the aggregate of their states to converge to a solution of a linear program in standard form. Each agent has limited information about the problem data and can communicate with other…

Optimization and Control · Mathematics 2014-05-06 Dean Richert , Jorge Cortes

Integrated task and motion planning has emerged as a challenging problem in sequential decision making, where a robot needs to compute high-level strategy and low-level motion plans for solving complex tasks. While high-level strategies…

Artificial Intelligence · Computer Science 2018-02-19 Siddharth Srivastava , Nishant Desai , Richard Freedman , Shlomo Zilberstein

In many Cyber-Physical Systems, we encounter the problem of remote state estimation of geographically distributed and remote physical processes. This paper studies the scheduling of sensor transmissions to estimate the states of multiple…

Systems and Control · Computer Science 2020-05-28 Alex S. Leong , Arunselvan Ramaswamy , Daniel E. Quevedo , Holger Karl , Ling Shi

In large-scale systems there are fundamental challenges when centralised techniques are used for task allocation. The number of interactions is limited by resource constraints such as on computation, storage, and network communication. We…

Artificial Intelligence · Computer Science 2022-05-12 Niall Creech , Natalia Criado Pacheco , Simon Miles

The goal of this paper is to analyze distributional Markov Decision Processes as a class of control problems in which the objective is to learn policies that steer the distribution of a cumulative reward toward a prescribed target law,…

Optimization and Control · Mathematics 2026-02-09 Nicole Bäuerle , Athanasios Vasileiadis

We investigate interactive trajectory planning subject to uncertainty in the decisions of surrounding agents. To control the ego-agent, we aim to first learn the decision distribution and solve a Stochastic Model Predictive Control (SMPC)…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Erik Börve , Nikolce Murgovski , Morteza Haghir Chehreghani , Leo Laine

Finding optimal adversarial attack strategies is an important topic in reinforcement learning and the Markov decision process. Previous studies usually assume one all-knowing coordinator (attacker) for whom attacking different recipient…

Machine Learning · Computer Science 2024-03-05 Ziqing Lu , Guanlin Liu , Lifeng Lai , Weiyu Xu

This paper develops a dynamic programming (DP) approach for decentralized stochastic optimal control problems with delayed sharing information patterns, which exhibits the fundamental Properties of classical DP of centralized partially…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Charalambos D. Charalambous , Umarbek Guvercin , Seddik Djouadi

This paper focuses on distributed learning-based control of decentralized multi-agent systems where the agents' dynamics are modeled by Gaussian Processes (GPs). Two fundamental problems are considered: the optimal design of experiment for…

Systems and Control · Electrical Eng. & Systems 2021-04-06 Viet-Anh Le , Truong X. Nghiem

Markov decision process (MDP) is a decision making framework where a decision maker is interested in maximizing the expected discounted value of a stream of rewards received at future stages at various states which are visited according to…

Optimization and Control · Mathematics 2022-12-19 Hoang Nam Nguyen , Abdel Lisser , Vikas Vikram Singh

Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed…

We study a distributed decision-making problem in which multiple agents face the same multi-armed bandit (MAB), and each agent makes sequential choices among arms to maximize its own individual reward. The agents cooperate by sharing their…

Optimization and Control · Mathematics 2020-08-13 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

In this paper, we study a distributed parameter estimation problem with an asynchronous communication protocol over multi-agent systems. Different from traditional time-driven communication schemes, in this work, data can be transmitted…

Systems and Control · Computer Science 2019-03-04 Xingkang He , Qian Liu , Junfeng Wu , Karl Henrik Johansson

Generalized from the concept of consensus, this paper considers a group of edge agreements, i.e. constraints defined for neighboring agents, in which each pair of neighboring agents is required to satisfy one edge agreement constraint. Edge…

Optimization and Control · Mathematics 2023-12-04 Zehui Lu , Shaoshuai Mou