English
Related papers

Related papers: Decentralized Planning Using Probabilistic Hyperpr…

200 papers

Large-scale Markov decision processes (MDPs) require planning algorithms with runtime independent of the number of states of the MDP. We consider the planning problem in MDPs using linear value function approximation with only weak…

Machine Learning · Computer Science 2020-07-14 Roshan Shariff , Csaba Szepesvári

This paper presents a distributed stochastic model predictive control (SMPC) approach for large-scale linear systems with private and common uncertainties in a plug-and-play framework. Using the so-called scenario approach, the centralized…

Optimization and Control · Mathematics 2019-01-09 V. Rostampour , T. Keviczky

We consider problems in sequential decision making with natural multi-level structure, where sub-tasks are assembled together to accomplish complex goals. Systematically inferring and leveraging hierarchical structure has remained a…

Machine Learning · Computer Science 2026-03-11 Sichen Yang , Mauro Maggioni

This paper investigates manipulation of multiple unknown objects in a crowded environment. Because of incomplete knowledge due to unknown objects and occlusions in visual observations, object observations are imperfect and action success is…

Robotics · Computer Science 2014-07-09 Joni Pajarinen , Ville Kyrki

We consider a cooperative multi-agent system consisting of a team of agents with decentralized information. Our focus is on the design of symmetric (i.e. identical) strategies for the agents in order to optimize a finite horizon team…

Optimization and Control · Mathematics 2023-07-17 Sagar Sudhakara , Ashutosh Nayyar

We introduce synchronizing objectives for Markov decision processes (MDP). Intuitively, a synchronizing objective requires that eventually, at every step there is a state which concentrates almost all the probability mass. In particular, it…

Logic in Computer Science · Computer Science 2011-02-22 Laurent Doyen , Thierry Massart , Mahsa Shirmohammadi

This paper develops a dynamic programming (DP) approach for decentralized stochastic optimal control problems with delayed sharing information patterns, which exhibits the fundamental Properties of classical DP of centralized partially…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Charalambos D. Charalambous , Umarbek Guvercin , Seddik Djouadi

We study the problem of minimizing the resource capacity of autonomous agents cooperating to achieve a shared task. More specifically, we consider high-level planning for a team of homogeneous agents that operate under resource constraints…

Multiagent Systems · Computer Science 2021-05-05 Murat Cubuktepe , František Blahoudek , Ufuk Topcu

We present a general framework for applying learning algorithms and heuristical guidance to the verification of Markov decision processes (MDPs). The primary goal of our techniques is to improve performance by avoiding an exhaustive…

This paper seeks to establish a framework for directing a society of simple, specialized, self-interested agents to solve what traditionally are posed as monolithic single-agent sequential decision problems. What makes it challenging to use…

Machine Learning · Computer Science 2020-08-17 Michael Chang , Sidhant Kaushik , S. Matthew Weinberg , Thomas L. Griffiths , Sergey Levine

This paper introduces a new approach that leverages Multi-agent Bayesian Optimization (MABO) to design Distributed Model Predictive Control (DMPC) schemes for multi-agent systems. The primary objective is to learn optimal DMPC schemes even…

Systems and Control · Electrical Eng. & Systems 2025-05-21 Hossein Nejatbakhsh Esfahani , Kai Liu , Javad Mohammadpour Velni

Training self-driving cars is often challenging since they require a vast amount of labeled data in multiple real-world contexts, which is computationally and memory intensive. Researchers often resort to driving simulators to train the…

Artificial Intelligence · Computer Science 2022-12-01 Avinash Amballa , Advaith P. , Pradip Sasmal , Sumohana Channappayya

We address the problem of controlling a stochastic version of a Dubins vehicle such that the probability of satisfying a temporal logic specification over a set of properties at the regions in a partitioned environment is maximized. We…

Robotics · Computer Science 2012-07-06 Igor Cizelj , Calin Belta

This paper is concerned with planning in stochastic domains by means of partially observable Markov decision processes (POMDPs). POMDPs are difficult to solve. This paper identifies a subclass of POMDPs called region observable POMDPs,…

Artificial Intelligence · Computer Science 2013-02-08 Nevin Lianwen Zhang , Wenju Liu

We study distributed optimization in a cooperative multi-agent setting, where agents have to agree on the usage of shared resources and can communicate via a time-varying network to this purpose. Each agent has its own decision variables…

Optimization and Control · Mathematics 2017-04-20 Alessandro Falsone , Kostas Margellos , Simone Garatti , Maria Prandini

Autonomous agents often operate in scenarios where the state is partially observed. In addition to maximizing their cumulative reward, agents must execute complex tasks with rich temporal and logical structures. These tasks can be expressed…

Systems and Control · Electrical Eng. & Systems 2022-03-18 Krishna C. Kalagarla , Dhruva Kartik , Dongming Shen , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

In this work, we consider the problem of decentralized multi-robot target tracking and obstacle avoidance in dynamic environments. Each robot executes a local motion planning algorithm which is based on model predictive control (MPC). The…

Robotics · Computer Science 2019-09-04 Rahul Tallamraju , Sujit Rajappa , Michael Black , Kamalakar Karlapalem , Aamir Ahmad

Graph games are fundamental in strategic reasoning of multi-agent systems and their environments. We study a new family of graph games which combine stochastic environmental uncertainties and auction-based interactions among the agents,…

Computer Science and Game Theory · Computer Science 2024-12-30 Guy Avni , Martin Kurečka , Kaushik Mallik , Petr Novotný , Suman Sadhukhan

Multi-Agent reinforcement learning has received lot of attention in recent years and have applications in many different areas. Existing methods involving Centralized Training and Decentralized execution, attempts to train the agents…

Machine Learning · Computer Science 2021-09-15 Satheesh K. Perepu , Kaushik Dey

In many domains such as transportation and logistics, search and rescue, or cooperative surveillance, tasks are pending to be allocated with the consideration of possible execution uncertainties. Existing task coordination algorithms either…

Multiagent Systems · Computer Science 2023-08-03 Ruifan Liu , Hyo-Sang Shin , Binbin Yan , Antonios Tsourdos