English
Related papers

Related papers: Online Planning for Decentralized Stochastic Contr…

200 papers

Today's automated vehicles lack the ability to cooperate implicitly with others. This work presents a Monte Carlo Tree Search (MCTS) based approach for decentralized cooperative planning using macro-actions for automated vehicles in…

Artificial Intelligence · Computer Science 2020-02-04 Karl Kurzer , Chenyang Zhou , J. Marius Zöllner

Decentralized partially observable Markov decision processes (Dec-POMDPs) are rich models for cooperative decision-making under uncertainty, but are often intractable to solve optimally (NEXP-complete). The transition and observation…

Artificial Intelligence · Computer Science 2012-10-19 Jilles S. Dibangoye , Christopher Amato , Arnoud Doniec

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

In this paper we consider online distributed learning problems. Online distributed learning refers to the process of training learning models on distributed data sources. In our setting a set of agents need to cooperatively train a learning…

Machine Learning · Computer Science 2024-05-07 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

Collaborative Data Sharing raises a fundamental issue in distributed systems. Several strategies have been proposed for making shared data consistent between peers in such a way that the shared part of their local data become equal. Most of…

Databases · Computer Science 2021-12-02 Masato Takeichi

The partially observable Markov decision process (POMDP) provides a principled general framework for planning under uncertainty, but solving POMDPs optimally is computationally intractable, due to the "curse of dimensionality" and the…

Artificial Intelligence · Computer Science 2017-09-20 Nan Ye , Adhiraj Somani , David Hsu , Wee Sun Lee

Multi-agent planning in stochastic environments can be framed formally as a decentralized Markov decision problem. Many real-life distributed problems that arise in manufacturing, multi-robot coordination and information gathering scenarios…

Artificial Intelligence · Computer Science 2011-11-02 Claudia V. Goldman , Shlomo Zilberstein

We present a scalable tree search planning algorithm for large multi-agent sequential decision problems that require dynamic collaboration. Teams of agents need to coordinate decisions in many domains, but naive approaches fail due to the…

Artificial Intelligence · Computer Science 2021-01-14 Shushman Choudhury , Jayesh K. Gupta , Peter Morales , Mykel J. Kochenderfer

We study the problem of online learning in competitive settings in the context of two-sided matching markets. In particular, one side of the market, the agents, must learn about their preferences over the other side, the firms, through…

Artificial Intelligence · Computer Science 2022-06-07 Chinmay Maheshwari , Eric Mazumdar , Shankar Sastry

Partially Observable Markov Decision Processes (POMDPs) provide a rich framework for sequential decision-making under uncertainty in stochastic domains. However, solving a POMDP is often intractable except for small problems due to their…

Artificial Intelligence · Computer Science 2014-01-16 Stéphane Ross , Joelle Pineau , Sébastien Paquet , Brahim Chaib-draa

Recent developments in cloud storage architectures have originated new models of online storage as cooperative storage systems and interconnected clouds. Such distributed environments involve many organizations, thus ensuring…

Cryptography and Security · Computer Science 2016-06-30 Marco Baldi , Alessandro Cucchiarelli , Linda Senigagliesi , Luca Spalazzi , Francesco Spegni

Planning for distributed agents with partial state information is considered from a decision- theoretic perspective. We describe generalizations of both the MDP and POMDP models that allow for decentralized control. For even a small number…

Artificial Intelligence · Computer Science 2013-01-18 Daniel S Bernstein , Shlomo Zilberstein , Neil Immerman

The increasing number of wireless devices operating in unlicensed spectrum motivates the development of intelligent adaptive approaches to spectrum access. We consider decentralized contention-based medium access for base stations (BSs)…

Information Theory · Computer Science 2021-10-15 Akash Doshi , Srinivas Yerramalli , Lorenzo Ferrari , Taesang Yoo , Jeffrey G. Andrews

We introduce an expressive framework and algorithms for the semi-decentralized control of cooperative agents in environments with communication uncertainty. Whereas semi-Markov control admits a distribution over time for agent actions,…

Artificial Intelligence · Computer Science 2026-03-13 Mahdi Al-Husseini , Mykel J. Kochenderfer , Kyle H. Wray

Learning the relationships between various entities from time-series data is essential in many applications. Gaussian graphical models have been studied to infer these relationships. However, existing algorithms process data in a batch at a…

Machine Learning · Computer Science 2021-10-04 Tong Yao , Shreyas Sundaram

We consider the following distributed pursuit-evasion problem. A team of mobile agents called searchers starts at an arbitrary node of an unknown $n$-node network. Their goal is to execute a search strategy that guarantees capturing a fast…

Discrete Mathematics · Computer Science 2021-01-19 Dariusz Dereniowski , Dorota Urbańska

Tree-based models are among the most efficient machine learning techniques for data mining nowadays due to their accuracy, interpretability, and simplicity. The recent orthogonal needs for more data and privacy protection call for…

Cryptography and Security · Computer Science 2021-06-21 Sylvain Chatel , Apostolos Pyrgelis , Juan Ramon Troncoso-Pastoriza , Jean-Pierre Hubaux

Multi-agent planning under stochastic dynamics is usually formalised using decentralized (partially observable) Markov decision processes ( MDPs) and reachability or expected reward specifications. In this paper, we propose a different…

Logic in Computer Science · Computer Science 2025-02-20 Francesco Pontiggia , Filip Macák , Roman Andriushchenko , Michele Chiari , Milan Češka

Learning cooperative policies for multi-agent systems is often challenged by partial observability and a lack of coordination. In some settings, the structure of a problem allows a distributed solution with limited communication. Here, we…

Systems and Control · Computer Science 2017-08-01 Roel Dobbe , David Fridovich-Keil , Claire Tomlin

Consensus control in multi-agent systems has received significant attention and practical implementation across various domains. However, managing consensus control under unknown dynamics remains a significant challenge for control design…

Systems and Control · Electrical Eng. & Systems 2024-02-06 Xiaobing Dai , Zewen Yang , Mengtian Xu , Fangzhou Liu , Georges Hattab , Sandra Hirche