English
Related papers

Related papers: Regret Lower Bounds for Decentralized Multi-Agent …

200 papers

Coordinating multiple autonomous agents in shared environments under decentralized conditions is a long-standing challenge in robotics and artificial intelligence. This work addresses the problem of decentralized goal assignment for…

Artificial Intelligence · Computer Science 2025-10-29 Murad Ismayilov , Edwin Meriaux , Shuo Wen , Gregory Dudek

We consider distributed linear bandits where $M$ agents learn collaboratively to minimize the overall cumulative regret incurred by all agents. Information exchange is facilitated by a central server, and both the uplink and downlink…

Machine Learning · Computer Science 2025-11-17 Sudeep Salgia , Qing Zhao

We consider the problem of learning in single-player and multiplayer multiarmed bandit models. Bandit problems are classes of online learning problems that capture exploration versus exploitation tradeoffs. In a multiarmed bandit model,…

Machine Learning · Statistics 2016-12-02 Naumaan Nayyar , Dileep Kalathil , Rahul Jain

We consider the problem where M agents collaboratively interact with an instance of a stochastic K-armed contextual bandit, where K>>M. The goal of the agents is to simultaneously minimize the cumulative regret over all the agents over a…

Machine Learning · Computer Science 2022-11-16 Jiabin Lin , Shana Moothedath

In decentralized multi-robot navigation, ensuring safe and efficient movement with limited environmental awareness remains a challenge. While robots traditionally navigate based on local observations, this approach falters in complex…

Robotics · Computer Science 2024-06-27 Senthil Hariharan Arul , Amrit Singh Bedi , Dinesh Manocha

This article introduces a decentralized robust optimization framework for safe multi-agent control under uncertainty. Although stochastic noise has been the primary form of modeling uncertainty in such systems, these formulations might fall…

Optimization and Control · Mathematics 2025-08-19 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

TWe establish regret lower bounds for adaptively controlling an unknown linear Gaussian system with quadratic costs. We combine ideas from experiment design, estimation theory and a perturbation bound of certain information matrices to…

Machine Learning · Computer Science 2024-06-13 Ingvar Ziemann , Henrik Sandberg

In recent years, reinforcement learning and its multi-agent analogue have achieved great success in solving various complex control problems. However, multi-agent reinforcement learning remains challenging both in its theoretical analysis…

Robotics · Computer Science 2023-02-10 Kai Cui , Mengguang Li , Christian Fabian , Heinz Koeppl

The problem of coordinated data collection is studied for a mobile crowdsensing (MCS) system. A mobile crowdsensing platform (MCSP) sequentially publishes sensing tasks to the available mobile units (MUs) that signal their willingness to…

Social and Information Networks · Computer Science 2023-09-20 Bernd Simon , Andrea Ortiz , Walid Saad , Anja Klein

In software-defined networking (SDN) systems, it is a common practice to adopt a multi-controller design and control devolution techniques to improve the performance of the control plane. However, in such systems, the decision-making for…

Networking and Internet Architecture · Computer Science 2020-08-05 Xi Huang , Yinxu Tang , Ziyu Shao , Yang Yang , Hong Xu

Rapid urbanization in cities like Bangalore has led to severe traffic congestion, making efficient Traffic Signal Control (TSC) essential. Multi-Agent Reinforcement Learning (MARL), often modeling each traffic signal as an independent agent…

Machine Learning · Computer Science 2026-05-19 Sayambhu Sen , Shalabh Bhatnagar

We consider the shortest path routing (SPR) of a network with stochastically time varying link metrics under potential adversarial attacks. Due to potential denial of service attacks, the distributions of link states could be stochastic…

Networking and Internet Architecture · Computer Science 2016-10-12 Pan Zhou , Lin Cheng , Dapeng Oliver Wu

Decentralized stochastic control problems involving general state/measurement/action spaces are intrinsically difficult to study because of the inapplicability of standard tools from centralized (single-agent) stochastic control. In this…

Optimization and Control · Mathematics 2025-11-10 Omar Mrani-Zentar , Serdar Yüksel

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

Machine Learning · Computer Science 2023-08-17 Mengfan Xu , Diego Klabjan

This study integrates Transit Signal Priority (TSP) into multi-agent reinforcement learning (MARL) based traffic signal control. The first part of the study develops adaptive signal control based on MARL for a pair of coordinated…

Artificial Intelligence · Computer Science 2024-12-02 Dickness Kakitahi Kwesiga , Suyash Chandra Vishnoi , Angshuman Guin , Michael Hunter

This paper studies the decentralized online convex optimization problem for heterogeneous linear multi-agent systems. Agents have access to their time-varying local cost functions related to their own outputs, and there are also…

Optimization and Control · Mathematics 2022-07-05 Yang Yu , Xiuxian Li , Li Li , Lihua Xie

Multi-Agent Path Finding (MAPF) in crowded environments presents a challenging problem in motion planning, aiming to find collision-free paths for all agents in the system. MAPF finds a wide range of applications in various domains,…

Robotics · Computer Science 2025-01-06 Phu Pham , Aniket Bera

Coordinating the movement of multiple autonomous agents over a shared network is a fundamental challenge in algorithmic robotics, intelligent transportation, and distributed systems. The dominant approach, Multi-Agent Path Finding, relies…

Multiagent Systems · Computer Science 2026-02-04 Tesshu Hanaka , Nikolaos Melissinos , Hirotaka Ono

We study a decentralized multi-agent multi-armed bandit problem in which multiple clients are connected by time dependent random graphs provided by an environment. The reward distributions of each arm vary across clients and rewards are…

Machine Learning · Computer Science 2023-10-19 Mengfan Xu , Diego Klabjan

We study the stochastic Multi-Armed Bandit (MAB) problem with random delays in the feedback received by the algorithm. We consider two settings: the reward-dependent delay setting, where realized delays may depend on the stochastic rewards,…

Machine Learning · Computer Science 2021-06-07 Tal Lancewicki , Shahar Segal , Tomer Koren , Yishay Mansour