English
Related papers

Related papers: Online Multi-Agent Control with Adversarial Distur…

200 papers

As learning-based robotic controllers are typically trained offline and deployed with fixed parameters, their ability to cope with unforeseen changes during operation is limited. Biologically inspired, this work presents a framework for…

Robotics · Computer Science 2026-03-05 Fabian Domberg , Georg Schildbach

We analyze the dynamics of multi-agent collective behavior models and their control theoretical properties. We first derive a large population limit to parabolic diffusive equations. We also show that the non-local transport equations…

Analysis of PDEs · Mathematics 2019-02-12 Umberto Biccari , Dongnam Ko , Enrique Zuazua

Many potential applications of reinforcement learning in the real world involve interacting with other agents whose numbers vary over time. We propose new neural policy architectures for these multi-agent problems. In contrast to other…

Machine Learning · Computer Science 2019-06-03 Matthew A. Wright , Roberto Horowitz

We investigate the distributed online economic dispatch problem for power systems with time-varying coupled inequality constraints. The problem is formulated as a distributed online optimization problem in a multi-agent system. At each time…

Optimization and Control · Mathematics 2025-12-25 Yingjie Zhou , Xiaoqian Wang , Tao Li

This paper considers distributed online convex optimization with adversarial constraints. In this setting, a network of agents makes decisions at each round, and then only a portion of the loss function and a coordinate block of the…

Optimization and Control · Mathematics 2023-06-02 Xinlei Yi , Xiuxian Li , Tao Yang , Lihua Xie , Yiguang Hong , Tianyou Chai , Karl H. Johansson

Multi-Agent Reinforcement Learning (MARL) is a promising area of research that can model and control multiple, autonomous decision-making agents. During online training, MARL algorithms involve performance-intensive computations such as…

Multiagent Systems · Computer Science 2023-02-13 Kailash Gogineni , Peng Wei , Tian Lan , Guru Venkataramani

In this work, we are interested in studying multi-agent routing settings, where adversarial agents are part of the assignment and decision loop, degrading the performance of the fleet by incurring bounded delays while servicing…

Multiagent Systems · Computer Science 2025-04-02 Roee M. Francos , Daniel Garces , Stephanie Gil

We propose a neural network approach for solving high-dimensional optimal control problems. In particular, we focus on multi-agent control problems with obstacle and collision avoidance. These problems immediately become high-dimensional,…

Optimization and Control · Mathematics 2022-05-05 Derek Onken , Levon Nurbekyan , Xingjian Li , Samy Wu Fung , Stanley Osher , Lars Ruthotto

This paper presents a new framework for analyzing and designing no-regret algorithms for dynamic (possibly adversarial) systems. The proposed framework generalizes the popular online convex optimization framework and extends it to its…

Machine Learning · Computer Science 2016-08-30 Ian Gemp , Sridhar Mahadevan

This paper addresses the challenge of network synchronization under limited communication, involving heterogeneous agents with different dynamics and various network topologies, to achieve consensus. We investigate the distributed adaptive…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Moh. Kamalul Wafi , Milad Siami

We consider a linear stochastic bandit problem involving $M$ agents that can collaborate via a central server to minimize regret. A fraction $\alpha$ of these agents are adversarial and can act arbitrarily, leading to the following tension:…

Machine Learning · Computer Science 2022-06-08 Aritra Mitra , Arman Adibi , George J. Pappas , Hamed Hassani

Addressing complex cooperative tasks in safety-critical environments poses significant challenges for multi-agent systems, especially under conditions of partial observability. We focus on a dynamic network bridging task, where agents must…

Multiagent Systems · Computer Science 2025-04-04 Raffaele Galliera , Konstantinos Mitsopoulos , Niranjan Suri , Raffaele Romagnoli

This work focuses on the problem of distributed optimization in multi-agent cyberphysical systems, where a legitimate agent's iterates are influenced both by the values it receives from potentially malicious neighboring agents, and by its…

Robotics · Computer Science 2025-01-16 Michal Yemini , Angelia Nedić , Andrea J. Goldsmith , Stephanie Gil

In this paper, the problem of distributed optimization is studied via a network of agents. Each agent only has access to a stochastic gradient of its own objective function in the previous time, and can communicate with its neighbors via a…

Optimization and Control · Mathematics 2024-01-29 Yuchen Yang , Kaihong Lu , Long Wang

This paper introduces \textit{online bilevel optimization} in which a sequence of time-varying bilevel problems is revealed one after the other. We extend the known regret bounds for online single-level algorithms to the bilevel setting.…

Optimization and Control · Mathematics 2024-07-10 Davoud Ataee Tarzanagh , Parvin Nazari , Bojian Hou , Li Shen , Laura Balzano

We investigate the mechanism design problem faced by a principal who hires \emph{multiple} agents to gather and report costly information. Then, the principal exploits the information to make an informed decision. We model this problem as a…

Computer Science and Game Theory · Computer Science 2023-07-13 Federico Cacciamani , Matteo Castiglioni , Nicola Gatti

We address the problem of persistent monitoring, where a finite set of mobile agents has to persistently visit a finite set of targets. Each of these targets has an internal state that evolves with linear stochastic dynamics. The agents can…

Systems and Control · Electrical Eng. & Systems 2020-04-23 Samuel C. Pinto , Sean B. Andersson , Julien M. Hendrickx , Christos G. Cassandras

A Multi-Agent Cooperative Learning (MACL) system is an artificial intelligence (AI) system where multiple learning agents work together to complete a common task. Recent empirical success of MACL systems in various domains (e.g. traffic…

Machine Learning · Computer Science 2023-10-31 Jialin Yi

Deep reinforcement learning (RL) has achieved outstanding results in recent years, which has led a dramatic increase in the number of methods and applications. Recent works are exploring learning beyond single-agent scenarios and…

Computer Science and Game Theory · Computer Science 2020-02-03 Yunlong Lu , Kai Yan