English
Related papers

Related papers: Online Multi-Agent Control with Adversarial Distur…

200 papers

We consider the problem of tracking an adversarial state sequence in a linear dynamical system subject to adversarial disturbances and loss functions, generalizing earlier settings in the literature. To this end, we develop three…

Machine Learning · Computer Science 2022-02-23 Zhiyu Zhang , Ashok Cutkosky , Ioannis Ch. Paschalidis

This paper presents an adversary detection mechanism and a resilient control framework for multi-agent systems under spatiotemporal constraints. Safety in multi-agent systems is typically addressed under the assumption that all agents…

Systems and Control · Electrical Eng. & Systems 2022-07-22 Aquib Mustafa , Dimitra Panagou

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

Machine Learning · Statistics 2024-05-20 Lexing Ying

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros

We introduce a new algorithm for online linear-quadratic control in a known system subject to adversarial disturbances. Existing regret bounds for this setting scale as $\sqrt{T}$ unless strong stochastic assumptions are imposed on the…

Machine Learning · Computer Science 2020-06-24 Dylan J. Foster , Max Simchowitz

The setting of an agent making decisions under uncertainty and under dynamic constraints is common for the fields of optimal control, reinforcement learning, and recently also for online learning. In the online learning setting, the quality…

Systems and Control · Electrical Eng. & Systems 2023-04-18 Aren Karapetyan , Anastasios Tsiamis , Efe C. Balta , Andrea Iannelli , John Lygeros

Distributed decision making in multi-agent networks has recently attracted significant research attention thanks to its wide applicability, e.g. in the management and optimization of computer networks, power systems, robotic teams, sensor…

Optimization and Control · Mathematics 2018-11-13 Carlo Cenedese , Yu Kawano , Sergio Grammatico , Ming Cao

This paper considers a bi-level discrete-time control framework with real-time constraints, consisting of several local controllers and a central controller. The objective is to bridge the gap between the online convex optimization and…

Optimization and Control · Mathematics 2017-02-21 Andrey Bernstein

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad

We study online control of time-varying linear systems with unknown dynamics in the nonstochastic control model. At a high level, we demonstrate that this setting is \emph{qualitatively harder} than that of either unknown time-invariant or…

Machine Learning · Computer Science 2022-02-17 Edgar Minasyan , Paula Gradu , Max Simchowitz , Elad Hazan

Online meta-learning is emerging as an enabling technique for achieving edge intelligence in the IoT ecosystem. Nevertheless, to learn a good meta-model for within-task fast adaptation, a single agent alone has to learn over many tasks, and…

Machine Learning · Computer Science 2020-12-22 Sen Lin , Mehmet Dedeoglu , Junshan Zhang

We examine the long-run behavior of multi-agent online learning in games that evolve over time. Specifically, we focus on a wide class of policies based on mirror descent, and we show that the induced sequence of play (a) converges to Nash…

Computer Science and Game Theory · Computer Science 2022-08-11 Benoit Duvocelle , Panayotis Mertikopoulos , Mathias Staudigl , Dries Vermeulen

In this paper, we address tracking of a time-varying parameter with unknown dynamics. We formalize the problem as an instance of online optimization in a dynamic setting. Using online gradient descent, we propose a method that sequentially…

Machine Learning · Computer Science 2016-03-17 Aryan Mokhtari , Shahin Shahrampour , Ali Jadbabaie , Alejandro Ribeiro

This paper studies the decentralized online convex optimization problem for heterogeneous linear multi-agent systems. Agents have access to their time-varying local cost functions related to their own outputs, and there are also…

Optimization and Control · Mathematics 2022-07-05 Yang Yu , Xiuxian Li , Li Li , Lihua Xie

We consider control strategies for large-scale interacting agent systems under uncertainty. The particular focus is on the design of robust controls that allow to bound the variance of the controlled system over time. To this end we…

Optimization and Control · Mathematics 2022-10-06 Giacomo Albi , Michael Herty , Chiara Segala

In this paper, we consider the problem of distributed online convex optimization, where a group of agents collaborate to track the global minimizers of a sum of time-varying objective functions in an online manner. Specifically, we propose…

Optimization and Control · Mathematics 2020-10-14 Yan Zhang , Robert J. Ravier , Vahid Tarokh , Michael M. Zavlanos

This paper studies the control of safety-critical dynamical systems in the presence of adversarial disturbances. We seek to synthesize state-feedback controllers to minimize a cost incurred due to the disturbance, while respecting a safety…

Systems and Control · Electrical Eng. & Systems 2020-09-22 Bhaskar Ramasubramanian , Baicen Xiao , Linda Bushnell , Radha Poovendran

This paper addresses the estimation of a time- varying parameter in a network. A group of agents sequentially receive noisy signals about the parameter (or moving target), which does not follow any particular dynamics. The parameter is not…

Optimization and Control · Mathematics 2016-03-03 Shahin Shahrampour , Alexander Rakhlin , Ali Jadbabaie

Model-based multi-agent control requires agents to possess a model of the behavior of others to make strategic decisions. Solution concepts from game theory are often used to model the emergent collective behavior of self-interested agents…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Ada Yildirim , Bryce L. Ferguson

Human behaviors are regularized by a variety of norms or regulations, either to maintain orders or to enhance social welfare. If artificially intelligent (AI) agents make decisions on behalf of human beings, we would hope they can also…

Computer Science and Game Theory · Computer Science 2019-10-28 Fan-Yun Sun , Yen-Yu Chang , Yueh-Hua Wu , Shou-De Lin