English
Related papers

Related papers: Multi-Agent Online Optimization with Delays: Async…

200 papers

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

Machine Learning · Computer Science 2019-05-29 Shariq Iqbal , Fei Sha

We study learning control in an online reset-free lifelong learning scenario, where mistakes can compound catastrophically into the future and the underlying dynamics of the environment may change. Traditional model-free policy learning…

Machine Learning · Computer Science 2020-06-30 Kevin Lu , Igor Mordatch , Pieter Abbeel

As learning-based robotic controllers are typically trained offline and deployed with fixed parameters, their ability to cope with unforeseen changes during operation is limited. Biologically inspired, this work presents a framework for…

Robotics · Computer Science 2026-03-05 Fabian Domberg , Georg Schildbach

We consider systems that require timely monitoring of sources over a communication network, where the cost of delayed information is unknown, time-varying and possibly adversarial. For the single source monitoring problem, we design…

Networking and Internet Architecture · Computer Science 2021-05-31 Vishrant Tripathi , Eytan Modiano

The framework of uncoupled online learning in multiplayer games has made significant progress in recent years. In particular, the development of time-varying games has considerably expanded its modeling capabilities. However, current regret…

Computer Science and Game Theory · Computer Science 2025-08-18 Aymeric Capitaine , Etienne Boursier , Eric Moulines , Michael I. Jordan , Alain Durmus

This is the first of a series of papers that the authors propose to write on the subject of improving the speed of response of learning systems using multiple models. During the past two decades, the first author has worked on numerous…

Machine Learning · Computer Science 2015-11-02 Kumpati S. Narendra , Snehasis Mukhopadyhay , Yu Wang

Consider a collaborative task carried out by two autonomous agents that are able to communicate over a noisy channel. Each agent is only aware of its own state, while the accomplishment of the task depends on the value of the joint state of…

Information Theory · Computer Science 2019-03-01 Arsham Mostaani , Osvaldo Simeone , Symeon Chatzinotas , Bjorn Ottersten

This paper addresses the challenge of coordinating multi-robot systems under realistic communication delays using distributed optimization. We focus on consensus ADMM as a scalable framework for generating collision-free, dynamically…

*Relative overgeneralization* (RO) occurs in cooperative multi-agent learning tasks when agents converge towards a suboptimal joint policy due to overfitting to suboptimal behavior of other agents. No methods have been proposed for…

Machine Learning · Computer Science 2025-10-15 Wenshuai Zhao , Yi Zhao , Zhiyuan Li , Juho Kannala , Joni Pajarinen

Online learning and model reference adaptive control have many interesting intersections. One area where they differ however is in how the algorithms are analyzed and what objective or metric is used to discriminate "good" algorithms from…

Systems and Control · Electrical Eng. & Systems 2025-01-24 Travis E. Gibson , Sawal Acharya

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

Machine Learning · Computer Science 2012-07-03 Huahua Wang , Arindam Banerjee

This paper introduces a novel transfer learning framework for deep multi-agent reinforcement learning. The approach automatically combines goal-conditioned policies with temporal contrastive learning to discover meaningful sub-goals. The…

Artificial Intelligence · Computer Science 2024-06-04 Weihao Zeng , Joseph Campbell , Simon Stepputtis , Katia Sycara

Regret analysis is challenging in Multi-Agent Reinforcement Learning (MARL) primarily due to the dynamical environments and the decentralized information among agents. We attempt to solve this challenge in the context of decentralized…

Machine Learning · Computer Science 2020-01-29 Seyed Mohammad Asghari , Yi Ouyang , Ashutosh Nayyar

Adaptation is the cornerstone of effective collaboration among heterogeneous team members. In human-agent teams, artificial agents need to adapt to their human partners in real time, as individuals often have unique preferences and policies…

Artificial Intelligence · Computer Science 2025-11-18 Benjamin Li , Shuyang Shi , Lucia Romero , Huao Li , Yaqi Xie , Woojun Kim , Stefanos Nikolaidis , Michael Lewis , Katia Sycara , Simon Stepputtis

This paper considers a variant of the online paging problem, where the online algorithm has access to multiple predictors, each producing a sequence of predictions for the page arrival times. The predictors may have occasional prediction…

Data Structures and Algorithms · Computer Science 2020-11-20 Yuval Emek , Shay Kutten , Yangguang Shi

Modern multi-agent systems ranging from sensor networks monitoring critical infrastructure to crowdsourcing platforms aggregating human intelligence can suffer significant performance degradation due to systematic biases that vary with…

Machine Learning · Computer Science 2025-10-31 Siavash M. Alamouti , Fay Arjomandi

In this work, we propose a novel memory-based multi-agent meta-learning architecture and learning procedure that allows for learning of a shared communication policy that enables the emergence of rapid adaptation to new and unseen…

We investigate the distributed online economic dispatch problem for power systems with time-varying coupled inequality constraints. The problem is formulated as a distributed online optimization problem in a multi-agent system. At each time…

Optimization and Control · Mathematics 2025-12-25 Yingjie Zhou , Xiaoqian Wang , Tao Li

We consider a multi-agent setting with agents exchanging information over a possibly time-varying network, aiming at minimising a separable objective function subject to constraints. To achieve this objective we propose a novel subgradient…

Optimization and Control · Mathematics 2020-11-20 Licio Romao , Kostas Margellos , Giuseppe Notarstefano , Antonis Papachristodoulou

In many practical applications, usually, similar optimisation problems or scenarios repeatedly appear. Learning from previous problem-solving experiences can help adjust algorithm components of meta-heuristics, e.g., adaptively selecting…

Neural and Evolutionary Computing · Computer Science 2024-04-17 Jiyuan Pei , Jialin Liu , Yi Mei