English
Related papers

Related papers: Multi-Agent Online Optimization with Delays: Async…

200 papers

This paper addresses the problem of collaboratively satisfying long-term spatial constraints in multi-agent systems. Each agent is subject to spatial constraints, expressed as inequalities, which may depend on the positions of other agents…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Farhad Mehdifar , Mani H. Dhullipalla , Charalampos P. Bechlioulis , Dimos V. Dimarogonas

We provide a distributed online algorithm for multi-agent submodular maximization under communication delays. We are motivated by the future distributed information-gathering tasks in unknown and dynamic environments, where utility…

Machine Learning · Computer Science 2026-03-31 Zirui Xu , Vasileios Tzoumas

We study the adversarial multi-armed bandit problem and create a completely online algorithmic framework that is invariant under arbitrary translations and scales of the arm losses. We study the expected performance of our algorithm against…

Machine Learning · Computer Science 2021-09-21 Kaan Gokcesu , Hakan Gokcesu

The key challenge in multiagent learning is learning a best response to the behaviour of other agents, which may be non-stationary: if the other agents adapt their strategy as well, the learning target moves. Disparate streams of research…

Multiagent Systems · Computer Science 2019-03-13 Pablo Hernandez-Leal , Michael Kaisers , Tim Baarslag , Enrique Munoz de Cote

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

Min-max problems are important in multi-agent sequential decision-making because they improve the performance of the worst-performing agent in the network. However, solving the multi-agent min-max problem is challenging. We propose a…

Multiagent Systems · Computer Science 2024-05-31 Alexandros E. Tzikas , Jinkyoo Park , Mykel J. Kochenderfer , Ross E. Allen

In numerous settings, agents lack sufficient data to directly learn a model. Collaborating with other agents may help, but it introduces a bias-variance trade-off, when local data distributions differ. A key challenge is for each agent to…

Machine Learning · Computer Science 2025-02-20 Franco Galante , Giovanni Neglia , Emilio Leonardi

This paper proposes a highly robust autonomous agent framework based on the ReAct paradigm, designed to solve complex tasks through adaptive decision making and multi-agent collaboration. Unlike traditional frameworks that rely on fixed…

Multiagent Systems · Computer Science 2025-04-09 Zihao Wu

We consider an online two-stage stochastic optimization with long-term constraints over a finite horizon of $T$ periods. At each period, we take the first-stage action, observe a model parameter realization and then take the second-stage…

Machine Learning · Computer Science 2024-05-21 Jiashuo Jiang

We consider a multi-agent multi-armed bandit setting in which $n$ honest agents collaborate over a network to minimize regret but $m$ malicious agents can disrupt learning arbitrarily. Assuming the network is the complete graph, existing…

Machine Learning · Computer Science 2023-01-30 Daniel Vial , Sanjay Shakkottai , R. Srikant

The paper considers the problem of distributed adaptive linear parameter estimation in multi-agent inference networks. Local sensing model information is only partially available at the agents and inter-agent communication is assumed to be…

Optimization and Control · Mathematics 2012-08-07 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

In this paper, we address a class of distributed optimization problems in the presence of inter-agent communication delays based on passivity. We first focus on unconstrained distributed optimization and provide a passivity-based…

Systems and Control · Computer Science 2016-09-16 Takeshi Hatanaka , Nikhil Chopra , Takayuki Ishizaki , Na Li

Training agents in multi-agent competitive games presents significant challenges due to their intricate nature. These challenges are exacerbated by dynamics influenced not only by the environment but also by opponents' strategies. Existing…

Machine Learning · Computer Science 2023-08-22 The Viet Bui , Tien Mai , Thanh Hong Nguyen

Motivated by applications to online advertising and recommender systems, we consider a game-theoretic model with delayed rewards and asynchronous, payoff-based feedback. In contrast to previous work on delayed multi-armed bandits, we focus…

Computer Science and Game Theory · Computer Science 2020-06-22 Amélie Héliou , Panayotis Mertikopoulos , Zhengyuan Zhou

Agent faults pose a significant threat to the performance of multi-agent reinforcement learning (MARL) algorithms, introducing two key challenges. First, agents often struggle to extract critical information from the chaotic state space…

Machine Learning · Computer Science 2024-12-03 Yuchen Shi , Huaxin Pei , Liang Feng , Yi Zhang , Danya Yao

This work views the multi-agent system and its surrounding environment as a co-evolving system, where the behavior of one affects the other. The goal is to take both agent actions and environment configurations as decision variables, and…

Robotics · Computer Science 2025-07-03 Zhan Gao , Guang Yang , Amanda Prorok

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

Machine Learning · Computer Science 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

This paper presents a learning framework to estimate an agent capability and task requirement model for multi-agent task allocation. With a set of team configurations and the corresponding task performances as the training data, linear task…

Robotics · Computer Science 2022-11-09 Bo Fu , William Smith , Denise Rizzo , Matthew Castanier , Maani Ghaffari , Kira Barton

We propose a distributed planning method with asynchronous execution for multi-agent pickup and delivery (MAPD) problems for environments with occasional delays in agents' activities and flexible endpoints. MAPD is a crucial problem…

Multiagent Systems · Computer Science 2023-02-21 Yuki Miyashita , Tomoki Yamauchi , Toshiharu Sugawara

Fast changing states or volatile environments pose a significant challenge to online optimization, which needs to perform rapid adaptation under limited observation. In this paper, we give query and regret optimal bandit algorithms under…

Machine Learning · Computer Science 2024-01-18 Zhou Lu , Qiuyi Zhang , Xinyi Chen , Fred Zhang , David Woodruff , Elad Hazan