English
Related papers

Related papers: Improving monotonic optimization in heterogeneous …

200 papers

In this work, we study the problem of finding Pareto optimal policies in multi-agent reinforcement learning problems with cooperative reward structures. We show that any algorithm where each agent only optimizes their reward is subject to…

Machine Learning · Computer Science 2024-10-28 Bang Giang Le , Viet Cuong Ta

Previous deep multi-agent reinforcement learning (MARL) algorithms have achieved impressive results, typically in homogeneous scenarios. However, heterogeneous scenarios are also very common and usually harder to solve. In this paper, we…

Multiagent Systems · Computer Science 2024-08-15 Xiaoyang Yu , Youfang Lin , Xiangsen Wang , Sheng Han , Kai Lv

Intelligence agents and multi-agent systems play important roles in scenes like the control system of grouped drones, and multi-agent navigation and obstacle avoidance which is the foundational function of advanced application has great…

Robotics · Computer Science 2022-10-25 Enyu Zhao , Chanjuan Liu , Houfu Su , Yang Liu

Mixture policies theoretically offer greater flexibility than unimodal policies in continuous action reinforcement learning, but the practical benefits of this complexity remain elusive. Mixture policies are notably absent from most…

Machine Learning · Computer Science 2026-05-12 Jiamin He , Samuel Neumann , Jincheng Mei , Adam White , Martha White

Sample efficiency remains a key challenge in multi-agent reinforcement learning (MARL). A promising approach is to learn a meaningful latent representation space through auxiliary learning objectives alongside the MARL objective to aid in…

Multiagent Systems · Computer Science 2024-06-06 Dom Huh , Prasant Mohapatra

Cooperative multi-agent problems often require coordination between agents, which can be achieved through a centralized policy that considers the global state. Multi-agent policy gradient (MAPG) methods are commonly used to learn such…

Robotics · Computer Science 2023-08-03 Xubo Lyu , Amin Banitalebi-Dehkordi , Mo Chen , Yong Zhang

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

Machine Learning · Computer Science 2019-08-22 Tiancheng Yu , Suvrit Sra

We study the finite-horizon Restless Multi-Armed Bandit (RMAB) problem with $N$ homogeneous arms. Prior work has shown that when an RMAB satisfies a non-degeneracy condition, Linear-Programming-based (LP-based) policies derived from the…

Optimization and Control · Mathematics 2025-05-27 Chen Yan , Weina Wang , Lei Ying

Autonomous agents' interactions with humans are increasingly focused on adapting to their changing preferences in order to improve assistance in real-world tasks. Effective agents must learn to accurately infer human goals, which are often…

Artificial Intelligence · Computer Science 2025-01-22 Andrey Risukhin , Kavel Rao , Ben Caffee , Alan Fan

We study a networked multi-agent reinforcement learning (NMARL) problem with human feedback in an infinite-horizon setting, where agents interact over an underlying network with localized state dependencies and aim to collaboratively…

Multiagent Systems · Computer Science 2026-05-18 Pengcheng Dai , He Wang , Dongming Wang , Jian Qin , Wenwu Yu

With wireless devices increasingly forming a unified smart network for seamless, user-friendly operations, random access (RA) medium access control (MAC) design is considered a key solution for handling unpredictable data traffic from…

Networking and Internet Architecture · Computer Science 2025-08-12 Myeung Suk Oh , Zhiyao Zhang , FNU Hairi , Alvaro Velasquez , Jia Liu

One of the notorious issues for Reinforcement Learning (RL) is poor sample efficiency. Compared to single agent RL, the sample efficiency for Multi-Agent Reinforcement Learning (MARL) is more challenging because of its inherent partial…

Machine Learning · Computer Science 2024-04-16 Linjie Xu , Zichuan Liu , Alexander Dockhorn , Diego Perez-Liebana , Jinyu Wang , Lei Song , Jiang Bian

With the rapid growth of IoT devices and latency-sensitive applications, the demand for both real-time and energy-efficient computing has surged, placing significant pressure on traditional cloud computing architectures. Mobile edge…

Machine Learning · Computer Science 2026-01-13 Wei Ai , Yun Peng , Yuntao Shou , Tao Meng , Keqin Li

Tackling multi-agent learning problems efficiently is a challenging task in continuous action domains. While value-based algorithms excel in sample efficiency when applied to discrete action domains, they are usually inefficient when…

Multiagent Systems · Computer Science 2024-02-13 Yasin Findik , S. Reza Ahmadzadeh

We consider the problem of \emph{fully decentralized} multi-agent reinforcement learning (MARL), where the agents are located at the nodes of a time-varying communication network. Specifically, we assume that the reward functions of the…

Machine Learning · Computer Science 2018-02-28 Kaiqing Zhang , Zhuoran Yang , Han Liu , Tong Zhang , Tamer Başar

Achieving optimality and adversarial robustness in deep reinforcement learning has long been regarded as conflicting goals. Nonetheless, recent theoretical insights presented in CAR suggest a potential alignment, raising the important…

Machine Learning · Computer Science 2025-12-02 Haoran Li , Jiayu Lv , Congying Han , Zicheng Zhang , Anqi Li , Yan Liu , Tiande Guo , Nan Jiang

Achieving robust coordination and cooperation is a central challenge in multi-agent reinforcement learning (MARL). Uncovering the mechanisms underlying such emergent behaviors calls for a dynamical understanding of learn processes. In this…

Physics and Society · Physics 2026-01-13 Yuxin Geng , Wolfram Barfuss , Feng Fu , Xingru Chen

Multi-objective reinforcement learning (MORL) algorithms tackle sequential decision problems where agents may have different preferences over (possibly conflicting) reward functions. Such algorithms often learn a set of policies (each…

Machine Learning · Computer Science 2023-08-16 Lucas N. Alegre , Ana L. C. Bazzan , Diederik M. Roijers , Ann Nowé , Bruno C. da Silva

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu

Federated learning (FL) in multi-service provider (SP) ecosystems is fundamentally hampered by non-cooperative dynamics, where privacy constraints and competing interests preclude the centralized optimization of multi-SP communication and…

Machine Learning · Computer Science 2025-08-29 Renxuan Tan , Rongpeng Li , Xiaoxue Yu , Xianfu Chen , Xing Xu , Zhifeng Zhao