English
Related papers

Related papers: Towards Understanding Cooperative Multi-Agent Q-Le…

200 papers

Cooperative multi-agent tasks require agents to deduce their own contributions with shared global rewards, known as the challenge of credit assignment. General methods for policy based multi-agent reinforcement learning to solve the…

Machine Learning · Computer Science 2021-05-11 Lipeng Wan , Xuwei Song , Xuguang Lan , Nanning Zheng

A hallmark of modern large-scale machine learning techniques is the use of training objectives that provide dense supervision to intermediate computations, such as teacher forcing the next token in language models or denoising step-by-step…

Machine Learning · Computer Science 2025-10-24 Bhavya Agrawalla , Michal Nauman , Khush Agrawal , Aviral Kumar

To know which operators to apply and in which order, as well as attributing good values to their parameters is a challenge for users of computer vision. This paper proposes a solution to this problem as a multi-agent system modeled…

Artificial Intelligence · Computer Science 2013-11-26 Issam Qaffou , Mohamed Sadgal , Abdelaziz Elfazziki

In this paper, we explore the susceptibility of the independent Q-learning algorithms (a classical and widely used multi-agent reinforcement learning method) to strategic manipulation of sophisticated opponents in normal-form games played…

Computer Science and Game Theory · Computer Science 2024-07-17 Yuksel Arslantas , Ege Yuceel , Muhammed O. Sayin

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

Multiagent Systems · Computer Science 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

Achieving cooperation among self-interested agents remains a fundamental challenge in multi-agent reinforcement learning. Recent work showed that mutual cooperation can be induced between "learning-aware" agents that account for and shape…

Extending deep Q-learning to cooperative multi-agent settings is challenging due to the exponential growth of the joint action space, the non-stationary environment, and the credit assignment problem. Value decomposition allows deep…

Artificial Intelligence · Computer Science 2025-03-13 Zak Buzzard

For Industry 4.0 Revolution, cooperative autonomous mobility systems are widely used based on multi-agent reinforcement learning (MARL). However, the MARL-based algorithms suffer from huge parameter utilization and convergence difficulties…

Multiagent Systems · Computer Science 2023-08-04 Soohyun Park , Jae Pyoung Kim , Chanyoung Park , Soyi Jung , Joongheon Kim

We propose using regularization for Multi-Agent Reinforcement Learning rather than learning explicit cooperative structures called {\em Multi-Agent Regularized Q-learning} (MARQ). Many MARL approaches leverage centralized structures in…

Machine Learning · Computer Science 2021-09-21 Chapman Siu , Jason Traish , Richard Yi Da Xu

Supervised classification and representation learning are two widely used classes of methods to analyze multivariate images. Although complementary, these methods have been scarcely considered jointly in a hierarchical modeling. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Adrien Lagrange , Mathieu Fauvel , Stéphane May , José Bioucas-Dias , Nicolas Dobigeon

We study the policy evaluation problem in multi-agent reinforcement learning. In this problem, a group of agents works cooperatively to evaluate the value function for the global discounted accumulative reward problem, which is composed of…

Optimization and Control · Mathematics 2019-06-04 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

This paper addresses the problem of decentralized spectrum sharing in vehicle-to-everything (V2X) communication networks. The aim is to provide resource-efficient coexistence of vehicle-to-infrastructure(V2I) and vehicle-to-vehicle(V2V)…

Machine Learning · Computer Science 2021-07-14 Hammad Zafar , Zoran Utkovski , Martin Kasparick , Slawomir Stanczak

The empirical success of multi-agent reinforcement learning (MARL) has motivated the search for more efficient and scalable algorithms for large scale multi-agent systems. However, existing state-of-the-art algorithms do not fully exploit…

Multiagent Systems · Computer Science 2025-10-14 Shahbaz P Qadri Syed , He Bai

In this work, we present a scalable reinforcement learning method for training multi-task policies from large offline datasets that can leverage both human demonstrations and autonomously collected data. Our method uses a Transformer to…

Many potential applications of reinforcement learning in the real world involve interacting with other agents whose numbers vary over time. We propose new neural policy architectures for these multi-agent problems. In contrast to other…

Machine Learning · Computer Science 2019-06-03 Matthew A. Wright , Roberto Horowitz

Many real-world tasks involve multiple agents with partial observability and limited communication. Learning is challenging in these settings due to local viewpoints of agents, which perceive the world as non-stationary due to…

Machine Learning · Computer Science 2018-05-23 Shayegan Omidshafiei , Jason Pazis , Christopher Amato , Jonathan P. How , John Vian

Multi-agent deep reinforcement learning (MARL) suffers from a lack of commonly-used evaluation tasks and criteria, making comparisons between approaches difficult. In this work, we provide a systematic evaluation and comparison of three…

Machine Learning · Computer Science 2021-11-10 Georgios Papoudakis , Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

In recent years, reinforcement learning has faced several challenges in the multi-agent domain, such as the credit assignment issue. Value function factorization emerges as a promising way to handle the credit assignment issue under the…

Machine Learning · Computer Science 2022-06-06 Hao Chen , Guangkai Yang , Junge Zhang , Qiyue Yin , Kaiqi Huang

Solving multi-objective optimization problems is important in various applications where users are interested in obtaining optimal policies subject to multiple, yet often conflicting objectives. A typical approach to obtain optimal policies…

Systems and Control · Electrical Eng. & Systems 2019-10-07 Huixin Zhan , Yongcan Cao

Learning a stable and generalizable centralized value function (CVF) is a crucial but challenging task in multi-agent reinforcement learning (MARL), as it has to deal with the issue that the joint action space increases exponentially with…

Multiagent Systems · Computer Science 2020-08-11 Xinghu Yao , Chao Wen , Yuhui Wang , Xiaoyang Tan