English
Related papers

Related papers: Heterogeneous Value Decomposition Policy Fusion fo…

200 papers

When the federated learning is adopted among competitive agents with siloed datasets, agents are self-interested and participate only if they are fairly rewarded. To encourage the application of federated learning, this paper employs a…

Machine Learning · Computer Science 2020-05-04 Jingfeng Zhang , Cheng Li , Antonio Robles-Kelly , Mohan Kankanhalli

Value-decomposition methods, which reduce the difficulty of a multi-agent system by decomposing the joint state-action space into local observation-action spaces, have become popular in cooperative multi-agent reinforcement learning (MARL).…

Artificial Intelligence · Computer Science 2023-03-17 Shuhan Qi , Shuhao Zhang , Qiang Wang , Jiajia Zhang , Jing Xiao , Xuan Wang

This article advocates factorized and hybrid dimensional decompositions (FDD/HDD), as alternatives to analysis-of-variance dimensional decomposition (ADD), for second-moment statistical analysis of multivariate functions. New formulae…

Numerical Analysis · Mathematics 2013-10-28 Sharif Rahman

We study the policy evaluation problem in multi-agent reinforcement learning. In this problem, a group of agents works cooperatively to evaluate the value function for the global discounted accumulative reward problem, which is composed of…

Optimization and Control · Mathematics 2019-06-04 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

Deep reinforcement learning for multi-agent cooperation and competition has been a hot topic recently. This paper focuses on cooperative multi-agent problem based on actor-critic methods under local observations settings. Multi agent deep…

Artificial Intelligence · Computer Science 2017-10-04 Xiangxiang Chu , Hangjun Ye

Multi-agent policy gradient (MAPG) methods recently witness vigorous progress. However, there is a significant performance discrepancy between MAPG methods and state-of-the-art multi-agent value-based approaches. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Yihan Wang , Beining Han , Tonghan Wang , Heng Dong , Chongjie Zhang

Understanding citizens' values in participatory systems is crucial for citizen-centric policy-making. We envision a hybrid participatory system where participants make choices and provide motivations for those choices, and AI agents…

Artificial Intelligence · Computer Science 2025-02-12 Enrico Liscio , Luciano C. Siebert , Catholijn M. Jonker , Pradeep K. Murukannaiah

Multimodal human action understanding is a significant problem in computer vision, with the central challenge being the effective utilization of the complementarity among diverse modalities while maintaining model efficiency. However, most…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Hongsong Wang , Heng Fei , Bingxuan Dai , Jie Gui

Many cooperative multi-agent problems require agents to learn individual tasks while contributing to the collective success of the group. This is a challenging task for current state-of-the-art multi-agent reinforcement algorithms that are…

Multiagent Systems · Computer Science 2020-03-25 Hassam Ullah Sheikh , Ladislau Bölöni

Value function decomposition is becoming a popular rule of thumb for scaling up multi-agent reinforcement learning (MARL) in cooperative games. For such a decomposition rule to hold, the assumption of the individual-global max (IGM)…

Machine Learning · Computer Science 2022-02-17 Zehao Dou , Jakub Grudzien Kuba , Yaodong Yang

Future coalition operations can be substantially augmented through agile teaming between human and machine agents, but in a coalition context these agents may be unfamiliar to the human users and expected to operate in a broad set of…

Multiagent Systems · Computer Science 2020-10-26 Dave Braines , Federico Cerutti , Marc Roig Vilamala , Mani Srivastava , Lance Kaplan Alun Preece , Gavin Pearson

We consider a setting involving $N$ agents, where each agent interacts with an environment modeled as a Markov Decision Process (MDP). The agents' MDPs differ in their reward functions, capturing heterogeneous objectives/tasks. The…

Machine Learning · Computer Science 2024-09-10 Feng Zhu , Robert W. Heath , Aritra Mitra

Standard deep reinforcement learning algorithms use a shared representation for the policy and value function, especially when training directly from images. However, we argue that more information is needed to accurately estimate the value…

Machine Learning · Computer Science 2021-06-16 Roberta Raileanu , Rob Fergus

In many real-world multi-agent cooperative tasks, due to high cost and risk, agents cannot continuously interact with the environment and collect experiences during learning, but have to learn from offline datasets. However, the transition…

Machine Learning · Computer Science 2023-08-01 Jiechuan Jiang , Zongqing Lu

We investigate the problem of distributed training under partial observability, whereby cooperative multi-agent reinforcement learning agents (MARL) maximize the expected cumulative joint reward. We propose distributed value decomposition…

Machine Learning · Computer Science 2025-02-12 Guilherme S. Varela , Alberto Sardinha , Francisco S. Melo

Dynamic Facial Expression Recognition (DFER) plays a critical role in affective computing and human-computer interaction. Although existing methods achieve comparable performance, they inevitably suffer from performance degradation under…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Feng-Qi Cui , Anyang Tong , Jinyang Huang , Jie Zhang , Dan Guo , Zhi Liu , Meng Wang

This paper presents an extension of the Mirror Descent method to overcome challenges in cooperative Multi-Agent Reinforcement Learning (MARL) settings, where agents have varying abilities and individual policies. The proposed…

Machine Learning · Computer Science 2023-08-15 Mohammad Mehdi Nasiri , Mansoor Rezghi

Combined visual and force feedback play an essential role in contact-rich robotic manipulation tasks. Current methods focus on developing the feedback control around a single modality while underrating the synergy of the sensors. Fusing…

Robotics · Computer Science 2022-02-18 Piaopiao Jin , Yinjie Lin , Yanchao Tan , Tiefeng Li , Wei Yang

Recently, model-based agents have achieved better performance than model-free ones using the same computational budget and training time in single-agent environments. However, due to the complexity of multi-agent systems, it is tough to…

Multiagent Systems · Computer Science 2022-12-08 Zhiwei Xu , Dapeng Li , Bin Zhang , Yuan Zhan , Yunpeng Bai , Guoliang Fan

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

Machine Learning · Computer Science 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria