English
Related papers

Related papers: ToMacVF : Temporal Macro-action Value Factorizatio…

200 papers

Audio-Visual Video Parsing (AVVP) task aims to parse the event categories and occurrence times from audio and visual modalities in a given video. Existing methods usually focus on implicitly modeling audio and visual features through weak…

Multimedia · Computer Science 2025-05-06 Yaru Chen , Peiliang Zhang , Fei Li , Faegheh Sardari , Ruohao Guo , Zhenbo Li , Wenwu Wang

Value factorization is a popular and promising approach to scaling up multi-agent reinforcement learning in cooperative settings, which balances the learning scalability and the representational capacity of value functions. However, the…

Machine Learning · Computer Science 2021-11-02 Jianhao Wang , Zhizhou Ren , Beining Han , Jianing Ye , Chongjie Zhang

We explore value-based multi-agent reinforcement learning (MARL) in the popular paradigm of centralized training with decentralized execution (CTDE). CTDE has an important concept, Individual-Global-Max (IGM) principle, which requires the…

Machine Learning · Computer Science 2021-10-05 Jianhao Wang , Zhizhou Ren , Terry Liu , Yang Yu , Chongjie Zhang

Multi-agent reinforcement learning (MARL) provides a promising paradigm for coordinating multi-agent systems (MAS). However, most existing methods rely on restrictive assumptions, such as a fixed number of agents and fully synchronous…

Multiagent Systems · Computer Science 2026-02-17 Yexin Li , Jinjin Guo , Haoyu Zhang , Yuhan Zhao , Yiwen Sun , Zihao Jiao

Multi-access edge computing (MEC) and network function virtualization (NFV) are promising technologies to support emerging IoT applications, especially those computation-intensive. In NFV-enabled MEC environment, service function chain…

Artificial Intelligence · Computer Science 2022-05-23 Xinhan Wang , Huanlai Xing , Fuhong Song , Shouxi Luo , Penglin Dai , Bowen Zhao

We introduce hybrid execution in multi-agent reinforcement learning (MARL), a new paradigm in which agents aim to successfully complete cooperative tasks with arbitrary communication levels at execution time by taking advantage of…

Machine Learning · Computer Science 2023-06-06 Pedro P. Santos , Diogo S. Carvalho , Miguel Vasco , Alberto Sardinha , Pedro A. Santos , Ana Paiva , Francisco S. Melo

This paper introduces four new algorithms that can be used for tackling multi-agent reinforcement learning (MARL) problems occurring in cooperative settings. All algorithms are based on the Deep Quality-Value (DQV) family of algorithms, a…

Machine Learning · Computer Science 2020-12-23 Pascal Leroy , Damien Ernst , Pierre Geurts , Gilles Louppe , Jonathan Pisane , Matthia Sabatelli

While Vision-Language-Action (VLA) models have seen rapid progress in pretraining, their advancement in Reinforcement Learning (RL) remains hampered by low sample efficiency and sparse rewards in real-world settings. Developing…

Movement speed data from urban road networks, computed from ridesharing vehicles or taxi trajectories, is often high-dimensional, sparse, and nonstationary (e.g., exhibiting seasonality). To address these challenges, we propose a…

Machine Learning · Computer Science 2026-01-28 Xinyu Chen , Chengyuan Zhang , Xi-Le Zhao , Nicolas Saunier , Lijun Sun

Masked video modeling~(MVM) has emerged as a highly effective pre-training strategy for visual foundation models, whereby the model reconstructs masked spatiotemporal tokens using information from visible tokens. However, a key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Ayush K. Rai , Kyle Min , Tarun Krishna , Feiyan Hu , Alan F. Smeaton , Noel E. O'Connor

The StarCraft II Multi-Agent Challenge (SMAC) was created to be a challenging benchmark problem for cooperative multi-agent reinforcement learning (MARL). SMAC focuses exclusively on the problem of StarCraft micromanagement and assumes that…

Multiagent Systems · Computer Science 2022-08-16 Muhammad Junaid Khan , Syed Hammad Ahmed , Gita Sukthankar

Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique challenges of demanding…

Machine Learning · Computer Science 2021-12-06 Siyang Wu , Tonghan Wang , Chenghao Li , Yang Hu , Chongjie Zhang

The goal of this paper is to study a distributed version of the gradient temporal-difference (GTD) learning algorithm for a class of multi-agent Markov decision processes (MDPs). The temporal-difference (TD) learning is a reinforcement…

Optimization and Control · Mathematics 2020-04-29 Donghwan Lee , Jianghai Hu

Standard RL algorithms assume fixed environment dynamics and require a significant amount of interaction to adapt to new environments. We introduce Policy-Dynamics Value Functions (PD-VF), a novel approach for rapidly adapting to dynamics…

Machine Learning · Computer Science 2020-07-07 Roberta Raileanu , Max Goldstein , Arthur Szlam , Rob Fergus

Temporal action recognition always depends on temporal action proposal generation to hypothesize actions and algorithms usually need to process very long video sequences and output the starting and ending times of each potential action in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tian Wang , Shiye Lei , Youyou Jiang , Choi Chang , Hichem Snoussi , Guangcun Shan

We propose FACtored Multi-Agent Centralised policy gradients (FACMAC), a new method for cooperative multi-agent reinforcement learning in both discrete and continuous action spaces. Like MADDPG, a popular multi-agent actor-critic method,…

Most modern approaches in temporal action localization divide this problem into two parts: (i) short-term feature extraction and (ii) long-range temporal boundary localization. Due to the high GPU memory cost caused by processing long…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Feng Cheng , Gedas Bertasius

This work introduces a novel value decomposition algorithm, termed \textit{Dynamic Deep Factor Graphs} (DDFG). Unlike traditional coordination graphs, DDFG leverages factor graphs to articulate the decomposition of value functions, offering…

Robotics · Computer Science 2024-06-10 Yuchen Shi , Shihong Duan , Cheng Xu , Ran Wang , Fangwen Ye , Chau Yuen

Reinforcement learning with verifiable rewards (RLVR) has become a core technique for post-training of Large Language Models (LLMs). While policy optimization is driven by all sampled tokens under a globally broadcast scalar reward, the…

Machine Learning · Computer Science 2026-05-26 Jinghao Zhang , Ruilin Li , Feng Zhao , Jiaqi Wang

In Cooperative Multi-Agent Reinforcement Learning (MARL) and under the setting of Centralized Training with Decentralized Execution (CTDE), agents observe and interact with their environment locally and independently. With local observation…

Machine Learning · Computer Science 2021-02-24 Jian Hu , Seth Austin Harding , Haibin Wu , Siyue Hu , Shih-wei Liao