English
Related papers

Related papers: ToMacVF : Temporal Macro-action Value Factorizatio…

200 papers

Human Activity Recognition using wearable inertial sensors is foundational to healthcare monitoring, fitness analytics, and context-aware computing, yet its deployment is hindered by cross-user variability arising from heterogeneous…

Machine Learning · Computer Science 2026-03-18 Xiaozhou Ye , Feng Jiang , Zihan Wang , Xiulai Wang , Yutao Zhang , Kevin I-Kai Wang

Vision-Language-Action (VLA) models process visual inputs independently at each timestep, discarding valuable temporal information inherent in robotic manipulation tasks. This frame-by-frame processing makes models vulnerable to visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Chenghao Liu , Jiachen Zhang , Chengxuan Li , Zhimu Zhou , Shixin Wu , Songfang Huang , Huiling Duan

Offline multi-agent reinforcement learning (MARL) aims to learn the optimal joint policy from pre-collected datasets, requiring a trade-off between maximizing global returns and mitigating distribution shift from offline data. Recent…

Machine Learning · Computer Science 2026-04-10 Teng Pang , Zhiqiang Dong , Yan Zhang , Rongjian Xu , Guoqiang Wu , Yilong Yin

In this paper, we propose capturing and utilizing \textit{Temporal Information through Graph-based Embeddings and Representations} or \textbf{TIGER} to enhance multi-agent reinforcement learning (MARL). We explicitly model how inter-agent…

Machine Learning · Computer Science 2025-11-13 Nikunj Gupta , Ludwika Twardecka , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

Event cameras offer unique advantages for vision tasks in challenging environments, yet processing asynchronous event streams remains an open challenge. While existing methods rely on specialized architectures or resource-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ruihao Xia , Junhong Cai , Luziwei Leng , Liuyi Wang , Chengju Liu , Ran Cheng , Yang Tang , Pan Zhou

Value function factorization via centralized training and decentralized execution is promising for solving cooperative multi-agent reinforcement tasks. One of the approaches in this area, QMIX, has become state-of-the-art and achieved the…

Multiagent Systems · Computer Science 2023-07-27 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Centralized training is widely utilized in the field of multi-agent reinforcement learning (MARL) to assure the stability of training process. Once a joint policy is obtained, it is critical to design a value function factorization method…

Artificial Intelligence · Computer Science 2023-11-02 Rizhong Wang , Huiping Li , Di Cui , Demin Xu

Temporal Action Localization (TAL) aims to identify actions' start, end, and class labels in untrimmed videos. While recent advancements using transformer networks and Feature Pyramid Networks (FPN) have enhanced visual feature recognition…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Edward Fish , Jon Weinbren , Andrew Gilbert

The incorporation of macro-actions (temporally extended actions) into multi-agent decision problems has the potential to address the curse of dimensionality associated with such decision problems. Since macro-actions last for stochastic…

Artificial Intelligence · Computer Science 2019-05-30 Kunal Menda , Yi-Chun Chen , Justin Grana , James W. Bono , Brendan D. Tracey , Mykel J. Kochenderfer , David Wolpert

Centralized Training with Decentralized Execution (CTDE) has been a popular paradigm in cooperative Multi-Agent Reinforcement Learning (MARL) settings and is widely used in many real applications. One of the major challenges in the training…

Artificial Intelligence · Computer Science 2022-01-25 Jiahui Li , Kun Kuang , Baoxiang Wang , Furui Liu , Long Chen , Fei Wu , Jun Xiao

Current value-based multi-agent reinforcement learning methods optimize individual Q values to guide individuals' behaviours via centralized training with decentralized execution (CTDE). However, such expected, i.e., risk-neutral, Q value…

Machine Learning · Computer Science 2021-03-23 Wei Qiu , Xinrun Wang , Runsheng Yu , Xu He , Rundong Wang , Bo An , Svetlana Obraztsova , Zinovi Rabinovich

Generative models have emerged as a promising paradigm for offline multi-agent reinforcement learning (MARL), but existing approaches require many iterative sampling steps. Recent few-step acceleration methods either distill a joint teacher…

Artificial Intelligence · Computer Science 2026-05-14 Guowei Zou , Haitao Wang , Beiwen Zhang , Boning Zhang , Hejun Wu

Conditional value-at-risk (CVaR) is a prominent risk measure in financial engineering, energy systems, and supply chain management. In these domains, Markov decision processes (MDPs) with a long-run CVaR criterion effectively mitigate cost…

Optimization and Control · Mathematics 2026-03-11 Qixin Wang , Hao Cao , Jian-Qiang Hu , Mingjie Hu , Li Xia

To reliably deploy Multi-Agent Reinforcement Learning (MARL) systems, it is crucial to understand individual agent behaviors. While prior work typically evaluates overall team performance based on explicit reward signals, it is unclear how…

Artificial Intelligence · Computer Science 2025-08-26 Ardian Selmonaj , Miroslav Strupl , Oleg Szehr , Alessandro Antonucci

The rapid progress of large language models (LLMs) has laid the foundation for multimodal models. However, visual language models (VLMs) still face heavy computational costs when extended from images to videos due to high frame rates and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Peiran Wu , Zhuorui Yu , Yunze Liu , Chi-Hao Wu , Enmin Zhou , Junxiao Shen

Multi-agent reinforcement learning (MARL) has witnessed significant progress with the development of value function factorization methods. It allows optimizing a joint action-value function through the maximization of factorized per-agent…

Multiagent Systems · Computer Science 2023-05-05 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Multimodal foundation models (MFMs) have demonstrated significant success in tasks such as visual captioning, question answering, and image-text retrieval. However, these models face inherent limitations due to their finite internal…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xingjian Diao , Chunhui Zhang , Weiyi Wu , Zhongyu Ouyang , Peijun Qing , Ming Cheng , Soroush Vosoughi , Jiang Gui

We explore value-based solutions for multi-agent reinforcement learning (MARL) tasks in the centralized training with decentralized execution (CTDE) regime popularized recently. However, VDN and QMIX are representative examples that use the…

Machine Learning · Computer Science 2019-05-15 Kyunghwan Son , Daewoo Kim , Wan Ju Kang , David Earl Hostallero , Yung Yi

Temporal planning is an extension of classical planning involving concurrent execution of actions and alignment with temporal constraints. Durative actions along with invariants allow for modeling domains in which multiple agents operate in…

Artificial Intelligence · Computer Science 2023-07-25 Marco De Bortoli , Lukáš Chrpa , Martin Gebser , Gerald Steinbauer-Wagner

Statistical classification of actions in videos is mostly performed by extracting relevant features, particularly covariance features, from image frames and studying time series associated with temporal evolutions of these features. A…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Zhengwu Zhang , Jingyong Su , Eric Klassen , Huiling Le , Anuj Srivastava