English
Related papers

Related papers: STAIRS-Former: Spatio-Temporal Attention with Inte…

200 papers

In this paper, we develop a novel mobility-aware transformer-driven tiered structure (MASSFormer) based cooperative spectrum sensing method that effectively models the spatio-temporal dynamics of user movements. Unlike existing methods, our…

Information Theory · Computer Science 2024-09-27 Dimpal Janu , Sandeep Mandia , Kuldeep Singh , Sandeep Kumar

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

Machine Learning · Computer Science 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

Safety and scalability are two critical challenges faced by practical Multi-Agent Systems (MAS). However, existing Multi-Agent Reinforcement Learning (MARL) algorithms that rely solely on reward shaping are ineffective in ensuring safety,…

Multiagent Systems · Computer Science 2025-04-02 Haikuo Du , Fandi Gou , Yunze Cai

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

We study multi-agent reinforcement learning (MARL) with centralized training and decentralized execution. During the training, new agents may join, and existing agents may unexpectedly leave the training. In such situations, a standard deep…

Machine Learning · Computer Science 2022-08-05 Xuting Tang , Jia Xu , Shusen Wang

Online temporal action localization (On-TAL) is the task of identifying multiple action instances given a streaming video. Since existing methods take as input only a video segment of fixed size per iteration, they are limited in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Youngkil Song , Dongkeun Kim , Minsu Cho , Suha Kwak

In action recognition, although the combination of spatio-temporal videos and skeleton features can improve the recognition performance, a separate model and balancing feature representation for cross-modal data are required. To solve these…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Dasom Ahn , Sangwon Kim , Hyunsu Hong , Byoung Chul Ko

Effective navigation intelligence relies on long-term memory to support both immediate generalization and sustained adaptation. However, existing approaches face a dilemma: modular systems rely on explicit mapping but lack flexibility,…

Machine Learning · Computer Science 2026-03-26 Zhiyuan Chen , Yuxuan Zhong , Fan Wang , Bo Yu , Pengtao Shao , Shaoshan Liu , Ning Ding

Deep neural networks, especially transformer-based architectures, have achieved remarkable success in semantic segmentation for environmental perception. However, existing models process video frames independently, thus failing to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Serin Varghese , Kevin Ross , Fabian Hueger , Kira Maag

Multi-agent systems (MAS) have shown great potential in executing complex tasks, but coordination and safety remain significant challenges. Multi-Agent Reinforcement Learning (MARL) offers a promising framework for agent collaboration, but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziqi Jia , Junjie Li , Xiaoyang Qu , Jianzong Wang

Offline reinforcement learning (RL) has garnered significant attention for its ability to learn effective policies from pre-collected datasets without the need for further environmental interactions. While promising results have been…

Machine Learning · Computer Science 2024-10-04 The Viet Bui , Thanh Hong Nguyen , Tien Mai

Distributed Multi-Agent Reinforcement Learning (MARL) algorithms has attracted a surge of interest lately mainly due to the recent advancements of Deep Neural Networks (DNNs). Conventional Model-Based (MB) or Model-Free (MF) RL algorithms…

Machine Learning · Computer Science 2022-01-03 Mohammad Salimibeni , Arash Mohammadi , Parvin Malekzadeh , Konstantinos N. Plataniotis

Multivariate time series (MTS) analysis prevails in real-world applications such as finance, climate science and healthcare. The various self-attention mechanisms, the backbone of the state-of-the-art Transformer-based models, efficiently…

Machine Learning · Computer Science 2023-11-21 Quang Minh Nguyen , Lam M. Nguyen , Subhro Das

Multi-task multi-agent reinforcement learning (MT-MARL) has recently gained attention for its potential to enhance MARL's adaptability across multiple tasks. However, it is challenging for existing multi-task learning methods to handle…

Robotics · Computer Science 2025-07-10 Guobin Zhu , Rui Zhou , Wenkang Ji , Hongyin Zhang , Donglin Wang , Shiyu Zhao

Significant advances have recently been achieved in Multi-Agent Reinforcement Learning (MARL) which tackles sequential decision-making problems involving multiple participants. However, MARL requires a tremendous number of samples for…

Multiagent Systems · Computer Science 2024-12-30 Xihuai Wang , Zhicheng Zhang , Weinan Zhang

Multi-Agent Experience Replay (MER) is a key component of off-policy reinforcement learning~(RL) algorithms. By remembering and reusing experiences from the past, experience replay significantly improves the stability of RL algorithms and…

Multiagent Systems · Computer Science 2023-06-02 Kailash Gogineni , Yongsheng Mei , Peng Wei , Tian Lan , Guru Venkataramani

Unlike the sparse label action detection task, where a single action occurs in each timestamp of a video, in a dense multi-label scenario, actions can overlap. To address this challenging task, it is necessary to simultaneously learn (i)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Faegheh Sardari , Armin Mustafa , Philip J. B. Jackson , Adrian Hilton

Coordination is one of the most difficult aspects of multi-agent reinforcement learning (MARL). One reason is that agents normally choose their actions independently of one another. In order to see coordination strategies emerging from the…

Machine Learning · Computer Science 2023-01-16 Matteo Gallici , Mario Martin , Ivan Masmitja

Effective interactive tool use requires agents to master Tool Integrated Reasoning (TIR): a complex process involving multi-turn planning and long-context dialogue management. To train agents for this dynamic process, particularly in…

Computation and Language · Computer Science 2025-09-19 Weiting Tan , Xinghua Qu , Ming Tu , Meng Ge , Andy T. Liu , Philipp Koehn , Lu Lu

Stochastic partial observability poses a major challenge for decentralized coordination in multi-agent reinforcement learning but is largely neglected in state-of-the-art research due to a strong focus on state-based centralized training…