English
Related papers

Related papers: Dyadic Mamba: Long-term Dyadic Human Motion Synthe…

200 papers

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

Machine Learning · Computer Science 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

Sequential modeling has demonstrated remarkable capabilities in offline reinforcement learning (RL), with Decision Transformer (DT) being one of the most notable representatives, achieving significant success. However, RL trajectories…

Machine Learning · Computer Science 2024-09-12 Jiahang Cao , Qiang Zhang , Ziqing Wang , Jingkai Sun , Jiaxu Wang , Hao Cheng , Yecheng Shao , Wen Zhao , Gang Han , Yijie Guo , Renjing Xu

Sequential recommendation methods are crucial in modern recommender systems for their remarkable capability to understand a user's changing interests based on past interactions. However, a significant challenge faced by current methods…

Information Retrieval · Computer Science 2025-01-17 Haohao Qu , Yifeng Zhang , Liangbo Ning , Wenqi Fan , Qing Li

With intelligent room-side sensing and service robots widely deployed, human motion prediction (HMP) is essential for safe, proactive assistance. However, many existing HMP methods either produce a single, deterministic forecast that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junqiao Fan , Pengfei Liu , Haocong Rao

The Transformer architecture has shown a remarkable ability in modeling global relationships. However, it poses a significant computational challenge when processing high-dimensional medical images. This hinders its development and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zhaohu Xing , Tian Ye , Yijun Yang , Guang Liu , Lei Zhu

Multi-modal medical image synthesis involves nonlinear transformation of tissue signals between source and target modalities, where tissues exhibit contextual interactions across diverse spatial distances. As such, the utility of a network…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Omer F. Atli , Bilal Kabas , Fuat Arslan , Arda C. Demirtas , Mahmut Yurt , Onat Dalmaz , Tolga Çukur

Current automatic speech recognition systems struggle with modeling long speech sequences due to high quadratic complexity of Transformer-based models. Selective state space models such as Mamba has performed well on long-sequence modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Xiaoxue Gao , Nancy F. Chen

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

In the realm of motion generation, the creation of long-duration, high-quality motion sequences remains a significant challenge. This paper presents our groundbreaking work on "Infinite Motion", a novel approach that leverages long text to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Mengtian Li , Chengshuo Zhai , Shengxiang Yao , Zhifeng Xie , Keyu Chen , Yu-Gang Jiang

Long-range sequence processing poses a significant challenge for Transformers due to their quadratic complexity in input length. A promising alternative is Mamba, which demonstrates high performance and achieves Transformer-level…

Machine Learning · Computer Science 2025-04-11 Assaf Ben-Kish , Itamar Zimerman , Shady Abu-Hussein , Nadav Cohen , Amir Globerson , Lior Wolf , Raja Giryes

Point cloud videos can faithfully capture real-world spatial geometries and temporal dynamics, which are essential for enabling intelligent agents to understand the dynamically changing world. However, designing an effective 4D backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Jiuming Liu , Jinru Han , Lihao Liu , Angelica I. Aviles-Rivero , Chaokang Jiang , Zhe Liu , Hesheng Wang

With the evolution of large language models, traditional Transformer models become computationally demanding for lengthy sequences due to the quadratic growth in computation with respect to the sequence length. Mamba, emerging as a…

Machine Learning · Computer Science 2024-08-22 Haoran Xu , Ziqian Liu , Rong Fu , Zhongling Su , Zerui Wang , Zheng Cai , Zhilin Pei , Xingcheng Zhang

Dynamic graphs exhibit intertwined spatio-temporal evolutionary patterns, widely existing in the real world. Nevertheless, the structure incompleteness, noise, and redundancy result in poor robustness for Dynamic Graph Neural Networks…

Machine Learning · Computer Science 2024-12-20 Haonan Yuan , Qingyun Sun , Zhaonan Wang , Xingcheng Fu , Cheng Ji , Yongjian Wang , Bo Jin , Jianxin Li

Transformers have significantly advanced the field of 3D human pose estimation (HPE). However, existing transformer-based methods primarily use self-attention mechanisms for spatio-temporal modeling, leading to a quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yunlong Huang , Junshuo Liu , Ke Xian , Robert Caiming Qiu

Long-sequence electroencephalogram (EEG) modeling is essential for developing generalizable EEG representation models. This need arises from the high sampling rate of EEG data and the long recording durations required to capture extended…

Machine Learning · Computer Science 2025-11-25 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often convert images into 1D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chaodong Xiao , Minghan Li , Zhengqiang Zhang , Deyu Meng , Lei Zhang

Recent works have shown the remarkable superiority of transformer models in reinforcement learning (RL), where the decision-making problem is formulated as sequential generation. Transformer-based agents could emerge with self-improvement…

Machine Learning · Computer Science 2024-06-04 Sili Huang , Jifeng Hu , Zhejian Yang , Liwei Yang , Tao Luo , Hechang Chen , Lichao Sun , Bo Yang

Efficiently modeling large 2D contexts is essential for various fields including Giga-Pixel Whole Slide Imaging (WSI) and remote sensing. Transformer-based models offer high parallelism but face challenges due to their quadratic complexity…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Jingwei Zhang , Anh Tien Nguyen , Xi Han , Vincent Quoc-Huy Trinh , Hong Qin , Dimitris Samaras , Mahdi S. Hosseini

Mamba-based models have drawn much attention in offline RL. However, their selective mechanism often detrimental when key steps in RL sequences are omitted. To address these issues, we propose a simple yet effective structure, called…

Machine Learning · Computer Science 2026-02-27 Wall Kim , Chaeyoung Song , Hanul Kim

Time series prediction, a crucial task across various domains, faces significant challenges due to the inherent complexities of time series data, including non-stationarity, multi-scale periodicity, and transient dynamics, particularly when…

Machine Learning · Computer Science 2025-07-18 Qianru Zhang , Chenglei Yu , Haixin Wang , Yudong Yan , Yuansheng Cao , Siu-Ming Yiu , Tailin Wu , Hongzhi Yin