English
Related papers

Related papers: AdaMamba: Adaptive Frequency-Gated Mamba for Long-…

200 papers

Text-to-motion generation, which converts motion language descriptions into coherent 3D human motion sequences, has attracted increasing attention in fields, such as avatar animation and humanoid robotic interaction. Though existing models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xingzu Zhan , Chen Xie , Honghang Chen , Yixun Lin , Xiaochun Mai

Recently, deep neural networks have gained increasing popularity in the field of time series forecasting. A primary reason for their success is their ability to effectively capture complex temporal dynamics across multiple related time…

Machine Learning · Computer Science 2022-06-23 Xiaoyong Jin , Youngsuk Park , Danielle C. Maddix , Hao Wang , Yuyang Wang

Multi-task dense scene understanding, which learns a model for multiple dense prediction tasks, has a wide range of application scenarios. Modeling long-range dependency and enhancing cross-task interactions are crucial to multi-task dense…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Baijiong Lin , Weisen Jiang , Pengguang Chen , Yu Zhang , Shu Liu , Ying-Cong Chen

As one of the most representative DL techniques, Transformer architecture has empowered numerous advanced models, especially the large language models (LLMs) that comprise billions of parameters, becoming a cornerstone in deep learning.…

Machine Learning · Computer Science 2026-04-07 Haohao Qu , Liangbo Ning , Rui An , Wenqi Fan , Tyler Derr , Hui Liu , Xin Xu , Qing Li

3D object detection is critical for autonomous driving, yet it remains fundamentally challenging to simultaneously maximize computational efficiency and capture long-range spatial dependencies. We observed that Mamba-based models, with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Longhui Zheng , Qiming Xia , Xiaolu Chen , Zhaoliang Liu , Chenglu Wen

Sequential modeling has demonstrated remarkable capabilities in offline reinforcement learning (RL), with Decision Transformer (DT) being one of the most notable representatives, achieving significant success. However, RL trajectories…

Machine Learning · Computer Science 2024-09-12 Jiahang Cao , Qiang Zhang , Ziqing Wang , Jingkai Sun , Jiaxu Wang , Hao Cheng , Yecheng Shao , Wen Zhao , Gang Han , Yijie Guo , Renjing Xu

Introduction: Long-term time series forecasting (LTSF) has gained significant attention in recent years. While various specialized designs exist for capturing temporal dependency, recent studies have shown that even a single linear layer…

Machine Learning · Computer Science 2026-05-19 Zhe Li , Shiyi Qi , Yiduo Li , Zenglin Xu

While recent Transformer and Mamba architectures have advanced point cloud representation learning, they are typically developed for single-task or single-domain settings. Directly applying them to multi-task domain generalization (DG)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jincen Jiang , Qianyu Zhou , Yuhang Li , Kui Su , Meili Wang , Jian Chang , Jian Jun Zhang , Xuequan Lu

Although transformer-based methods have achieved great success in multi-scale temporal pattern interaction modeling, two key challenges limit their further development: (1) Individual time points contain less semantic information, and…

Machine Learning · Computer Science 2024-11-01 Zongjiang Shang , Ling Chen , Binqing wu , Dongliang Cui

Skeleton-based action recognition has garnered significant attention in the computer vision community. Inspired by the recent success of the selective state-space model (SSM) Mamba in modeling 1D temporal sequences, we propose TSkel-Mamba,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Yanan Liu , Jun Liu , Hao Zhang , Dan Xu , Hossein Rahmani , Mohammed Bennamoun , Qiuhong Ke

Hyperspectral anomaly detection (HAD) aims to identify rare and irregular targets in high-dimensional hyperspectral images (HSIs), which are often noisy and unlabelled data. Existing deep learning methods either fail to capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Aayushma Pant , Lakpa Tamang , Tsz-Kwan Lee , Sunil Aryal

Large Language Models (LLMs) have demonstrated strong semantic reasoning across multimodal domains. However, their integration with graph-based models of brain connectivity remains limited. In addition, most existing fMRI analysis methods…

Image and Video Processing · Electrical Eng. & Systems 2026-05-27 Yasaman Torabi , Parsa Razmara , Hamed Ajorlou , Bardia Baraeinejad

Depression is a prevalent mental health disorder that severely impairs daily functioning and quality of life. While recent deep learning approaches for depression detection have shown promise, most rely on limited feature types, overlook…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Bowen Zhou , Marc-André Fiedler , Ayoub Al-Hamadi

Long-sequence electroencephalogram (EEG) modeling is essential for developing generalizable EEG representation models. This need arises from the high sampling rate of EEG data and the long recording durations required to capture extended…

Machine Learning · Computer Science 2025-11-25 Jiazhen Hong , Geoffrey Mackellar , Soheila Ghane

Multivariate time series forecasting (MTSF) seeks to model temporal dynamics among variables to predict future trends. Transformer-based models and large language models (LLMs) have shown promise due to their ability to capture long-range…

Machine Learning · Computer Science 2025-08-07 Abdul Monaf Chowdhury , Rabeya Akter , Safaeid Hossain Arib

Human motion generation stands as a significant pursuit in generative computer vision, while achieving long-sequence and efficient motion generation remains challenging. Recent advancements in state space models (SSMs), notably Mamba, have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zeyu Zhang , Akide Liu , Ian Reid , Richard Hartley , Bohan Zhuang , Hao Tang

Long-term time series forecasting (LTSF) is important for various domains but is confronted by challenges in handling the complex temporal-contextual relationships. As multivariate input models underperforming some recent univariate…

Machine Learning · Statistics 2026-02-06 Jiecheng Lu , Xu Han , Shihao Yang

Dynamic model averaging (DMA) combines the forecasts of a large number of dynamic linear models (DLMs) to predict the future value of a time series. The performance of DMA critically depends on the appropriate choice of two forgetting…

Econometrics · Economics 2019-12-11 Alisa Yusupova , Nicos G. Pavlidis , Efthymios G. Pavlidis

Long-range dependency is one of the most desired properties of recent sequence models such as state-space models (particularly Mamba) and transformer models. New model architectures are being actively developed and benchmarked for…

Machine Learning · Computer Science 2025-09-05 Cong Ma , Kayvan Najarian

Point cloud videos can faithfully capture real-world spatial geometries and temporal dynamics, which are essential for enabling intelligent agents to understand the dynamically changing world. However, designing an effective 4D backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Jiuming Liu , Jinru Han , Lihao Liu , Angelica I. Aviles-Rivero , Chaokang Jiang , Zhe Liu , Hesheng Wang