English
Related papers

Related papers: MambaRain: Multi-Scale Mamba-Attention Framework f…

200 papers

In long-term time series forecasting, different variables often influence the target variable over distinct time intervals, a challenge known as the multi-delay issue. Traditional models typically process all variables or time points…

Machine Learning · Computer Science 2025-05-28 Xiaowen Ma , Zhenliang Ni , Shuai Xiao , Xinghao Chen

Long time series forecasting aims to utilize historical information to forecast future states over extended horizons. Traditional RNN-based series forecasting methods struggle to effectively address long-term dependencies and gradient…

Machine Learning · Computer Science 2024-08-06 GaoXiang Zhao , Li Zhou , XiaoQiang Wang

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Human trajectory forecasting is crucial for safe navigation in crowded environments, requiring models that balance accuracy with computational efficiency. Efficiently modeling social interactions is key to performance in dense crowds. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Po-Chien Luan , Wuyang Li , Yang Gao , Alexandre Alahi

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

Machine Learning · Computer Science 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

Accurate long-term time series forecasting (LTSF) requires the capture of complex long-range dependencies and dynamic periodic patterns. Recent advances in frequency-domain analysis offer a global perspective for uncovering temporal…

Artificial Intelligence · Computer Science 2026-04-28 Xudong Jiang , Mingshan Loo , Hanchen Yang , Wengen Li , Mingrui Zhang , Yichao Zhang , Jihong Guan , Shuigeng Zhou

Time series forecasting in real world environments faces significant challenges non stationarity, multi scale temporal patterns, and distributional shifts that degrade model stability and accuracy. This study propose AdaMamba, a unified…

Machine Learning · Computer Science 2025-12-09 MinCheol Jeon

Rain significantly degrades the performance of computer vision systems, particularly in applications like autonomous driving and video surveillance. While existing deraining methods have made considerable progress, they often struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhaocheng Yu , Kui Jiang , Junjun Jiang , Xianming Liu , Guanglu Sun , Yi Xiao

Medical time series are central to healthcare, enabling continuous monitoring and supporting timely clinical decisions. Despite recent progress, existing methods struggle to jointly model local-global dynamics and handle nonstationarities…

Machine Learning · Computer Science 2026-05-26 Da Zhang , Bingyu Li , Zhiyuan Zhao , Hongyuan Zhang , Junyu Gao , Xuelong Li

This paper proposes a Mamba-assisted neural network framework incorporating self-attention mechanism to achieve improved channel estimation with low complexity for orthogonal frequency-division multiplexing (OFDM) waveforms, particularly…

Machine Learning · Computer Science 2026-01-27 Dianxin Luan , Chengsi Liang , Jie Huang , Zheng Lin , Kaitao Meng , John Thompson , Cheng-Xiang Wang

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

This paper introduces Mamba4Cast, a zero-shot foundation model for time series forecasting. Based on the Mamba architecture and inspired by Prior-data Fitted Networks (PFNs), Mamba4Cast generalizes robustly across diverse time series tasks…

Machine Learning · Computer Science 2024-10-15 Sathya Kamesh Bhethanabhotla , Omar Swelam , Julien Siems , David Salinas , Frank Hutter

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading…

Machine Learning · Computer Science 2025-12-16 Peng Lu , Jerry Huang , Qiuhao Zeng , Xinyu Wang , Boxing Chen , Philippe Langlais , Yufei Cui

High-definition (HD) maps are essential for autonomous driving, as they provide precise road information for downstream tasks. Recent advances highlight the potential of temporal modeling in addressing challenges like occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Ruizi Yang , Xiaolu Liu , Junbo Chen , Jianke Zhu

Short-term (0-24 hours) precipitation forecasting is highly valuable to socioeconomic activities and public safety. However, the highly complex evolution patterns of precipitation events, the extreme imbalance between precipitation and…

Machine Learning · Computer Science 2026-03-30 Shuangliang Li , Siwei Li , Li Li , Weijie Zou , Jie Yang , Maolin Zhang

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enhance tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yinchao Ma , Dengqing Yang , Zhangyu He , Wenfei Yang , Tianzhu Zhang

Mamba has recently gained widespread attention as a backbone model for point cloud modeling, leveraging a state-space architecture that enables efficient global sequence modeling with linear complexity. However, its lack of local inductive…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuanyu Lin , Xiaona Zeng , Xianwei Zheng , Xutao Li

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao

Sequential recommendation systems have become a cornerstone of personalized services, adept at modeling the temporal evolution of user preferences by capturing dynamic interaction sequences. Existing approaches predominantly rely on…

Information Retrieval · Computer Science 2025-05-15 Qianru Zhang , Honggang Wen , Wei Yuan , Crystal Chen , Menglin Yang , Siu-Ming Yiu , Hongzhi Yin

Short-term rainfall forecasting, also known as precipitation nowcasting has become a potentially fundamental technology impacting significant real-world applications ranging from flight safety, rainstorm alerts to farm irrigation timings.…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Maitreya Patel , Anery Patel , Dr. Ranendu Ghosh