English
Related papers

Related papers: Sequential Order-Robust Mamba for Time Series Fore…

200 papers

Image super-resolution (SR) is a critical technology for overcoming the inherent hardware limitations of sensors. However, existing approaches mainly focus on directly enhancing the final resolution, often neglecting effective control over…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chenyu Li , Danfeng Hong , Bing Zhang , Zhaojie Pan , Naoto Yokoya , Jocelyn Chanussot

Recently, Mamba-based super-resolution (SR) methods have demonstrated the ability to capture global receptive fields with linear complexity, addressing the quadratic computational cost of Transformer-based SR approaches. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Sichen Guo , Wenjie Li , Yuanyang Liu , Guangwei Gao , Jian Yang , Chia-Wen Lin

In scene text detection, Transformer-based methods have addressed the global feature extraction limitations inherent in traditional convolution neural network-based methods. However, most directly rely on native Transformer attention layers…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Qiyan Zhao , Yue Yan , Da-Han Wang

State Space Models (SSMs) show significant potential for long-sequence modeling, but their reliance on input order conflicts with the irregular nature of point clouds. Existing approaches often rely on predefined serialization schemes whose…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Bin Liu , Chunyang Wang , Xuelian Liu , Ge Zhang

Sequence models like Transformers and RNNs often overallocate attention to irrelevant context, leading to noisy intermediate representations. This degrades LLM capabilities by promoting hallucinations, weakening long-range and retrieval…

Machine Learning · Computer Science 2025-10-30 Nadav Schneider , Itamar Zimerman , Eliya Nachmani

A persistent paradox in time-series forecasting is that structurally simple MLP and linear models often outperform high-capacity Transformers. We argue that this gap arises from a mismatch in the sequence-modeling primitive: while many…

Machine Learning · Computer Science 2026-05-13 Jevon Twitty , Vinh Pham , Nitiwith Rotchanarak , Viresh Pati , Yubin Kim , Shihao Yang , Jiecheng Lu

Transformer-based methods for 3D human pose estimation face significant computational challenges due to the quadratic growth of self-attention mechanism complexity with sequence length. Recently, the Mamba model has substantially reduced…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Zenghao Zheng , Lianping Yang , Jinshan Pan , Hegui Zhu

In this effort, we propose using the Mamba for handling tabular data in personalized recommendation systems. We present the \textit{FT-Mamba} (Feature Tokenizer\,$+$\,Mamba), a novel hybrid model that replaces Transformer layers with Mamba…

Information Retrieval · Computer Science 2024-09-27 Andrew Starnes , Clayton Webster

Event cameras capture asynchronous pixel-level brightness changes with microsecond temporal resolution, offering unique advantages for high-speed vision tasks. Existing methods often convert event streams into intermediate representations…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Hanfang Liang , Bing Wang , Shizhen Zhang , Wen Jiang , Yizhuo Yang , Weixiang Guo , Shenghai Yuan

Surgical phase recognition is crucial for enhancing the efficiency and safety of computer-assisted interventions. One of the fundamental challenges involves modeling the long-distance temporal relationships present in surgical videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Rui Cao , Jiangliu Wang , Yun-Hui Liu

Due to the long-range modeling ability and linear complexity property, Mamba has attracted considerable attention in point cloud analysis. Despite some interesting progress, related work still suffers from imperfect point cloud…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Kanglin Qu , Pan Gao , Qun Dai , Zhanzhi Ye , Rui Ye , Yuanhao Sun

Training urban spatio-temporal foundation models that generalize well across diverse regions and cities is critical for deploying urban services in unseen or data-scarce regions. Recent studies have typically focused on fusing cross-domain…

Machine Learning · Computer Science 2026-02-04 Rui An , Yifeng Zhang , Ziran Liang , Wenqi Fan , Yuxuan Liang , Xuequn Shang , Qing Li

Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Ying Chen , Jiajing Xie , Yuxiang Lin , Yuhang Song , Wenxian Yang , Rongshan Yu

Linear State Space Models (SSMs) offer remarkable performance gains in efficient sequence modeling, with constant inference-time computation and memory complexity. Recent advances, such as Mamba, further enhance SSMs with input-dependent…

Machine Learning · Computer Science 2025-06-24 Zheng Zhan , Liliang Ren , Shuohang Wang , Liyuan Liu , Yang Liu , Yeyun Gong , Yanzhi Wang , Yelong Shen

Convolutional neural networks (CNN) and Transformers have made impressive progress in the field of remote sensing change detection (CD). However, both architectures have inherent shortcomings: CNN are constrained by a limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Hongruixuan Chen , Jian Song , Chengxi Han , Junshi Xia , Naoto Yokoya

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Multivariate time series data provide a robust framework for future predictions by leveraging information across multiple dimensions, ensuring broad applicability in practical scenarios. However, their high dimensionality and mixing…

Machine Learning · Computer Science 2024-11-28 Xuanbing Zhu , Dunbin Shen , Zhongwen Rao , Huiyi Ma , Yingguang Hao , Hongyu Wang

Mamba extends earlier state space models (SSMs) by introducing input-dependent dynamics, and has demonstrated strong empirical performance across a range of domains, including language modeling, computer vision, and foundation models.…

Machine Learning · Computer Science 2025-05-15 Annan Yu , N. Benjamin Erichson

Time series forecasting in real world environments faces significant challenges non stationarity, multi scale temporal patterns, and distributional shifts that degrade model stability and accuracy. This study propose AdaMamba, a unified…

Machine Learning · Computer Science 2025-12-09 MinCheol Jeon

Enhancing and preserving the readability of document images, particularly historical ones, is crucial for effective document image analysis. Numerous models have been proposed for this task, including convolutional-based, transformer-based,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Mohd. Azfar , Siddhant Bharadwaj , Ashwin Sasikumar