English
Related papers

Related papers: Trajectory-aware Shifted State Space Models for On…

200 papers

Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Yan He , Bing Tu , Bo Liu , Jun Li , Antonio Plaza

Recent efforts on image restoration have focused on developing "all-in-one" models that can handle different degradation types and levels within single model. However, most of mainstream Transformer-based ones confronted with dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Aiwen Jiang , Hourong Chen , Zhiwen Chen , Jihua Ye , Mingwen Wang

Vision Mambas (ViMs) achieve remarkable success with sub-quadratic complexity, but their efficiency remains constrained by quadratic token scaling with image resolution. While existing methods address token redundancy, they overlook ViMs'…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yan Wen , Peng Ye , Lin Zhang , Baopu Li , Jiakang Yuan , Yaoxin Yang , Tao Chen

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Rui Xu , Shu Yang , Yihui Wang , Yu Cai , Bo Du , Hao Chen

Recent advancements in Mamba have shown promising results in image restoration. These methods typically flatten 2D images into multiple distinct 1D sequences along rows and columns, process each sequence independently using selective scan…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Boyun Li , Haiyu Zhao , Wenxin Wang , Peng Hu , Yuanbiao Gou , Xi Peng

Recent advances in deep learning have mainly relied on Transformers due to their data dependency and ability to learn at scale. The attention module in these architectures, however, exhibits quadratic time and space in input size, limiting…

Machine Learning · Computer Science 2024-07-25 Ali Behrouz , Michele Santacatterina , Ramin Zabih

The realm of Mamba for vision has been advanced in recent years to strike for the alternatives of Vision Transformers (ViTs) that suffer from the quadratic complexity. While the recurrent scanning mechanism of Mamba offers computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Masakazu Yoshimura , Teruaki Hayashi , Yuki Hoshino , Wei-Yao Wang , Takeshi Ohashi

Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture to more efficiently and effectively model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tao Zhang , Haobo Yuan , Lu Qi , Jiangning Zhang , Qianyu Zhou , Shunping Ji , Shuicheng Yan , Xiangtai Li

Transformer-based methods have demonstrated impressive performance in 4D light field (LF) super-resolution by effectively modeling long-range spatial-angular correlations, but their quadratic complexity hinders the efficient processing of…

Image and Video Processing · Electrical Eng. & Systems 2024-06-25 Ruisheng Gao , Zeyu Xiao , Zhiwei Xiong

Spatio-temporal graph (STG) forecasting is a critical task with extensive applications in the real world, including traffic and weather forecasting. Although several recent methods have been proposed to model complex dynamics in STGs,…

Machine Learning · Computer Science 2024-06-18 Jinhyeok Choi , Heehyeon Kim , Minhyeong An , Joyce Jiyoung Whang

The Vision Transformer (ViT) model has long struggled with the challenge of quadratic complexity, a limitation that becomes especially critical in unmanned aerial vehicle (UAV) tracking systems, where data must be processed in real time. In…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Bingxi Liu , Calvin Chen , Junhao Li , Guyang Yu , Haoqian Song , Xuchen Liu , Jinqiang Cui , Hong Zhang

State-Space Models (SSMs) have emerged as an efficient alternative to transformers, yet existing visual SSMs retain deeply ingrained biases from their origins in natural language processing. In this paper, we address these limitations by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Enis Baty , Alejandro Hernández Díaz , Rebecca Davidson , Chris Bridges , Simon Hadfield

Motion style transfer is a significant research direction in the field of computer vision, enabling virtual digital humans to rapidly switch between different styles of the same motion, thereby significantly enhancing the richness and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ziyun Qian , Zeyu Xiao , Xingliang Jin , Dingkang Yang , Mingcheng Li , Zhenyi Wu , Dongliang Kou , Peng Zhai , Lihua Zhang

Perceptual image compression focuses on preserving high visual quality under low-bitrate constraints. Most existing approaches to perceptual compression leverage the strong generative capabilities of generative adversarial networks or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jiaqian Zhang , Hao Wei , Chenyang Ge , Yanhui Zhou

While the conditional sequence modeling with the transformer architecture has demonstrated its effectiveness in dealing with offline reinforcement learning (RL) tasks, it is struggle to handle out-of-distribution states and actions.…

Machine Learning · Computer Science 2025-01-23 Qi Lv , Xiang Deng , Gongwei Chen , Michael Yu Wang , Liqiang Nie

Recent Mamba-based image restoration methods have achieved promising results but remain limited by fixed scanning patterns and inefficient feature utilization. Conventional Mamba architectures rely on predetermined paths that cannot adapt…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Han Hu , Zhuoran Zheng , Liang Li , Chen Lyu

Spatial-Temporal Video Super-Resolution (ST-VSR) technology generates high-quality videos with higher resolution and higher frame rates. Existing advanced methods accomplish ST-VSR tasks through the association of Spatial and Temporal video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Mengshun Hu , Kui Jiang , Zhixiang Nie , Zheng Wang

Mamba is an efficient State Space Model (SSM) with linear computational complexity. Although SSMs are not suitable for handling non-causal data, Vision Mamba (ViM) methods still demonstrate good performance in tasks such as image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Juntao Zhang , Shaogeng Liu , Kun Bian , You Zhou , Pei Zhang , Jianning Liu , Jun Zhou , Bingyan Liu

Selective state space models (SSMs) have rapidly become a compelling backbone for large language models, especially for long-context workloads. Yet in deployment, their inference performance is often bounded by the memory capacity,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-25 Anurag Dutt , Nimit Shah , Hazem Masarani , Anshul Gandhi

The explosive growth in video streaming gives rise to challenges on performing video understanding at high accuracy and low computation cost. Conventional 2D CNNs are computationally cheap but cannot capture temporal relationships; 3D CNN…

Computer Vision and Pattern Recognition · Computer Science 2019-08-23 Ji Lin , Chuang Gan , Song Han