English
Related papers

Related papers: Scalable Visual State Space Model with Fractal Sca…

200 papers

Remote sensing image classification forms the foundation of various understanding tasks, serving a crucial function in remote sensing image interpretation. The recent advancements of Convolutional Neural Networks (CNNs) and Transformers…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Keyan Chen , Bowen Chen , Chenyang Liu , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shufan Li , Harkanwar Singh , Aditya Grover

Mamba-based State Space Models (SSM) have emerged as a promising alternative to the ubiquitous transformers. Despite the expressive power of transformers, the quadratic complexity of computing attention is a major impediment to scaling…

Machine Learning · Computer Science 2025-08-26 Trinayan Baruah , Kaustubh Shivdikar , Sara Prescott , David Kaeli

Recent advancements in State Space Models, notably Mamba, have demonstrated superior performance over the dominant Transformer models, particularly in reducing the computational complexity from quadratic to linear. Yet, difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Fei Xie , Weijia Zhang , Zhongdao Wang , Chao Ma

State Space Model (SSM) is a mathematical model used to describe and analyze the behavior of dynamic systems. This model has witnessed numerous applications in several fields, including control theory, signal processing, economics and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Xiao Liu , Chenxu Zhang , Lei Zhang

State space models (SSMs) have emerged as a powerful paradigm for efficient single-image super-resolution (SR) due to their linear complexity and long-range modeling capabilities. However, existing Mamba-based methods typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wenbin Zou , Yawen Cui , Yi Wang , Lap-Pui Chau , Liang Chen , Jinshan Pan , Huiping Zhuang , Guanbin Li

In image fusion tasks, images from different sources possess distinct characteristics. This has driven the development of numerous methods to explore better ways of fusing them while preserving their respective characteristics.Mamba, as a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zihan Cao , Xiao Wu , Liang-Jian Deng , Yu Zhong

Reconstructing degraded images is a critical task in image processing. Although CNN and Transformer-based models are prevalent in this field, they exhibit inherent limitations, such as inadequate long-range dependency modeling and high…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Rui Deng , Tianpei Gu

Structured State Space Models (SSMs) have emerged as a transformative paradigm in sequence modeling, addressing critical limitations of Recurrent Neural Networks (RNNs) and Transformers, namely, vanishing gradients, sequential computation…

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Junbo Qiao , Jincheng Liao , Wei Li , Yulun Zhang , Yong Guo , Yi Wen , Zhangxizi Qiu , Jiao Xie , Jie Hu , Shaohui Lin

Existing Transformer-based models for point cloud analysis suffer from quadratic complexity, leading to compromised point cloud resolution and information loss. In contrast, the newly proposed Mamba model, based on state space models (SSM),…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xu Han , Yuan Tang , Zhaoxuan Wang , Xianzhi Li

Semantic segmentation is a vital task in the field of remote sensing (RS). However, conventional convolutional neural network (CNN) and transformer-based models face limitations in capturing long-range dependencies or are often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yin Hu , Xianping Ma , Jialu Sui , Man-On Pun

Video super-resolution (VSR) faces critical challenges in effectively modeling non-local dependencies across misaligned frames while preserving computational efficiency. Existing VSR methods typically rely on optical flow strategies or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Linfeng He , Meiqin Liu , Qi Tang , Chao Yao , Yao Zhao

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef

State-Space Models (SSMs) have emerged as an efficient alternative to transformers, yet existing visual SSMs retain deeply ingrained biases from their origins in natural language processing. In this paper, we address these limitations by…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Enis Baty , Alejandro Hernández Díaz , Rebecca Davidson , Chris Bridges , Simon Hadfield

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ke Cao , Xuanhua He , Tao Hu , Chengjun Xie , Man Zhou , Jie Zhang

Source-free domain adaptation (SFDA) tackles the critical challenge of adapting source-pretrained models to unlabeled target domains without access to source data, overcoming data privacy and storage limitations in real-world applications.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Xi Chen , Hongxun Yao , Sicheng Zhao , Jiankun Zhu , Jing Jiang , Kui Jiang

Transformers have become one of the foundational architectures in point cloud analysis tasks due to their excellent global modeling ability. However, the attention mechanism has quadratic complexity, making the design of a linear complexity…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Dingkang Liang , Xin Zhou , Wei Xu , Xingkui Zhu , Zhikang Zou , Xiaoqing Ye , Xiao Tan , Xiang Bai

In the realm of smart healthcare, researchers enhance the scale and diversity of medical datasets through medical image synthesis. However, existing methods are limited by CNN local perception and Transformer quadratic complexity, making it…

Image and Video Processing · Electrical Eng. & Systems 2024-05-10 Zhihan Ju , Wanting Zhou