English
Related papers

Related papers: Shuffle Mamba: State Space Models with Random Shuf…

200 papers

State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Junbo Qiao , Jincheng Liao , Wei Li , Yulun Zhang , Yong Guo , Yi Wen , Zhangxizi Qiu , Jiao Xie , Jie Hu , Shaohui Lin

Acquiring high-quality annotated data for medical image segmentation is tedious and costly. Semi-supervised segmentation techniques alleviate this burden by leveraging unlabeled data to generate pseudo labels. Recently, advanced state space…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shumeng Li , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

Recent deep models for image shadow removal often rely on attention-based architectures to capture long-range dependencies. However, their fixed attention patterns tend to mix illumination cues from irrelevant regions, leading to distorted…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Zhaotong Yang , Yi Chen , Yanying Li , Shengfeng He , Yangyang Xu , Junyu Dong , Jian Yang , Yong Du

Change detection (CD) in multitemporal remote sensing imagery presents significant challenges for fine-grained recognition, owing to heterogeneity and spatiotemporal misalignment. However, existing methodologies based on vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Lei Ding , Tong Liu , Xuanguang Liu , Xiangyun Liu , Haitao Guo , Jun Lu

Existing video camouflaged object detection (VCOD) methods primarily rely on spatial appearances for motion perception. However, the high foreground-background similarity in VCOD limits the discriminability of such features (e.g. color and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Xin Li , Keren Fu , Qijun Zhao

Two-view correspondence learning aims to discern true and false correspondences between image pairs by recognizing their underlying different information. Previous methods either treat the information equally or require the explicit storage…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiang Fang , Shihua Zhang , Hao Zhang , Tao Lu , Huabing Zhou , Jiayi Ma

Mamba is an emerging, complex workload with various short-range and long-range dependencies, nonlinearities, and elementwise computations that are unable to run at near-peak speeds on modern hardware. Specifically, Mamba's complex…

Hardware Architecture · Computer Science 2026-04-07 Toluwanimi O. Odemuyiwa , John D. Owens , Joel S. Emer , Michael Pellauer

In the realm of computer graphics, the ability to learn continuously from non-stationary data streams while adapting to new visual patterns and mitigating catastrophic forgetting is of paramount importance. Existing approaches often…

Graphics · Computer Science 2025-04-01 Jiahao Qin , Feng Liu , Lu Zong

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

Reconstructing degraded images is a critical task in image processing. Although CNN and Transformer-based models are prevalent in this field, they exhibit inherent limitations, such as inadequate long-range dependency modeling and high…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Rui Deng , Tianpei Gu

The vision-language tracking task aims to perform object tracking based on various modality references. Existing Transformer-based vision-language tracking methods have made remarkable progress by leveraging the global modeling ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xinqi Liu , Li Zhou , Zikun Zhou , Jianqiu Chen , Zhenyu He

Transformers have become dominant in large-scale deep learning tasks across various domains, including text, 2D and 3D vision. However, the quadratic complexity of their attention mechanism limits their efficiency as the sequence length…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Nursena Köprücü , Destiny Okpekpe , Antonio Orvieto

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Zhongping Ji

Accurate prediction of RNA-associated interactions is essential for understanding cellular regulation and advancing drug discovery. While Biological Large Language Models (BioLLMs) such as ESM-2 and RiNALMo provide powerful sequence…

Genomics · Quantitative Biology 2026-02-27 Rabeya Tus Sadia , Qiang Ye , Qiang Cheng

In recent years, Transformers have become the de-facto architecture for sequence modeling on text and a variety of multi-dimensional data, such as images and video. However, the use of self-attention layers in a Transformer incurs…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Shufan Li , Harkanwar Singh , Aditya Grover

State Space Models (SSMs) have recently emerged as an alternative to Vision Transformers (ViTs) due to their unique ability of modeling global relationships with linear complexity. SSMs are specifically designed to capture spatially…

Enterprises are facing increasing risks of insider threats, while existing detection methods are unable to effectively address these challenges due to reasons such as insufficient temporal dynamic feature modeling, computational efficiency…

Cryptography and Security · Computer Science 2025-08-11 Kaichuan Kong , Dongjie Liu , Xiaobo Jin , Zhiying Li , Guanggang Geng , Jian Weng

Human motion generation stands as a significant pursuit in generative computer vision, while achieving long-sequence and efficient motion generation remains challenging. Recent advancements in state space models (SSMs), notably Mamba, have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zeyu Zhang , Akide Liu , Ian Reid , Richard Hartley , Bohan Zhuang , Hao Tang

Mamba has demonstrated exceptional performance in visual tasks due to its powerful global modeling capabilities and linear computational complexity, offering considerable potential in hyperspectral image super-resolution (HSISR). However,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Shi Chen , Lefei Zhang , Liangpei Zhang

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef