English
Related papers

Related papers: Content-Aware Mamba for Learned Image Compression

200 papers

Current image tampering localization methods primarily rely on Convolutional Neural Networks (CNNs) and Transformers. While CNNs suffer from limited local receptive fields, Transformers offer global context modeling at the expense of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Kun Guo , Gang Cao , Zijie Lou , Xianglin Huang , Jiaoyun Liu

Continual Learning (CL) aims to equip AI models with the ability to learn a sequence of tasks over time, without forgetting previously learned knowledge. Recently, State Space Models (SSMs), particularly the Mamba model, have achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 De Cheng , Yue Lu , Lingfeng He , Shizhou Zhang , Xi Yang , Nannan Wang , Xinbo Gao

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Translating NIR to the visible spectrum is challenging due to cross-domain complexities. Current models struggle to balance a broad receptive field with computational efficiency, limiting practical use. Although the Selective Structured…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Huiyu Zhai , Guang Jin , Xingxing Yang , Guosheng Kang

Remote sensing image classification forms the foundation of various understanding tasks, serving a crucial function in remote sensing image interpretation. The recent advancements of Convolutional Neural Networks (CNNs) and Transformers…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Keyan Chen , Bowen Chen , Chenyang Liu , Wenyuan Li , Zhengxia Zou , Zhenwei Shi

In the realm of computer graphics, the ability to learn continuously from non-stationary data streams while adapting to new visual patterns and mitigating catastrophic forgetting is of paramount importance. Existing approaches often…

Graphics · Computer Science 2025-04-01 Jiahao Qin , Feng Liu , Lu Zong

State-space models (SSMs), such as Mamba (Gu & Dao, 2023), have been proposed as alternatives to Transformer networks in language modeling, by incorporating gating, convolutions, and input-dependent token selection to mitigate the quadratic…

Machine Learning · Computer Science 2024-04-26 Jongho Park , Jaeseung Park , Zheyang Xiong , Nayoung Lee , Jaewoong Cho , Samet Oymak , Kangwook Lee , Dimitris Papailiopoulos

The typical Selective State-Space Model (SSM) used in Mamba addresses several limitations of Transformers, such as the quadratic computational complexity with respect to sequence length and the significant memory requirements during…

Computation and Language · Computer Science 2025-10-24 Shengkun Tang , Liqun Ma , Haonan Li , Mingjie Sun , Zhiqiang Shen

We present MambaCSR, a simple but effective framework based on Mamba for the challenging compressed image super-resolution (CSR) task. Particularly, the scanning strategies of Mamba are crucial for effective contextual knowledge modeling in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Yulin Ren , Xin Li , Mengxi Guo , Bingchen Li , Shijie Zhao , Zhibo Chen

Video anomaly detection (VAD) methods are mostly CNN-based or Transformer-based, achieving impressive results, but the focus on detection accuracy often comes at the expense of inference speed. The emergence of state space models in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jiahao Lyu , Minghua Zhao , Jing Hu , Xuewen Huang , Yifei Chen , Shuangli Du

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani

State-space models (SSMs) have recently shown promise in capturing long-range dependencies with subquadratic computational complexity, making them attractive for various applications. However, purely SSM-based models face critical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Abdelrahman Shaker , Syed Talal Wasim , Salman Khan , Juergen Gall , Fahad Shahbaz Khan

Mamba has demonstrated exceptional performance in visual tasks due to its powerful global modeling capabilities and linear computational complexity, offering considerable potential in hyperspectral image super-resolution (HSISR). However,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Shi Chen , Lefei Zhang , Liangpei Zhang

Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) are the predominant modalities utilized in the field of medical imaging. Although MRI capture the complexity of anatomical structures with greater detail than CT, it entails a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhenbin Wang , Lei Zhang , Lituan Wang , Zhenwei Zhang

Image restoration is a key task in low-level computer vision that aims to reconstruct high-quality images from degraded inputs. The emergence of Vision Mamba, which draws inspiration from the advanced state space model Mamba, marks a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yu-Cheng Lin , Yu-Syuan Xu , Hao-Wei Chen , Hsien-Kai Kuo , Chun-Yi Lee

Multicategory remote object counting is a fundamental task in computer vision, aimed at accurately estimating the number of objects of various categories in remote images. Existing methods rely on CNNs and Transformers, but CNNs struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Peng Liu , Sen Lei , Heng-Chao Li

Recent years have seen significant advancements in image restoration, largely attributed to the development of modern deep neural networks, such as CNNs and Transformers. However, existing restoration backbones often face the dilemma…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Hang Guo , Jinmin Li , Tao Dai , Zhihao Ouyang , Xudong Ren , Shu-Tao Xia

Establishing semantic correspondences between images is a fundamental yet challenging task in computer vision. Traditional feature-metric methods enhance visual features but may miss complex inter-correlation relationships, while recent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Seungwook Kim , Minsu Cho

Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yao Wang , Dong Yang , Zhi Qiao , Wenjian Huang , Liuzhi Yang , Zhen Qian

Accurate segmentation of 3D medical images such as MRI and CT is essential for clinical diagnosis and treatment planning. Foundation models like the Segment Anything Model (SAM) provide powerful general-purpose representations but struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Mohammadreza Gholipour Shahraki , Mehdi Rezaeian , Mohammad Ghasemzadeh