English
Related papers

Related papers: MambaIC: State Space Models for High-Performance L…

200 papers

With the rapid growth of the Internet of Things ecosystem, Automatic Modulation Classification (AMC) has become increasingly paramount. However, extended signal lengths offer a bounty of information, yet impede the model's adaptability,…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Yezhuo Zhang , Zinan Zhou , Yichao Cao , Guangyu Li , Xuanpeng Li

Image deraining is crucial for improving visual quality and supporting reliable downstream vision tasks. Although Mamba-based models provide efficient sequence modeling, their limited ability to capture fine-grained details and lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Zhiliang Zhu , Tao Zeng , Tao Yang , Guoliang Luo , Jiyong Zeng

Image restoration endeavors to reconstruct a high-quality, detail-rich image from a degraded counterpart, which is a pivotal process in photography and various computer vision systems. In real-world scenarios, different types of degradation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yuhong He , Long Peng , Qiaosi Yi , Chen Wu , Lu Wang

State Space Models (SSMs) have emerged as a promising alternative to Transformers for long-context sequence modeling, offering linear $O(N)$ computational complexity compared to the Transformer's quadratic $O(N^2)$ scaling. This paper…

Machine Learning · Computer Science 2026-01-06 Abidemi Koledoye , Chinemerem Unachukwu , Gold Nwobu , Hasin Rana

Existing learning-based stereo image codec adopt sophisticated transformation with simple entropy models derived from single image codecs to encode latent representations. However, those entropy models struggle to effectively capture the…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Xinjie Zhang , Shenyuan Gao , Zhening Liu , Jiawei Shao , Xingtong Ge , Dailan He , Tongda Xu , Yan Wang , Jun Zhang

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

In recent years, visually-rich document understanding has attracted increasing attention. Transformer-based pre-trained models have become the mainstream approach, yielding significant performance gains in this field. However, the…

Computation and Language · Computer Science 2025-02-11 Pengfei Hu , Zhenrong Zhang , Jiefeng Ma , Shuhang Liu , Jun Du , Jianshu Zhang

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

Remote sensing image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral data and a low-resolution image rich in spectral information. Current deep learning (DL)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Siran Peng , Xiangyu Zhu , Haoyu Deng , Liang-Jian Deng , Zhen Lei

State space models (SSMs) have emerged as a powerful paradigm for efficient single-image super-resolution (SR) due to their linear complexity and long-range modeling capabilities. However, existing Mamba-based methods typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Wenbin Zou , Yawen Cui , Yi Wang , Lap-Pui Chau , Liang Chen , Jinshan Pan , Huiping Zhuang , Guanbin Li

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

State Space Models (SSMs), particularly recent selective variants like Mamba, have emerged as a leading architecture for sequence modeling, challenging the dominance of Transformers. However, the success of these state-of-the-art models…

Machine Learning · Computer Science 2025-08-06 Yiyi Wang , Jian'an Zhang , Hongyi Duan , Haoyang Liu , Qingyang Li

Lightweight and efficient deep joint source-channel coding (JSCC) is a key technology for semantic communications. In this paper, we design a novel JSCC scheme named MambaJSCC, which utilizes a visual state space model with channel…

Information Theory · Computer Science 2024-05-07 Tong Wu , Zhiyong Chen , Meixia Tao , Xiaodong Xu , Wenjun Zhang , Ping Zhang

Handling lengthy context is crucial for enhancing the recognition and understanding capabilities of multimodal large language models (MLLMs) in applications such as processing high-resolution images or high frame rate videos. The rise in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Jianing Zhou , Han Li , Shuai Zhang , Ning Xie , Ruijie Wang , Xiaohan Nie , Sheng Liu , Lingyun Wang

To analyze high-dimensional systems, many fields in science and engineering rely on high-level descriptions, sometimes called "macrostates," "coarse-grainings," or "effective theories". Examples of such descriptions include the…

Information Theory · Computer Science 2015-06-19 David H. Wolpert , Joshua A. Grochow , Eric Libby , Simon DeDeo

For the deployment of neural networks in resource-constrained environments, prior works have built lightweight architectures with convolution and attention for capturing local and global dependencies, respectively. Recently, the state space…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Sanghyeok Lee , Joonmyung Choi , Hyunwoo J. Kim

State-Space Models (SSMs) have emerged as efficient alternatives to transformers for sequential data tasks, offering linear or near-linear scalability with sequence length, making them ideal for long-sequence applications in NLP, vision,…

Machine Learning · Computer Science 2025-04-01 Arghadip Das , Arnab Raha , Shamik Kundu , Soumendu Kumar Ghosh , Deepak Mathaikutty , Vijay Raghunathan

Vision transformers dominate image processing tasks due to their superior performance. However, the quadratic complexity of self-attention limits the scalability of these systems and their deployment on resource-constrained devices. State…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Tien-Yu Chi , Hung-Yueh Chiang , Chi-Chih Chang , Ning-Chi Huang , Kai-Chiang Wu

This paper proposes ControlMambaIR, a novel image restoration method designed to address perceptual challenges in image deraining, deblurring, and denoising tasks. By integrating the Mamba network architecture with the diffusion model, the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Cheng Yang , Lijing Liang , Zhixun Su

Today, state-of-the-art deep neural networks that process event-camera data first convert a temporal window of events into dense, grid-like input representations. As such, they exhibit poor generalizability when deployed at higher inference…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Nikola Zubić , Mathias Gehrig , Davide Scaramuzza