English
Related papers

Related papers: MambaIR: A Simple Baseline for Image Restoration w…

200 papers

Recent advancements in multivariate time series forecasting have been propelled by Linear-based, Transformer-based, and Convolution-based models, with Transformer-based architectures gaining prominence for their efficacy in temporal and…

Machine Learning · Computer Science 2024-09-27 Chaolv Zeng , Zhanyu Liu , Guanjie Zheng , Linghe Kong

Modeling high-resolution spatiotemporal representations, including both global dynamic contexts (e.g., holistic human motion tendencies) and local motion details (e.g., high-frequency changes of keypoints), is essential for video-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Runyang Feng , Hyung Jin Chang , Tze Ho Elden Tse , Boeun Kim , Yi Chang , Yixing Gao

Video anomaly detection (VAD) has been extensively researched due to its potential for intelligent video systems. However, most existing methods based on CNNs and transformers still suffer from substantial computational burdens and have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Zhangxun Li , Mengyang Zhao , Xuan Yang , Yang Liu , Jiamu Sheng , Xinhua Zeng , Tian Wang , Kewei Wu , Yu-Gang Jiang

Extracting robust discriminative features is a critical challenge in person re-identification (ReID). While Transformer-based methods have successfully addressed some limitations of convolutional neural networks (CNNs), such as their local…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Hongyang Gu , Qisong Yang , Lei Pu , Siming Han , Yao Ding

Recently, a novel visual state space (VSS) model, referred to as Mamba, has demonstrated significant progress in modeling long sequences with linear complexity, comparable to Transformer models, thereby enhancing its adaptability for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Tao Wang , Tiecheng Bai , Chao Xu , Bin Liu , Erlei Zhang , Jiyun Huang , Hongming Zhang

Multi-modality image fusion (MMIF) aims to integrate complementary information from different modalities into a single fused image to represent the imaging scene and facilitate downstream visual tasks comprehensively. In recent years,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Zhe Li , Haiwei Pan , Kejia Zhang , Yuhua Wang , Fengming Yu

Transformers have been the most successful architecture for various speech modeling tasks, including speech separation. However, the self-attention mechanism in transformers with quadratic complexity is inefficient in computation and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-02 Xilin Jiang , Cong Han , Nima Mesgarani

Despite the prevalence of images and texts in machine learning, tabular data remains widely used across various domains. Existing deep learning models, such as convolutional neural networks and transformers, perform well however demand…

Machine Learning · Computer Science 2024-06-26 Md Atik Ahamed , Qiang Cheng

Atmospheric turbulence is a major source of image degradation in long-range imaging systems. Although numerous deep learning-based turbulence mitigation (TM) methods have been proposed, many are slow, memory-hungry, and do not generalize…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Xingguang Zhang , Nicholas Chimitt , Xijun Wang , Yu Yuan , Stanley H. Chan

Medical image reconstruction from undersampled acquisitions is an ill-posed inverse problem requiring accurate recovery of anatomical structures from incomplete measurements. Physics-driven (PD) network models have gained prominence for…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Bilal Kabas , Fuat Arslan , Valiyeh A. Nezhad , Saban Ozturk , Emine U. Saritas , Tolga Çukur

The state space model Mamba has recently emerged as a promising paradigm in computer vision, attracting significant attention due to its efficient processing of long sequence tasks. Mamba's inherent causal mechanism renders it particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hanpeng Liu , Zidan Wang , Shuoxi Zhang , Kaiyuan Gao , Kun He

Convolutional neural networks (CNNs) and transformers are widely employed in constructing UNet architectures for medical image segmentation tasks. However, CNNs struggle to model long-range dependencies, while transformers suffer from…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Shaolei Zhang , Jinyan Liu , Tianyi Qian , Xuesong Li

Existing deraining Transformers employ self-attention mechanisms with fixed-range windows or along channel dimensions, limiting the exploitation of non-local receptive fields. In response to this issue, we introduce a novel dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shangquan Sun , Wenqi Ren , Juxiang Zhou , Jianhou Gan , Rui Wang , Xiaochun Cao

Pan-sharpening involves integrating information from low-resolution multi-spectral and high-resolution panchromatic images to generate high-resolution multi-spectral counterparts. While recent advancements in the state space model,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xuanhua He , Ke Cao , Keyu Yan , Rui Li , Chengjun Xie , Jie Zhang , Man Zhou

3D image reconstruction from a limited number of 2D images has been a long-standing challenge in computer vision and image analysis. While deep learning-based approaches have achieved impressive performance in this area, existing deep…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Nivetha Jayakumar , Tonmoy Hossain , Miaomiao Zhang

State Space Models (SSMs), especially Mamba, have shown great promise in medical image segmentation due to their ability to model long-range dependencies with linear computational complexity. However, accurate medical image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Chaowei Chen , Li Yu , Shiquan Min , Shunfang Wang

Recovering fine-grained details in extremely dark images remains challenging due to severe structural information loss and noise corruption. Existing enhancement methods often fail to preserve intricate details and sharp edges, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tongshun Zhang , Pingping Liu , Zixuan Zhong , Zijian Zhang , Qiuzhan Zhou

Previous research on lightweight models has primarily focused on CNNs and Transformer-based designs. CNNs, with their local receptive fields, struggle to capture long-range dependencies, while Transformers, despite their global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Haoyang He , Jiangning Zhang , Yuxuan Cai , Hongxu Chen , Xiaobin Hu , Zhenye Gan , Yabiao Wang , Chengjie Wang , Yunsheng Wu , Lei Xie

Recent advancements in sRGB-to-RAW de-rendering have increasingly emphasized metadata-driven approaches to reconstruct RAW data from sRGB images, supplemented by partial RAW information. In image-based de-rendering, metadata is commonly…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Hongjun Chen , Wencheng Han , Huan Zheng , Jianbing Shen

Recent advances in Vision Transformers (ViTs) and State Space Models (SSMs) have challenged the dominance of Convolutional Neural Networks (CNNs) in computer vision. ViTs excel at capturing global context, and SSMs like Mamba offer linear…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mustafa Munir , Alex Zhang , Radu Marculescu