English
Related papers

Related papers: VSRM: A Robust Mamba-Based Framework for Video Sup…

200 papers

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolution operations, the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyang Wang , Jian-Qing Zheng , Yichi Zhang , Ge Cui , Lei Li

State Space Models (SSMs) with selective scan (Mamba) have been adapted into efficient vision models. Mamba, unlike Vision Transformers, achieves linear complexity for token interactions through a recurrent hidden state process. This…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Saarthak Kapse , Robin Betz , Srinivasan Sivanandan

Efficient extraction of spectral sequences and geospatial information has always been a hot topic in hyperspectral image classification. In terms of spectral sequence feature capture, RNN and Transformer have become mainstream…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Aitao Yang , Min Li , Yao Ding , Leyuan Fang , Yaoming Cai , Yujie He

Translating NIR to the visible spectrum is challenging due to cross-domain complexities. Current models struggle to balance a broad receptive field with computational efficiency, limiting practical use. Although the Selective Structured…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Huiyu Zhai , Guang Jin , Xingxing Yang , Guosheng Kang

Traditionally for improving the segmentation performance of models, most approaches prefer to use adding more complex modules. And this is not suitable for the medical field, especially for mobile medical devices, where computationally…

Image and Video Processing · Electrical Eng. & Systems 2025-06-30 Renkai Wu , Yinghao Liu , Pengchen Liang , Qing Chang

Global effective receptive field plays a crucial role for image style transfer (ST) to obtain high-quality stylized results. However, existing ST backbones (e.g., CNNs and Transformers) suffer huge computational complexity to achieve global…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Hongda Liu , Longguang Wang , Ye Zhang , Ziru Yu , Yulan Guo

Multi-modality image fusion aims to integrate the merits of images from different sources and render high-quality fusion images. However, existing feature extraction and fusion methods are either constrained by inherent local reduction bias…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Chenguang Zhu , Shan Gao , Huafeng Chen , Guangqian Guo , Chaowei Wang , Yaoxing Wang , Chen Shu Lei , Quanjiang Fan

Magnetic resonance imaging (MRI) is critical for neurodevelopmental research, however access to high-field (HF) systems in low- and middle-income countries is severely hindered by their cost. Ultra-low-field (ULF) systems mitigate such…

The accelerated MRI reconstruction poses a challenging ill-posed inverse problem due to the significant undersampling in k-space. Deep neural networks, such as CNNs and ViTs, have shown substantial performance improvements for this task…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Yucong Meng , Zhiwei Yang , Zhijian Song , Yonghong Shi

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Zhongping Ji

Video restoration (e.g., video super-resolution) aims to restore high-quality frames from low-quality frames. Different from single image restoration, video restoration generally requires to utilize temporal information from multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Jingyun Liang , Jiezhang Cao , Yuchen Fan , Kai Zhang , Rakesh Ranjan , Yawei Li , Radu Timofte , Luc Van Gool

VADMamba pioneered the introduction of Mamba to Video Anomaly Detection (VAD), achieving high accuracy and fast inference through hybrid proxy tasks. Nevertheless, its heavy reliance on optical flow as auxiliary input and inter-task fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jihao Lyu , Minghua Zhao , Jing Hu , Yifei Chen , Shuangli Du , Cheng Shi

Multi-Modal Image Fusion (MMIF) aims to integrate complementary image information from different modalities to produce informative images. Previous deep learning-based MMIF methods generally adopt Convolutional Neural Networks (CNNs) or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hui Sun , Long Lv , Pingping Zhang , Tongdan Tang , Feng Tian , Weibing Sun , Huchuan Lu

Recent advances in LiDAR 3D detection have demonstrated the effectiveness of Transformer-based frameworks in capturing the global dependencies from point cloud spaces, which serialize the 3D voxels into the flattened 1D sequence for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xin Jin , Haisheng Su , Kai Liu , Cong Ma , Wei Wu , Fei Hui , Junchi Yan

Infrared Image Super-Resolution (IRSR) is challenged by the low contrast and sparse textures of infrared data, requiring robust long-range modeling to maintain global coherence. While State-Space Models like Mamba offer proficiency in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Yongsong Huang , Tomo Miyazaki , Xiaofeng Liu , Shinichiro Omachi

Mamba is an efficient State Space Model (SSM) with linear computational complexity. Although SSMs are not suitable for handling non-causal data, Vision Mamba (ViM) methods still demonstrate good performance in tasks such as image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Juntao Zhang , Shaogeng Liu , Kun Bian , You Zhou , Pei Zhang , Jianning Liu , Jun Zhou , Bingyan Liu

Video super-resolution (VSR), with the aim to restore a high-resolution video from its corresponding low-resolution version, is a spatial-temporal sequence prediction problem. Recently, Transformer has been gaining popularity due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jiezhang Cao , Yawei Li , Kai Zhang , Luc Van Gool

Compared to single view medical image classification, using multiple views can significantly enhance predictive accuracy as it can account for the complementarity of each view while leveraging correlations between views. Existing multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xiaoyu Zheng , Xu Chen , Shaogang Gong , Xavier Griffin , Greg Slabaugh

State Space Models (SSMs) have recently emerged as an alternative to Vision Transformers (ViTs) due to their unique ability of modeling global relationships with linear complexity. SSMs are specifically designed to capture spatially…