English
Related papers

Related papers: Mamba-based Light Field Super-Resolution with Effi…

200 papers

Transformers have become dominant in large-scale deep learning tasks across various domains, including text, 2D and 3D vision. However, the quadratic complexity of their attention mechanism limits their efficiency as the sequence length…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Nursena Köprücü , Destiny Okpekpe , Antonio Orvieto

Deep learning methods, especially Convolutional Neural Networks (CNN) and Vision Transformer (ViT), are frequently employed to perform semantic segmentation of high-resolution remotely sensed images. However, CNNs are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Qinfeng Zhu , Yuan Fang , Yuanzhi Cai , Cheng Chen , Lei Fan

3D object detection is critical for autonomous driving, yet it remains fundamentally challenging to simultaneously maximize computational efficiency and capture long-range spatial dependencies. We observed that Mamba-based models, with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Longhui Zheng , Qiming Xia , Xiaolu Chen , Zhaoliang Liu , Chenglu Wen

Recent advancements in the Mamba architecture, with its linear computational complexity, being a promising alternative to transformer architectures suffering from quadratic complexity. While existing works primarily focus on adapting Mamba…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jie Hu , Junwei Zheng , Jiale Wei , Jiaming Zhang , Rainer Stiefelhagen

Video mirror detection has received significant research attention, yet existing methods suffer from limited performance and robustness. These approaches often over-rely on single, unreliable dynamic features, and are typically built on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rui Song , Jiaying Lin , Rynson W. H. Lau

Multi-modal 3D medical image segmentation aims to accurately identify tumor regions across different modalities, facing challenges from variations in image intensity and tumor morphology. Traditional convolutional neural network (CNN)-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Zexin Ji , Beiji Zou , Xiaoyan Kui , Hua Li , Pierre Vera , Su Ruan

Remote sensing images are becoming increasingly widespread in military, earth resource exploration. Because of the limitation of a single sensor, we can obtain high spatial resolution grayscale panchromatic (PAN) images and low spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Qian Jiang , Qianqian Wang , Xin Jin , Michal Wozniak , Shaowen Yao , Wei Zhou

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

Recent advancements in medical imaging have resulted in more complex and diverse images, with challenges such as high anatomical variability, blurred tissue boundaries, low organ contrast, and noise. Traditional segmentation methods…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Yufeng Jiang , Zongxi Li , Xiangyan Chen , Haoran Xie , Jing Cai

Transformers have become foundational for visual tasks such as object detection, semantic segmentation, and video understanding, but their quadratic complexity in attention mechanisms presents scalability challenges. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Fady Ibrahim , Guangjun Liu , Guanghui Wang

Image fusion integrates complementary information from different modalities to generate high-quality fused images, thereby enhancing downstream tasks such as object detection and semantic segmentation. Unlike task-specific techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yingying Wang , Rongjin Zhuang , Hui Zheng , Xuanhua He , Ke Cao , Xiaotong Tu , Xinghao Ding

Sonar imaging is the primary modality for underwater target detection, yet small targets remain difficult to detect due to insufficient pixel coverage, low acoustic contrast, and scale ambiguity across imaging ranges. CNN-based detectors…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Hui Lin , Jiayi Li , Jing Wang , Shenghui Rong

Establishing semantic correspondences between images is a fundamental yet challenging task in computer vision. Traditional feature-metric methods enhance visual features but may miss complex inter-correlation relationships, while recent…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Seungwook Kim , Minsu Cho

State-of-the-art transformer-based large multimodal models (LMMs) struggle to handle hour-long video inputs due to the quadratic complexity of the causal self-attention operations, leading to high computational costs during training and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Weiming Ren , Wentao Ma , Huan Yang , Cong Wei , Ge Zhang , Wenhu Chen

Hyperspectral anomaly detection (HAD) aims to identify rare and irregular targets in high-dimensional hyperspectral images (HSIs), which are often noisy and unlabelled data. Existing deep learning methods either fail to capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Aayushma Pant , Lakpa Tamang , Tsz-Kwan Lee , Sunil Aryal

Transformer-based segmentation methods face the challenge of efficient inference when dealing with high-resolution images. Recently, several linear attention architectures, such as Mamba and RWKV, have attracted much attention as they can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Haobo Yuan , Xiangtai Li , Lu Qi , Tao Zhang , Ming-Hsuan Yang , Shuicheng Yan , Chen Change Loy

Shadow removal aims to restore images that are partially degraded by shadows, where the degradation is spatially localized and non-uniform. Unlike general restoration tasks that assume global degradation, shadow removal can leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Linhao Li , Boya Jin , Zizhe Li , Lanqing Guo , Hao Cheng , Bo Li , Yongfeng Dong

Weakly supervised semantic segmentation offers a label-efficient solution to train segmentation models for volumetric medical imaging. However, existing approaches often rely on 2D encoders that neglect the inherent volumetric nature of the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Yiheng Lyu , Lian Xu , Mohammed Bennamoun , Farid Boussaid , Coen Arrow , Girish Dwivedi

Transformers have revolutionized deep learning across various tasks, including audio representation learning, due to their powerful modeling capabilities. However, they often suffer from quadratic complexity in both GPU memory usage and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-06 Siavash Shams , Sukru Samet Dindar , Xilin Jiang , Nima Mesgarani