English
Related papers

Related papers: VP-Hype: A Hybrid Mamba-Transformer Framework with…

200 papers

Recently, Mamba-based methods, with its advantage in long-range information modeling and linear complexity, have shown great potential in optimizing both computational cost and performance of light field image super-resolution (LFSR).…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Haosong Liu , Xiancheng Zhu , Huanqiang Zeng , Jianqing Zhu , Jiuwen Cao , Junhui Hou

Transformers bring significantly improved performance to the light field image super-resolution task due to their long-range dependency modeling capability. However, the inherently high computational complexity of their core self-attention…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Zeqiang Wei , Kai Jin , Zeyi Hou , Kuan Song , Xiuzhuang Zhou

Visual attention modeling, important for interpreting and prioritizing visual stimuli, plays a significant role in applications such as marketing, multimedia, and robotics. Traditional saliency prediction models, especially those based on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Alireza Hosseini , Amirhossein Kazerouni , Saeed Akhavan , Michael Brudno , Babak Taati

Multimodal large language models (MLLMs) have attracted widespread interest and have rich applications. However, the inherent attention mechanism in its Transformer structure requires quadratic complexity and results in expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yanyuan Qiao , Zheng Yu , Longteng Guo , Sihan Chen , Zijia Zhao , Mingzhen Sun , Qi Wu , Jing Liu

Previous research on lightweight models has primarily focused on CNNs and Transformer-based designs. CNNs, with their local receptive fields, struggle to capture long-range dependencies, while Transformers, despite their global modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Haoyang He , Jiangning Zhang , Yuxuan Cai , Hongxu Chen , Xiaobin Hu , Zhenye Gan , Yabiao Wang , Chengjie Wang , Yunsheng Wu , Lei Xie

In recent years, State Space Models (SSMs) with efficient hardware-aware designs, known as the Mamba deep learning models, have made significant progress in modeling long sequences such as language understanding. Therefore, building…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Juntao Zhang , Shaogeng Liu , Jun Zhou , Kun Bian , You Zhou , Jianning Liu , Pei Zhang , Bingyan Liu

Background: High-resolution MRI is critical for diagnosis, but long acquisition times limit clinical use. Super-resolution (SR) can enhance resolution post-scan, yet existing deep learning methods face fidelity-efficiency trade-offs.…

Meta-learning facilitates few-shot hyperspectral target detection (HTD), but adapting deep backbones remains challenging. Full-parameter fine-tuning is inefficient and prone to overfitting, and existing methods largely ignore the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Luqi Gong , Qixin Xie , Yue Chen , Ziqiang Chen , Fanda Fan , Shuai Zhao , Chao Li

Transformer-based segmentation methods face the challenge of efficient inference when dealing with high-resolution images. Recently, several linear attention architectures, such as Mamba and RWKV, have attracted much attention as they can…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Haobo Yuan , Xiangtai Li , Lu Qi , Tao Zhang , Ming-Hsuan Yang , Shuicheng Yan , Chen Change Loy

Hyperspectral image (HSI) classification (HSIC) requires effective modeling of complex spatial-spectral dependencies under limited labeled data and high dimensionality. While transformer-based models have shown strong capability in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Muhammad Ahmad

Self-supervised video hashing (SSVH) is a practical task in video indexing and retrieval. Although Transformers are predominant in SSVH for their impressive temporal modeling capabilities, they often suffer from computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jinpeng Wang , Niu Lian , Jun Li , Yuting Wang , Yan Feng , Bin Chen , Yongbing Zhang , Shu-Tao Xia

As data requirements continue to grow, efficient learning increasingly depends on the curation and distillation of high-value data rather than brute-force scaling of model sizes. In the case of a hyperspectral image (HSI), the challenge is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Abhiroop Chatterjee , Susmita Ghosh

Snapshot Compressive Imaging (SCI) enables fast spectral imaging but requires effective decoding algorithms for hyperspectral image (HSI) reconstruction from compressed measurements. Current CNN-based methods are limited in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenzhe Tian , Haijin Zeng , Yin-Ping Zhao , Yongyong Chen , Zhen Wang , Xuelong Li

Single hyperspectral image super-resolution (SHSR) aims to restore high-resolution images from low-resolution hyperspectral images. Recently, the Visual Mamba model has achieved an impressive balance between performance and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Baisong Li , Xingwang Wang , Haixiao Xu

State-of-the-art transformer-based large multimodal models (LMMs) struggle to handle hour-long video inputs due to the quadratic complexity of the causal self-attention operations, leading to high computational costs during training and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Weiming Ren , Wentao Ma , Huan Yang , Cong Wei , Ge Zhang , Wenhu Chen

Hyperspectral target detection (HTD) identifies objects of interest from complex backgrounds at the pixel level, playing a vital role in Earth observation. However, HTD faces challenges due to limited prior knowledge and spectral variation,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Dunbin Shen , Xuanbing Zhu , Jiacheng Tian , Jianjun Liu , Zhenrong Du , Hongyu Wang , Xiaorui Ma

Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes. While transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 A. Enes Doruk , Hasan F. Ates

Reconstructing high-fidelity MR images from undersampled k-space data remains a challenging problem in MRI. While Mamba variants for vision tasks offer promising long-range modeling capabilities with linear-time complexity, their direct…

Image and Video Processing · Electrical Eng. & Systems 2026-05-05 Hongli Chen , Pengcheng Fang , Yuxia Chen , Yingxuan Ren , Jing Hao , Fangfang Tang , Xiaohao Cai , Shanshan Shan , Feng Liu

Despite the significant achievements of Vision Transformers (ViTs) in various vision tasks, they are constrained by the quadratic complexity. Recently, State Space Models (SSMs) have garnered widespread attention due to their global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Yuheng Shi , Minjing Dong , Chang Xu

Recent advances in Vision Transformers (ViTs) and State Space Models (SSMs) have challenged the dominance of Convolutional Neural Networks (CNNs) in computer vision. ViTs excel at capturing global context, and SSMs like Mamba offer linear…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mustafa Munir , Alex Zhang , Radu Marculescu