English
Related papers

Related papers: Vision Transformer with Key-select Routing Attenti…

200 papers

Recently, deep learning has attracted more and more attention in phase unwrapping of fringe projection three-dimensional (3D) measurement, with the aim to improve the performance leveraging the powerful Convolutional Neural Network (CNN)…

Image and Video Processing · Electrical Eng. & Systems 2022-11-23 Xinjun Zhu , Zhiqiang Han , Mengkai Yuan , Qinghua Guo , Hongyi Wang

This paper investigates a Terahertz (THz)-enabled mobile edge computing (MEC)-assisted virtual reality (VR) system using reconfigurable holographic surfaces (RHS) as transceiver for multi-user beamforming and holographic-pattern division…

Information Theory · Computer Science 2026-03-03 Liangshun Wu , Wen Chen , Honghao Wang , Zhendong Li , Ying Wang

Due to the computational complexity of self-attention (SA), prevalent techniques for image deblurring often resort to either adopting localized SA or employing coarse-grained global SA methods, both of which exhibit drawbacks such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Xintian Mao , Jiansheng Wang , Xingran Xie , Qingli Li , Yan Wang

Pan-sharpening aims at producing a high-resolution (HR) multi-spectral (MS) image from a low-resolution (LR) multi-spectral (MS) image and its corresponding panchromatic (PAN) image acquired by a same satellite. Inspired by a new fashion in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Huanyu Zhou , Qingjie Liu , Yunhong Wang

Recently, Mamba-based super-resolution (SR) methods have demonstrated the ability to capture global receptive fields with linear complexity, addressing the quadratic computational cost of Transformer-based SR approaches. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Sichen Guo , Wenjie Li , Yuanyang Liu , Guangwei Gao , Jian Yang , Chia-Wen Lin

How to identify and segment camouflaged objects from the background is challenging. Inspired by the multi-head self-attention in Transformers, we present a simple masked separable attention (MSA) for camouflaged object detection. We first…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Bowen Yin , Xuying Zhang , Qibin Hou , Bo-Yuan Sun , Deng-Ping Fan , Luc Van Gool

Transformers have been successfully used in various fields and are becoming the standard tools in computer vision. However, self-attention, a core component of transformers, has a quadratic complexity problem, which limits the use of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Jiuk Hong , Chaehyeon Lee , Soyoun Bang , Heechul Jung

Transformer-based methods have demonstrated excellent performance on super-resolution visual tasks, surpassing conventional convolutional neural networks. However, existing work typically restricts self-attention computation to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shu-Chuan Chu , Zhi-Chao Dou , Jeng-Shyang Pan , Shaowei Weng , Junbao Li

Face Recognition Systems (FRS) are critical for security but remain vulnerable to morphing attacks, where synthetic images blend biometric features from multiple individuals. We propose a novel Single-Image Morphing Attack Detection (S-MAD)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ria Shekhawat , Sushrut Patwardhan , Raghavendra Ramachandra , Praveen Kumar Chandaliya , Kishor P. Upla

Haze degrades content and obscures information of images, which can negatively impact vision-based decision-making in real-time systems. In this paper, we propose an efficient fully convolutional neural network (CNN) image dehazing method…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Peter Morales , Tzofi Klinghoffer , Seung Jae Lee

Medical image recognition serves as a key way to aid in clinical diagnosis, enabling more accurate and timely identification of diseases and abnormalities. Vision transformer-based approaches have proven effective in handling various…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zunhui Xia , Hongxing Li , Libin Lan

Hyperspectral imaging (HSI) provides rich spectral-spatial information across hundreds of contiguous bands, enabling precise material discrimination in applications such as environmental monitoring, agriculture, and urban analysis. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Saad Sohail , Muhammad Usama , Usman Ghous , Manuel Mazzara , Salvatore Distefano , Muhammad Ahmad

Identifying robust and accurate correspondences across images is a fundamental problem in computer vision that enables various downstream tasks. Recent semi-dense matching methods emphasize the effectiveness of fusing relevant cross-view…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Hongkai Chen , Zixin Luo , Yurun Tian , Xuyang Bai , Ziyu Wang , Lei Zhou , Mingmin Zhen , Tian Fang , David McKinnon , Yanghai Tsin , Long Quan

We propose Frequency-Guided Attention (FGA), a lightweight upsampling module for single image super-resolution. Conventional upsamplers, such as Sub-Pixel Convolution, are efficient but frequently fail to reconstruct high-frequency details…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Daejune Choi , Youchan No , Jinhyung Lee , Duksu Kim

Auto-regressive inference of transformers benefit greatly from Key-Value (KV) caching, but can lead to major memory bottlenecks as model size, batch size, and sequence length grow at scale. We introduce Multi-Layer Key-Value (MLKV) sharing,…

Machine Learning · Computer Science 2024-10-16 Zayd Muhammad Kawakibi Zuhri , Muhammad Farid Adilazuarda , Ayu Purwarianti , Alham Fikri Aji

Transformers offer strong global modeling for single-image dehazing but come with high computational costs. Most methods rely on spatial features to capture long-range dependencies, making them less effective under complex haze conditions.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Lirong Zheng , Yanshan Li , Rui Yu , Kaihao Zhang

Dynamic metasurface antennas (DMAs) beamform through low-powered components that enable reconfiguration of each radiating element. Previous research on a single-user multiple-input-single-output (MISO) system with a dynamic metasurface…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Nitish Vikas Deshpande , Joseph Carlson , Miguel R. Castellanos , Robert W. Heath

Self-attention is central to the success of Transformer architectures; however, learning the query, key, and value projections from random initialization remains challenging and computationally expensive. In this paper, we propose two…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Hongyi Pan , Emadeldeen Hamdan , Xin Zhu , Ahmet Enis Cetin , Ulas Bagci

Transformer models have recently garnered significant attention in image restoration due to their ability to capture long-range pixel dependencies. However, long-range attention often results in computational overhead without practical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qifan Li , Tianyi Liang , Xingtao Wang , Xiaopeng Fan

Handwritten Mathematical Expression Recognition (HMER) methods have made remarkable progress, with most existing HMER approaches based on either a hybrid CNN/RNN-based with GRU architecture or Transformer architectures. Each of these has…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Kehua Chen , Haoyang Shen , Lifan Zhong , Mingyi Chen