English
Related papers

Related papers: High-Similarity-Pass Attention for Single Image Su…

200 papers

Hyperspectral images super-resolution aims to improve the spatial resolution, yet its performance is often limited at high-resolution ratios. The recent adoption of high-resolution reference images for super-resolution is driven by the poor…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yingkai Zhang , Zeqiang Lai , Tao Zhang , Ying Fu , Chenghu Zhou

Recently, lightweight methods for single image super-resolution (SISR) have gained significant popularity and achieved impressive performance due to limited hardware resources. These methods demonstrate that adopting residual feature…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Weifeng Cao , Xiaoyan Lei , Jun Shi , Wanyong Liang , Jie Liu , Zongfei Bai

The attention mechanism is an important reason for the success of transformers. It relies on computing pairwise relations between tokens. To reduce the high computational cost of standard quadratic attention, linear attention has been…

Artificial Intelligence · Computer Science 2026-02-13 Hanno Ackermann , Hong Cai , Mohsen Ghafoorian , Amirhossein Habibian

We present a novel framework, Spatial Pyramid Attention Network (SPAN) for detection and localization of multiple types of image manipulations. The proposed architecture efficiently and effectively models the relationship between image…

Computer Vision and Pattern Recognition · Computer Science 2021-01-15 Xuefeng Hu , Zhihan Zhang , Zhenye Jiang , Syomantak Chaudhuri , Zhenheng Yang , Ram Nevatia

Hyperspectral images (HSIs) have been widely used in a variety of applications thanks to the rich spectral information they are able to provide. Among all HSI processing tasks, HSI denoising is a crucial step. Recently, deep learning-based…

Image and Video Processing · Electrical Eng. & Systems 2022-02-16 Zhiqiang Wang , Zhenfeng Shao , Xiao Huang , Jiaming Wang , Tao Lu , Sihang Zhang

Whole slide images (WSIs) pose fundamental computational challenges due to their gigapixel resolution and the sparse distribution of informative regions. Existing approaches often treat image patches independently or reshape them in ways…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Weiyi Wu , Xingjian Diao , Chunhui Zhang , Chongyang Gao , Xinwen Xu , Siting Li , Jiang Gui

Recently, deep convolutional neural networks (CNNs) have been widely explored in single image super-resolution (SISR) and contribute remarkable progress. However, most of the existing CNNs-based SISR methods do not adequately explore…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Jiqing Zhang , Chengjiang Long , Yuxin Wang , Haiyin Piao , Haiyang Mei , Xin Yang , Baocai Yin

The performance of deep learning models in remote sensing (RS) strongly depends on the availability of high-quality labeled data. However, collecting large-scale annotations is costly and time-consuming, while vast amounts of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Wei Huang , Zhitong Xiong , Chenying Liu , Xiao Xiang Zhu

The prevalence of employing attention mechanisms has brought along concerns on the interpretability of attention distributions. Although it provides insights about how a model is operating, utilizing attention as the explanation of model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Tristan Gomez , Suiyi Ling , Thomas Fréour , Harold Mouchère

A key advantage of Recurrent Neural Networks (RNNs) over Transformers is their linear computational and space complexity enables faster training and inference for long sequences. However, RNNs are fundamentally unable to randomly access…

Computation and Language · Computer Science 2025-11-04 Xiang Hu , Jiaqi Leng , Jun Zhao , Kewei Tu , Wei Wu

Attention mechanisms have become of crucial importance in deep learning in recent years. These non-local operations, which are similar to traditional patch-based methods in image processing, complement local convolutions. However, computing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Nicolas Cherel , Andrés Almansa , Yann Gousseau , Alasdair Newson

Pan-sharpening is a process of merging a high-resolution (HR) panchromatic (PAN) image and its corresponding low-resolution (LR) multi-spectral (MS) image to create an HR-MS and pan-sharpened image. However, due to the different sensors'…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Jaehyup Lee , Soomin Seo , Munchurl Kim

Pixel-wise regression is probably the most common problem in fine-grained computer vision tasks, such as estimating keypoint heatmaps and segmentation masks. These regression problems are very challenging particularly because they require,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Huajun Liu , Fuqiang Liu , Xinyi Fan , Dong Huang

Token-level sparse attention mechanisms, exemplified by DeepSeek Sparse Attention (DSA), achieve fine-grained key selection by scoring every historical key for each query through a lightweight indexer, then computing attention only on the…

The quadratic cost of attention limits the scalability of long-context LLMs, especially under limited hardware memory budgets. While attention is often sparse, existing static sparse methods cannot adapt to task- or input-dependent…

Computation and Language · Computer Science 2026-05-29 Siheng Xiong , Joe Zou , Faramarz Fekri , Yae Jee Cho

Labeling medical images depends on professional knowledge, making it difficult to acquire large amount of annotated medical images with high quality in a short time. Thus, making good use of limited labeled samples in a small dataset to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Peng Jiang , Juan Liu , Lang Wang , Zhihui Ynag , Hongyu Dong , Jing Feng

Insufficient prior knowledge of a captured hyperspectral image (HSI) scene may lead the experts or the automatic labeling systems to offer incorrect labels or ambiguous labels (i.e., assigning each training sample to a group of candidate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Shujun Yang , Yu Zhang , Yao Ding , Danfeng Hong

In remote sensing applications, such as disaster detection and response, real-time efficiency and model lightweighting are of critical importance. Consequently, existing remote sensing image super-resolution methods often face a trade-off…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yi Liu , Yi Wan , Xinyi Liu , Qiong Wu , Panwang Xia , Xuejun Huang , Yongjun Zhang

The use of Deep Learning techniques for classification in Hyperspectral Imaging (HSI) is rapidly growing and achieving improved performances. Due to the nature of the data captured by sensors that produce HSI images, a common issue is the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Aryan Vats , Manan Suri

Non-local self-similarity in natural images has been well studied as an effective prior in image restoration. However, for single image super-resolution (SISR), most existing deep non-local methods (e.g., non-local neural networks) only…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Shangchen Zhou , Jiawei Zhang , Wangmeng Zuo , Chen Change Loy