English
Related papers

Related papers: Efficient Image Super-Resolution Using Pixel Atten…

200 papers

Convolutional Neural Networks (CNNs) are important for many machine learning tasks. They are built with different types of layers: convolutional layers that detect features, dropout layers that help to avoid over-reliance on any single…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Rinor Cakaj , Jens Mehnert , Bin Yang

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

In recent years, the use of large convolutional kernels has become popular in designing convolutional neural networks due to their ability to capture long-range dependencies and provide large receptive fields. However, the increase in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Gang Wu , Junjun Jiang , Yuanchao Bai , Xianming Liu

Positron emission tomography (PET) suffers from severe resolution limitations which limit its quantitative accuracy. In this paper, we present a super-resolution (SR) imaging technique for PET based on convolutional neural networks (CNNs).…

Image and Video Processing · Electrical Eng. & Systems 2021-07-29 Tzu-An Song , Samadrita Roy Chowdhury , Fan Yang , Joyita Dutta

In recent years, the long-range attention mechanism of vision transformers has driven significant performance breakthroughs across various computer vision tasks. However, the traditional self-attention mechanism, which processes both…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Tianyi Zhang , Baoxin Li , Jae-sun Seo , Yu Cao

Self-attention networks have shown remarkable progress in computer vision tasks such as image classification. The main benefit of the self-attention mechanism is the ability to capture long-range feature interactions in attention-maps.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Andong Tan , Duc Tam Nguyen , Maximilian Dax , Matthias Nießner , Thomas Brox

Self-attention has the promise of improving computer vision systems due to parameter-independent scaling of receptive fields and content-dependent interactions, in contrast to parameter-dependent scaling and content-independent interactions…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ashish Vaswani , Prajit Ramachandran , Aravind Srinivas , Niki Parmar , Blake Hechtman , Jonathon Shlens

This paper presents a methodology for image classification using Graph Neural Network (GNN) models. We transform the input images into region adjacency graphs (RAGs), in which regions are superpixels and edges connect neighboring…

Machine Learning · Computer Science 2020-11-17 Pedro H. C. Avelar , Anderson R. Tavares , Thiago L. T. da Silveira , Cláudio R. Jung , Luís C. Lamb

Self-attention networks (SANs) have drawn increasing interest due to their high parallelization in computation and flexibility in modeling dependencies. SANs can be further enhanced with multi-head attention by allowing the model to attend…

Computation and Language · Computer Science 2019-04-08 Baosong Yang , Longyue Wang , Derek Wong , Lidia S. Chao , Zhaopeng Tu

Convolutions are the fundamental building block of CNNs. The fact that their weights are spatially shared is one of the main reasons for their widespread use, but it also is a major limitation, as it makes convolutions content agnostic. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Hang Su , Varun Jampani , Deqing Sun , Orazio Gallo , Erik Learned-Miller , Jan Kautz

Fine-grained visual recognition typically depends on modeling subtle difference from object parts. However, these parts often exhibit dramatic visual variations such as occlusions, viewpoints, and spatial transformations, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Lin Wu , Yang Wang

Recent years have seen significant developments in the field of License Plate Recognition (LPR) through the integration of deep learning techniques and the increasing availability of training data. Nevertheless, reconstructing license…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Valfride Nascimento , Rayson Laroca , Jorge de A. Lambert , William Robson Schwartz , David Menotti

Hyperspectral image (HSI) classification faces critical challenges, including high spectral dimensionality, complex spectral-spatial correlations, and limited training samples with severe class imbalance. While CNNs excel at local feature…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Asmit Bandyopadhyay , Anindita Das Bhattacharjee , Rakesh Das

Image restoration is a long-standing task that seeks to recover the latent sharp image from its deteriorated counterpart. Due to the robust capacity of self-attention to capture long-range dependencies, transformer-based methods or some…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Fangwei Hao , Jiesheng Wu , Ji Du , Yinjie Wang , Jing Xu

Convolution exploits locality for efficiency at a cost of missing long range context. Self-attention has been adopted to augment CNNs with non-local interactions. Recent works prove it possible to stack self-attention layers to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Huiyu Wang , Yukun Zhu , Bradley Green , Hartwig Adam , Alan Yuille , Liang-Chieh Chen

Informative features play a crucial role in the single image super-resolution task. Channel attention has been demonstrated to be effective for preserving information-rich features in each layer. However, channel attention treats each…

Image and Video Processing · Electrical Eng. & Systems 2020-08-21 Ben Niu , Weilei Wen , Wenqi Ren , Xiangde Zhang , Lianping Yang , Shuzhen Wang , Kaihao Zhang , Xiaochun Cao , Haifeng Shen

Recent work has shown that self-attention can serve as a basic building block for image recognition models. We explore variations of self-attention and assess their effectiveness for image recognition. We consider two forms of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Hengshuang Zhao , Jiaya Jia , Vladlen Koltun

Accurate medical image segmentation is essential for diagnosis and treatment planning of diseases. Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance for automatic medical image segmentation. However, they are…

Image and Video Processing · Electrical Eng. & Systems 2020-11-05 Ran Gu , Guotai Wang , Tao Song , Rui Huang , Michael Aertsen , Jan Deprest , Sébastien Ourselin , Tom Vercauteren , Shaoting Zhang

We propose a simple yet effective model for Single Image Super-Resolution (SISR), by combining the merits of Residual Learning and Convolutional Sparse Coding (RL-CSC). Our model is inspired by the Learned Iterative Shrinkage-Threshold…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Menglei Zhang , Zhou Liu , Lei Yu

We propose an end-to-end-trainable attention module for convolutional neural network (CNN) architectures built for image classification. The module takes as input the 2D feature vector maps which form the intermediate representations of the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Saumya Jetley , Nicholas A. Lord , Namhoon Lee , Philip H. S. Torr