English
Related papers

Related papers: Cosine-Normalized Attention for Hyperspectral Imag…

200 papers

Image restoration has witnessed significant advancements with the development of deep learning models. Transformer-based models, particularly those using window-based self-attention, have become a dominant force. However, their performance…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Gang Wu , Junjun Jiang , Kui Jiang , Xianming Liu , Liqiang Nie

The lack of proper class discrimination among the Hyperspectral (HS) data points poses a potential challenge in HS classification. To address this issue, this paper proposes an optimal geometry-aware transformation for enhancing the…

Machine Learning · Computer Science 2018-07-10 Ramanarayan Mohanty , S L Happy , Aurobinda Routray

This paper introduces new attention-based convolutional neural networks for selecting bands from hyperspectral images. The proposed approach re-uses convolutional activations at different depths, identifying the most informative regions of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Pablo Ribalta Lorenzo , Lukasz Tulczyjew , Michal Marcinkiewicz , Jakub Nalepa

With the development of the self-attention mechanism, the Transformer model has demonstrated its outstanding performance in the computer vision domain. However, the massive computation brought from the full attention mechanism became a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Hai Lan , Xihao Wang , Xian Wei

This paper introduces SS-MixNet, a lightweight and effective deep learning model for hyperspectral image (HSI) classification. The architecture integrates 3D convolutional layers for local spectral-spatial feature extraction with two…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Mohammed Q. Alkhatib

Sparse regression methods have been proven effective in a wide range of signal processing problems such as image compression, speech coding, channel equalization, linear regression and classification. In this paper a new convex method of…

Optimization and Control · Mathematics 2018-03-07 Victor Stefan Aldea

We describe an efficient hierarchical method to compute attention in the Transformer architecture. The proposed attention mechanism exploits a matrix structure similar to the Hierarchical Matrix (H-Matrix) developed by the numerical…

Machine Learning · Computer Science 2021-07-27 Zhenhai Zhu , Radu Soricut

Single Image Super-Resolution (SISR) reconstructs high-resolution images from low-resolution inputs, enhancing image details. While Vision Transformer (ViT)-based models improve SISR by capturing long-range dependencies, they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Junyoung Kim , Youngrok Kim , Siyeol Jung , Donghyun Min

Hyperspectral image(HSI) classification has been improved with convolutional neural network(CNN) in very recent years. Being different from the RGB datasets, different HSI datasets are generally captured by various remote sensors and have…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Haokui Zhang , Yu Liu , Bei Fang , Ying Li , Lingqiao Liu , Ian Reid

We introduce a generalized attention mechanism for spherical domains, enabling Transformer architectures to natively process data defined on the two-dimensional sphere - a critical need in fields such as atmospheric physics, cosmology, and…

Machine Learning · Computer Science 2025-05-19 Boris Bonev , Max Rietmann , Andrea Paris , Alberto Carpentieri , Thorsten Kurth

Transformers have recently shown promise for medical image applications, leading to an increasing interest in developing such models for medical image registration. Recent advancements in designing registration Transformers have focused on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Junyu Chen , Yihao Liu , Yufan He , Yong Du

Image inpainting has made significant advances in recent years. However, it is still challenging to recover corrupted images with both vivid textures and reasonable structures. Some specific methods only tackle regular textures while losing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Qiaole Dong , Chenjie Cao , Yanwei Fu

Saliency Prediction aims to predict the attention distribution of human eyes given an RGB image. Most of the recent state-of-the-art methods are based on deep image feature representations from traditional CNNs. However, the traditional…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Shuo Zhang

Learned image compression methods have exhibited superior rate-distortion performance than classical image compression standards. Most existing learned image compression models are based on Convolutional Neural Networks (CNNs). Despite…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Renjie Zou , Chunfeng Song , Zhaoxiang Zhang

In hyperspectral image (HSI) classification, spatial context has demonstrated its significance in achieving promising performance. However, conventional spatial context-based methods simply assume that spatially neighboring pixels should…

Machine Learning · Computer Science 2019-09-27 Sheng Wan , Chen Gong , Ping Zhong , Shirui Pan , Guangyu Li , Jian Yang

This paper presents a new supervised classification algorithm for remotely sensed hyperspectral image (HSI) which integrates spectral and spatial information in a unified Bayesian framework. First, we formulate the HSI classification…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Xiangyong Cao , Feng Zhou , Lin Xu , Deyu Meng , Zongben Xu , John Paisley

Recently, graph convolutional networks (GCNs) have been developed to explore spatial relationship between pixels, achieving better classification performance of hyperspectral images (HSIs). However, these methods fail to sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jin-Yu Yang , Heng-Chao Li , Wen-Shuai Hu , Lei Pan , Qian Du

Deep Convolutional Neural Network (CNN) features have been demonstrated to be effective perceptual quality features. The perceptual loss, based on feature maps of pre-trained CNN's has proven to be remarkably effective for CNN based…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Taimoor Tariq , Juan Luis Gonzalez , Munchurl Kim

Transformers have been successfully used in various fields and are becoming the standard tools in computer vision. However, self-attention, a core component of transformers, has a quadratic complexity problem, which limits the use of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Jiuk Hong , Chaehyeon Lee , Soyoun Bang , Heechul Jung

Compressive sensing (CS) reconstructs images from sub-Nyquist measurements by solving a sparsity-regularized inverse problem. Traditional CS solvers use iterative optimizers with hand crafted sparsifiers, while early data-driven methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Pamuditha Somarathne , Tharindu Wickremasinghe , Amashi Niwarthana , A. Thieshanthan , Chamira U. S. Edussooriya , Dushan N. Wadduwage