English
Related papers

Related papers: Cosine-Normalized Attention for Hyperspectral Imag…

200 papers

The classification of gigapixel histopathology images with deep multiple instance learning models has become a critical task in digital pathology and precision medicine. In this work, we propose a Transformer-based multiple instance…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Josef Cersovsky , Sadegh Mohammadi , Dagmar Kainmueller , Johannes Hoehne

Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces noisy probability distribution, which can impair effective…

Computation and Language · Computer Science 2025-11-11 Dhananjay Ram , Wei Xia , Stefano Soatto

Transformer architecture has been showing its great strength in visual object tracking, for its effective attention mechanism. Existing transformer-based approaches adopt the pixel-to-pixel attention strategy on flattened image features and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zikai Song , Junqing Yu , Yi-Ping Phoebe Chen , Wei Yang

Hyperspectral images (HSI) not only have a broad macroscopic field of view but also contain rich spectral information, and the types of surface objects can be identified through spectral information, which is one of the main applications in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Sen Jia , Yifan Wang

Convolutional Neural Networks (CNN) are more suitable, indeed. However, fixed kernel sizes make traditional CNN too specific, neither flexible nor conducive to feature learning, thus impacting on the classification accuracy. The convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Muhammad Ahmad , Adil Mehmood Khan , Manuel Mazzara , Salvatore Distefano , Swalpa Kumar Roy , Xin Wu

Fine-grained object recognition concerns the identification of the type of an object among a large number of closely related sub-categories. Multisource data analysis, that aims to leverage the complementary spectral, spatial, and…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Gencer Sumbul , Ramazan Gokberk Cinbis , Selim Aksoy

In the hyperspectral image classification (HSIC) task, the most commonly used model validation paradigm is partitioning the training-test dataset through pixel-wise random sampling. By training on a small amount of data, the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Enzhe Zhao , Zhichang Guo , Shengzhu Shi , Yao Li , Jia Li , Dazhi Zhang

Classifying hyperspectral images is a difficult task in remote sensing, due to their complex high-dimensional data. To address this challenge, we propose HSIMamba, a novel framework that uses bidirectional reversed convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Judy X Yang , Jun Zhou , Jing Wang , Hui Tian , Alan Wee Chung Liew

Transformer models have achieved remarkable results in a wide range of applications. However, their scalability is hampered by the quadratic time and memory complexity of the self-attention mechanism concerning the sequence length. This…

Machine Learning · Computer Science 2024-02-27 Yury Nahshan , Joseph Kampeas , Emir Haleva

Hyperspectral image (HSI) reconstruction aims to recover the 3D spatial-spectral signal from a 2D measurement in the coded aperture snapshot spectral imaging (CASSI) system. The HSI representations are highly similar and correlated across…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Yuanhao Cai , Jing Lin , Xiaowan Hu , Haoqian Wang , Xin Yuan , Yulun Zhang , Radu Timofte , Luc Van Gool

We formulate an attention mechanism for continuous and ordered sequences that explicitly functions as an alignment model, which serves as the core of many sequence-to-sequence tasks. Standard scaled dot-product attention relies on…

Machine Learning · Computer Science 2025-09-19 Hyungjoon Soh , Junghyo Jo

Transformer now underpins modern AI as its core infrastructure. Its defining capability-dynamically focusing on the most relevant information in complex inputs-is bounded above by the self-attention scoring function. Quantum computing, with…

Quantum Physics · Physics 2026-05-26 Wenwei Zhang , Jintao Wang , Tianyu Ye , Changgeng Liao

We propose the use of a Transformer to accurately predict normals from point clouds with noise and density variations. Previous learning-based methods utilize PointNet variants to explicitly extract multi-scale features at different input…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Barry Shichen Hu , Siyun Liang , Johannes Paetzold , Huy H. Nguyen , Isao Echizen , Jiapeng Tang

Homography estimation is a basic computer vision task, which aims to obtain the transformation from multi-view images for image alignment. Unsupervised learning homography estimation trains a convolution neural network for feature…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Mingxiao Huo , Zhihao Zhang , Xinyang Ren , Xianqiang Yang

Hyperspectral image (HSI) denoising is critical for the effective analysis and interpretation of hyperspectral data. However, simultaneously modeling global and local features is rarely explored to enhance HSI denoising. In this letter, we…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Shuai Hu , Feng Gao , Xiaowei Zhou , Junyu Dong , Qian Du

Deep convolutional neural networks can use hierarchical information to progressively extract structural information to recover high-quality images. However, preserving the effectiveness of the obtained structural information is important in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Chunwei Tian , Chengyuan Zhang , Bob Zhang , Zhiwu Li , C. L. Philip Chen , David Zhang

Weakly supervised semantic segmentation (WSSS) with only image-level supervision is a challenging task. Most existing methods exploit Class Activation Maps (CAM) to generate pixel-level pseudo labels for supervised training. However, due to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ruiwen Li , Zheda Mai , Chiheb Trabelsi , Zhibo Zhang , Jongseong Jang , Scott Sanner

In this paper, we propose an unified hyperspectral image classification method which takes three-dimensional hyperspectral data cube as an input and produces a classification map. In the proposed method, a deep neural network which uses…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Berkan Demirel , Omer Ozdil , Yunus Emre Esin , Safak Ozturk

Transformers-based methods have achieved significant performance in image deraining as they can model the non-local information which is vital for high-quality image reconstruction. In this paper, we find that most existing Transformers…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Xiang Chen , Hao Li , Mingqiang Li , Jinshan Pan

In a globalized world at the present epoch of generative intelligence, most of the manual labour tasks are automated with increased efficiency. This can support businesses to save time and money. A crucial component of generative…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Pranav Dandwate , Chaitanya Shahane , Vandana Jagtap , Shridevi C. Karande