English
Related papers

Related papers: Spatial-Spectral Transformer for Hyperspectral Ima…

200 papers

Modern Convolutional Neural Networks (CNN) are extremely powerful on a range of computer vision tasks. However, their performance may degrade when the data is characterised by large intra-class variability caused by spatial transformations.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Roberto Annunziata , Christos Sagonas , Jacques Calì

The use of Deep Learning techniques for classification in Hyperspectral Imaging (HSI) is rapidly growing and achieving improved performances. Due to the nature of the data captured by sensors that produce HSI images, a common issue is the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Aryan Vats , Manan Suri

Hyperspectral imaging (HSI) has a wide range of applications from environmental monitoring to biotechnology. Current snapshot HSI techniques all require a trade-off between spatial and spectral resolution and are thus unable to achieve high…

Optics · Physics 2023-01-11 Yingwen Zhang , Duncan England , Benjamin Sussman

Spatial transcriptomics (ST) provides crucial insights into tissue micro-environments, but is limited to its high cost and complexity. As an alternative, predicting gene expression from pathology whole slide images (WSI) is gaining…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Mingcheng Qu , Yuncong Wu , Donglin Di , Yue Gao , Tonghua Su , Yang Song , Lei Fan

Tissue phenotyping is a fundamental task in learning objective characterizations of histopathologic biomarkers within the tumor-immune microenvironment in cancer pathology. However, whole-slide imaging (WSI) is a complex computer vision in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Richard J. Chen , Rahul G. Krishnan

In this paper, we tackle the high computational overhead of Transformers for efficient image super-resolution~(SR). Motivated by the observations of self-attention's inter-layer repetition, we introduce a convolutionized self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dongheon Lee , Seokju Yun , Youngmin Ro

Hyperspectral image (HSI) recovery, as an upstream image processing task, holds significant importance for downstream tasks such as classification, segmentation, and detection. In recent years, HSI recovery methods based on non-local prior…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhuoran Peng , Yiqing Shen

Since the number of incident energies is limited, it is difficult to directly acquire hyperspectral images (HSI) with high spatial resolution. Considering the high dimensionality and correlation of HSI, super-resolution (SR) of HSI remains…

Computer Vision and Pattern Recognition · Computer Science 2023-07-17 Tingting Liu , Yuan Liu , Chuncheng Zhang , Yuan Liyin , Xiubao Sui , Qian Chen

Transformer is a powerful tool for many natural language tasks which is based on self-attention, a mechanism that encodes the dependence of other tokens on each specific token, but the computation of self-attention is a bottleneck due to…

Machine Learning · Computer Science 2021-03-11 Madhusudan Verma

In the past, optimization-based registration models have used spatially-varying regularization to account for deformation variations in different image regions. However, deep learning-based registration models have mostly relied on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Junyu Chen , Yihao Liu , Yufan He , Yong Du

Transformers, with their self-attention mechanisms for modeling long-range dependencies, have become a dominant paradigm in image restoration tasks. However, the high computational cost of self-attention limits scalability to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Hanzhou Liu , Binghan Li , Chengkai Liu , Mi Lu

Transformer-based image restoration methods in adverse weather have achieved significant progress. Most of them use self-attention along the channel dimension or within spatially fixed-range blocks to reduce computational load. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Shangquan Sun , Wenqi Ren , Xinwei Gao , Rui Wang , Xiaochun Cao

Hyperspectral images are of crucial importance in order to better understand features of different materials. To reach this goal, they leverage on a high number of spectral bands. However, this interesting characteristic is often paid by a…

Image and Video Processing · Electrical Eng. & Systems 2020-06-01 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng , Tai-Xiang Jiang , Gemine Vivone , Jocelyn Chanussot

Semantic segmentation, which aims to classify every pixel in an image, is a key task in machine perception, with many applications across robotics and autonomous driving. Due to the high dimensionality of this task, most existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Alex Zihao Zhu , Jieru Mei , Siyuan Qiao , Hang Yan , Yukun Zhu , Liang-Chieh Chen , Henrik Kretzschmar

Though unsupervised domain adaptation (UDA) has achieved very impressive progress recently, it remains a great challenge due to missing target annotations and the rich discrepancy between source and target distributions. We propose Spectral…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jingyi Zhang , Jiaxing Huang , Zichen Tian , Shijian Lu

Recently, transformers have shown great potential in image classification and established state-of-the-art results on the ImageNet benchmark. However, compared to CNNs, transformers converge slowly and are prone to overfitting in low-data…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Yuxuan Zhou , Wangmeng Xiang , Chao Li , Biao Wang , Xihan Wei , Lei Zhang , Margret Keuper , Xiansheng Hua

X-ray Photoelectron Spectroscopy (XPS) is a crucial technique for material surface analysis, yet interpreting its spectra is often challenging for both human analysts and automated methods due to the prevalence of variable spectral shifts…

Materials Science · Physics 2026-03-06 Issa Saddiq , Yuxin Fan , Robert G. Palgrave , Mark A. Isaacs , David Morgan , Keith T. Butler

Learning from limited data is challenging because data scarcity leads to a poor generalization of the trained model. A classical global pooled representation will probably lose useful local information. Many few-shot learning methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Haoxing Chen , Huaxiong Li , Yaohui Li , Chunlin Chen

Removing the noise and improving the visual quality of hyperspectral images (HSIs) is challenging in academia and industry. Great efforts have been made to leverage local, global or spectral context information for HSI denoising. However,…

Image and Video Processing · Electrical Eng. & Systems 2023-04-20 Haodong Pan , Feng Gao , Junyu Dong , Qian Du

Transformer-based approaches have achieved superior performance in image restoration, since they can model long-term dependencies well. However, the limitation in capturing local information restricts their capacity to remove degradations.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shihao Zhou , Duosheng Chen , Jinshan Pan , Jufeng Yang