English
Related papers

Related papers: CSAKD: Knowledge Distillation with Cross Self-Atte…

200 papers

With the rapid development of deep learning (DL) in recent years, automatic modulation recognition (AMR) with DL has achieved high accuracy. However, insufficient training signal data in complicated channel environments and large-scale DL…

Machine Learning · Computer Science 2024-01-01 Dongbin Hou , Lixin Li , Wensheng Lin , Junli Liang , Zhu Han

This work revisits coupled tensor decomposition (CTD)-based hyperspectral super-resolution (HSR). HSR aims at fusing a pair of hyperspectral and multispectral images to recover a super-resolution image (SRI). The vast majority of the HSR…

Signal Processing · Electrical Eng. & Systems 2021-04-21 Meng Ding , Xiao Fu , Ting-Zhu Huang , Jun Wang , Xi-Le Zhao

Unregistered hyperspectral image (HSI) super-resolution (SR) typically aims to enhance a low-resolution HSI using an unregistered high-resolution reference image. In this paper, we propose an unmixing-based fusion framework that decouples…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yingkai Zhang , Tao Zhang , Jing Nie , Ying Fu

In recent years, the performance of lightweight Single-Image Super-Resolution (SISR) has been improved significantly with the application of Convolutional Neural Networks (CNNs) and Large Kernel Attention (LKA). However, existing…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Fangwei Hao , Ji Du , Desheng Kong , Jiesheng Wu , Jing Xu , Ping Li

Blind image super-resolution (Blind-SR) aims to recover a high-resolution (HR) image from its corresponding low-resolution (LR) input image with unknown degradations. Most of the existing works design an explicit degradation estimator for…

Image and Video Processing · Electrical Eng. & Systems 2023-02-17 Bin Xia , Yulun Zhang , Yitong Wang , Yapeng Tian , Wenming Yang , Radu Timofte , Luc Van Gool

Due to limitations in data quality, some essential visual tasks are difficult to perform independently. Introducing previously unavailable information to transfer informative dark knowledge has been a common way to solve such hard tasks.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Lingyu Si , Hongwei Dong , Wenwen Qiang , Junzhi Yu , Wenlong Zhai , Changwen Zheng , Fanjiang Xu , Fuchun Sun

In instance-level detection tasks (e.g., object detection), reducing input resolution is an easy option to improve runtime efficiency. However, this option traditionally hurts the detection performance much. This paper focuses on boosting…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Lu Qi , Jason Kuen , Jiuxiang Gu , Zhe Lin , Yi Wang , Yukang Chen , Yanwei Li , Jiaya Jia

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Muhammad Ahmad , Manuel Mazzara , Salvatore Distifano

Hyperspectral pansharpening aims to synthesize a low-resolution hyperspectral image (LR-HSI) with a registered panchromatic image (PAN) to generate an enhanced HSI with high spectral and spatial resolution. Recently proposed HS…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Wele Gedara Chaminda Bandara , Jeya Maria Jose Valanarasu , Vishal M. Patel

Obtaining high-resolution hyperspectral images (HR-HSI) is costly and data-intensive, making it necessary to fuse low-resolution hyperspectral images (LR-HSI) with high-resolution RGB images (HR-RGB) for practical applications. However,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-25 Lei Guo , Wei Chen , Yuxuan Sun , Bo Ai , Nikolaos Pappas , Tony Quek

Large language models (LLMs) achieve state-of-the-art (SOTA) performance across language tasks, but are costly to deploy due to their size and resource demands. Knowledge Distillation (KD) addresses this by training smaller Student models…

Computation and Language · Computer Science 2026-05-19 Stella Eva Tsiapali , Cong-Thanh Do , Kate Knill

Enormous efforts have been recently made to super-resolve hyperspectral (HS) images with the aid of high spatial resolution multispectral (MS) images. Most prior works usually perform the fusion task by means of multifarious pixel-level…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Danfeng Hong , Jing Yao , Deyu Meng , Naoto Yokoya , Jocelyn Chanussot

Knowledge Distillation (KD) has emerged as a promising technique for model compression but faces critical limitations: (1) sensitivity to hyperparameters requiring extensive manual tuning, (2) capacity gap when distilling from very large…

Machine Learning · Computer Science 2025-12-11 Gustavo Coelho Haase , Paulo Henrique Dourado da Silva

The rapid development of deep learning provides a better solution for the end-to-end reconstruction of hyperspectral image (HSI). However, existing learning-based methods have two major defects. Firstly, networks with self-attention usually…

Image and Video Processing · Electrical Eng. & Systems 2022-06-17 Xiaowan Hu , Yuanhao Cai , Jing Lin , Haoqian Wang , Xin Yuan , Yulun Zhang , Radu Timofte , Luc Van Gool

Hyperspectral and multispectral image fusion aims to generate high spectral and spatial resolution hyperspectral images (HR-HSI) by fusing high-resolution multispectral images (HR-MSI) and low-resolution hyperspectral images (LR-HSI).…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 He Wang , Yang Xu , Zebin Wu , Zhihui Wei

Skin cancer is one of the most common types of malignancy, affecting a large population and causing a heavy economic burden worldwide. Over the last few years, computer-aided diagnosis has been rapidly developed and make great progress in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Yongwei Wang , Yuheng Wang , Tim K. Lee , Chunyan Miao , Z. Jane Wang

Hyperspectral images (HSI) with abundant spectral information reflected materials property usually perform low spatial resolution due to the hardware limits. Meanwhile, multispectral images (MSI), e.g., RGB images, have a high spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Shuaikai Shi , Lijun Zhang , Yoann Altmann , Jie Chen

To overcome inherent hardware limitations of hyperspectral imaging systems with respect to their spatial resolution, fusion-based hyperspectral image (HSI) super-resolution is attracting increasing attention. This technique aims to fuse a…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Xiuheng Wang , Jie Chen , Cédric Richard

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shashank Mishra , Karan Patil , Didier Stricker , Jason Rambach

Deep learning has shown promise in enhancing channel state information (CSI) feedback. However, many studies indicate that better feedback performance often accompanies higher computational complexity. Pursuing better performance-complexity…

Signal Processing · Electrical Eng. & Systems 2024-03-05 Yiming Cui , Jiajia Guo , Zheng Cao , Huaze Tang , Chao-Kai Wen , Shi Jin , Xin Wang , Xiaolin Hou