中文

HyperKD:通过逆域迁移实现掩码自编码器中跨光谱知识蒸馏

计算机视觉与模式识别 2025-08-14 v1 机器学习

摘要

基础模型的快速增长使其成为使用卫星观测数据构建可适应且可重用的架构的有效方法,这些架构可为各种下游任务提供支持。然而,其直接应用于高光谱遥感仍具有挑战,主要due to inherent spectral disparities and the scarcity of available observations。 In this work, we present HyperKD, a novel knowledge distillation framework that enables transferring learned representations from a teacher model into a student model for effective development of a foundation model on hyperspectral images. Unlike typical knowledge distillation frameworks, which use a complex teacher to guide a simpler student, HyperKD enables an inverse form of knowledge transfer across different types of spectral data, guided by a simpler teacher model. Building upon a Masked Autoencoder, HyperKD distills knowledge from the Prithvi foundational model into a student tailored for EnMAP hyperspectral imagery. HyperKD addresses the inverse domain adaptation problem with spectral gaps by introducing a feature-based strategy that includes spectral range-based channel alignment, spatial feature-guided masking, and an enhanced loss function tailored for hyperspectral images. HyperKD bridges the substantial spectral domain gap, enabling the effective use of pretrained foundation models for geospatial applications. Extensive experiments show that HyperKD significantly improves representation learning in MAEs, leading to enhanced reconstruction fidelity and more robust performance on downstream tasks such as land cover classification, crop type identification, and soil organic carbon prediction, underpinning the potential of knowledge distillation frameworks in remote sensing analytics with hyperspectral imagery.

关键词

引用

@article{arxiv.2508.09453,
  title  = {HyperKD: Distilling Cross-Spectral Knowledge in Masked Autoencoders via Inverse Domain Shift with Spatial-Aware Masking and Specialized Loss},
  author = {Abdul Matin and Tanjim Bin Faruk and Shrideep Pallickara and Sangmi Lee Pallickara},
  journal= {arXiv preprint arXiv:2508.09453},
  year   = {2025}
}