We explore simple methods for adapting a trained multi-task UNet which predicts canopy cover and height to a new geographic setting using remotely sensed data without the need of training a domain-adaptive classifier and extensive fine-tuning. Extending previous research, we followed a selective alignment process to identify similar images in the two geographical domains and then tested an array of data-based unsupervised domain adaptation approaches in a zero-shot setting as well as with a small amount of fine-tuning. We find that the selective aligned data-based image matching methods produce promising results in a zero-shot setting, and even more so with a small amount of fine-tuning. These methods outperform both an untransformed baseline and a popular data-based image-to-image translation model. The best performing methods were pixel distribution adaptation and fourier domain adaptation on the canopy cover and height tasks respectively.
@article{arxiv.2404.10626,
title = {Exploring selective image matching methods for zero-shot and few-sample unsupervised domain adaptation of urban canopy prediction},
author = {John Francis and Stephen Law},
journal= {arXiv preprint arXiv:2404.10626},
year = {2024}
}
Comments
ICLR 2024 Machine Learning for Remote Sensing (ML4RS) Workshop