English

Enhancing Visual Domain Adaptation with Source Preparation

Computer Vision and Pattern Recognition 2023-06-21 v1 Artificial Intelligence Robotics

Abstract

Robotic Perception in diverse domains such as low-light scenarios, where new modalities like thermal imaging and specialized night-vision sensors are increasingly employed, remains a challenge. Largely, this is due to the limited availability of labeled data. Existing Domain Adaptation (DA) techniques, while promising to leverage labels from existing well-lit RGB images, fail to consider the characteristics of the source domain itself. We holistically account for this factor by proposing Source Preparation (SP), a method to mitigate source domain biases. Our Almost Unsupervised Domain Adaptation (AUDA) framework, a label-efficient semi-supervised approach for robotic scenarios -- employs Source Preparation (SP), Unsupervised Domain Adaptation (UDA) and Supervised Alignment (SA) from limited labeled data. We introduce CityIntensified, a novel dataset comprising temporally aligned image pairs captured from a high-sensitivity camera and an intensifier camera for semantic segmentation and object detection in low-light settings. We demonstrate the effectiveness of our method in semantic segmentation, with experiments showing that SP enhances UDA across a range of visual domains, with improvements up to 40.64% in mIoU over baseline, while making target models more robust to real-world shifts within the target domain. We show that AUDA is a label-efficient framework for effective DA, significantly improving target domain performance with only tens of labeled samples from the target domain.

Keywords

Cite

@article{arxiv.2306.10142,
  title  = {Enhancing Visual Domain Adaptation with Source Preparation},
  author = {Anirudha Ramesh and Anurag Ghosh and Christoph Mertz and Jeff Schneider},
  journal= {arXiv preprint arXiv:2306.10142},
  year   = {2023}
}
R2 v1 2026-06-28T11:07:38.498Z