English

PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Training

Computer Vision and Pattern Recognition 2021-05-19 v1 Artificial Intelligence

Abstract

Unsupervised domain adaptation is a promising technique for semantic segmentation and other computer vision tasks for which large-scale data annotation is costly and time-consuming. In semantic segmentation, it is attractive to train models on annotated images from a simulated (source) domain and deploy them on real (target) domains. In this work, we present a novel framework for unsupervised domain adaptation based on the notion of target-domain consistency training. Intuitively, our work is based on the idea that in order to perform well on the target domain, a model's output should be consistent with respect to small perturbations of inputs in the target domain. Specifically, we introduce a new loss term to enforce pixelwise consistency between the model's predictions on a target image and a perturbed version of the same image. In comparison to popular adversarial adaptation methods, our approach is simpler, easier to implement, and more memory-efficient during training. Experiments and extensive ablation studies demonstrate that our simple approach achieves remarkably strong results on two challenging synthetic-to-real benchmarks, GTA5-to-Cityscapes and SYNTHIA-to-Cityscapes. Code is available at: https://github.com/lukemelas/pixmatch

Keywords

Cite

@article{arxiv.2105.08128,
  title  = {PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Training},
  author = {Luke Melas-Kyriazi and Arjun K. Manrai},
  journal= {arXiv preprint arXiv:2105.08128},
  year   = {2021}
}

Comments

CVPR 2021

R2 v1 2026-06-24T02:11:58.337Z