English

Efficient Image Annotation via Semi-Supervised Object Segmentation with Label Propagation

Computer Vision and Pattern Recognition 2026-04-28 v1 Robotics

Abstract

Reliable object perception is necessary for general-purpose service robots. Open-vocabulary detectors struggle to generalize beyond a few classes and fully supervised training of object detectors requires time-intensive annotations. We present a semi-supervised label propagation approach for household object segmentation. A segment proposer generates class-agnostic masks, and an ensemble of Hopfield networks assigns labels by learning representative embeddings in complementary foundation model embedding spaces (CLIP, ViT, Theia). Our approach scales to 50 object classes with limited annotation overhead and can automatically label 60% of the data in a RoboCup@Home setting, where preparation time is severely constrained. Dataset and code are publicly available at https://github.com/ais-bonn/label_propagation.

Keywords

Cite

@article{arxiv.2604.22992,
  title  = {Efficient Image Annotation via Semi-Supervised Object Segmentation with Label Propagation},
  author = {Vitalii Tutevych and Raphael Memmesheimer and Luca Eichler and Dmytro Pavlichenko and Fynn Schilke and Rodja Krudewig and Sven Behnke},
  journal= {arXiv preprint arXiv:2604.22992},
  year   = {2026}
}

Comments

12 pages, 6 figures, 7 tables, submitted to RoboCup 2026 Symposium

R2 v1 2026-07-01T12:34:33.879Z