English

CAD-Prompted SAM3: Geometry-Conditioned Instance Segmentation for Industrial Objects

Computer Vision and Pattern Recognition 2026-03-25 v2

Abstract

Verbal-prompted segmentation is inherently limited by the expressiveness of natural language and struggles with uncommon, instance-specific, or difficult-to-describe objects: scenarios frequently encountered in manufacturing and 3D printing environments. While image exemplars provide an alternative, they primarily encode appearance cues such as color and texture, which are often unrelated to a part's geometric identity. In industrial settings, a single component may be produced in different materials, finishes, or colors, making appearance-based prompting unreliable. In contrast, such objects are typically defined by precise CAD models that capture their canonical geometry. We propose a CAD-prompted segmentation framework built on SAM3 that uses canonical multi-view renderings of a CAD model as prompt input. The rendered views provide geometry-based conditioning independent of surface appearance. The model is trained using synthetic data generated from mesh renderings in simulation under diverse viewpoints and scene contexts. Our approach enables single-stage, CAD-prompted mask prediction, extending promptable segmentation to objects that cannot be robustly described by language or appearance alone.

Keywords

Cite

@article{arxiv.2602.20551,
  title  = {CAD-Prompted SAM3: Geometry-Conditioned Instance Segmentation for Industrial Objects},
  author = {Zhenran Tang and Rohan Nagabhirava and Changliu Liu},
  journal= {arXiv preprint arXiv:2602.20551},
  year   = {2026}
}
R2 v1 2026-07-01T10:49:20.465Z