English

Towards Active Real-to-Twin Inspection: A New Paradigm for Zero-Shot Anomaly Detection

Computer Vision and Pattern Recognition 2026-05-26 v1

Abstract

The deployment of zero-shot anomaly detection (AD) in embodied industrial inspection is severely bottlenecked by its reliance on passive, fixed-viewpoint 2D imagery. Such formulations inherently fail to accommodate the active, dynamic observations required in real-world environments. To break this limitation, we introduce Real-to-Twin Anomaly Detection, a novel task that evaluates physical observations directly against geometrically matched CAD Digital Twins. To tackle this new task, we propose AVATAR, a framework designed to learn robust semantic alignment between Real and Digital Twins. By bridging benign Sim2Real domain gaps using only defect-free pairs, AVATAR effectively transforms CAD priors into dynamic, anomaly-free references. This elegant formulation enables the model to localize diverse anomalies in a zero-shot manner as unalignable deviations, eliminating the need for defect annotations. Extensive experiments demonstrate that AVATAR substantially outperforms adapted state-of-the-art baselines, exhibiting exceptional robustness to severe viewpoint variations. The code and dataset will be made publicly available.

Keywords

Cite

@article{arxiv.2605.25407,
  title  = {Towards Active Real-to-Twin Inspection: A New Paradigm for Zero-Shot Anomaly Detection},
  author = {Jiaxuan Liu and Yunkang Cao and Yufeng Chen and Chunyang Li and Yuhuan Du and Hui Zhang},
  journal= {arXiv preprint arXiv:2605.25407},
  year   = {2026}
}

Comments

6 pages, 4 figures, accepted to IEEE-CYBER 2026, Florence, Italy