English

MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detection

Computer Vision and Pattern Recognition 2025-09-15 v1 Machine Learning

Abstract

Zero-shot 3D (ZS-3D) anomaly detection aims to identify defects in 3D objects without relying on labeled training data, making it especially valuable in scenarios constrained by data scarcity, privacy, or high annotation cost. However, most existing methods focus exclusively on point clouds, neglecting the rich semantic cues available from complementary modalities such as RGB images and texts priors. This paper introduces MCL-AD, a novel framework that leverages multimodal collaboration learning across point clouds, RGB images, and texts semantics to achieve superior zero-shot 3D anomaly detection. Specifically, we propose a Multimodal Prompt Learning Mechanism (MPLM) that enhances the intra-modal representation capability and inter-modal collaborative learning by introducing an object-agnostic decoupled text prompt and a multimodal contrastive loss. In addition, a collaborative modulation mechanism (CMM) is proposed to fully leverage the complementary representations of point clouds and RGB images by jointly modulating the RGB image-guided and point cloud-guided branches. Extensive experiments demonstrate that the proposed MCL-AD framework achieves state-of-the-art performance in ZS-3D anomaly detection.

Keywords

Cite

@article{arxiv.2509.10282,
  title  = {MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detection},
  author = {Gang Li and Tianjiao Chen and Mingle Zhou and Min Li and Delong Han and Jin Wan},
  journal= {arXiv preprint arXiv:2509.10282},
  year   = {2025}
}

Comments

Page 14, 5 pictures

R2 v1 2026-07-01T05:33:34.232Z