English

Rethinking Multimodal Point Cloud Completion: A Completion-by-Correction Perspective

Computer Vision and Pattern Recognition 2025-12-02 v2 Artificial Intelligence

Abstract

Point cloud completion aims to reconstruct complete 3D shapes from partial observations, which is a challenging problem due to severe occlusions and missing geometry. Despite recent advances in multimodal techniques that leverage complementary RGB images to compensate for missing geometry, most methods still follow a Completion-by-Inpainting paradigm, synthesizing missing structures from fused latent features. We empirically show that this paradigm often results in structural inconsistencies and topological artifacts due to limited geometric and semantic constraints. To address this, we rethink the task and propose a more robust paradigm, termed Completion-by-Correction, which begins with a topologically complete shape prior generated by a pretrained image-to-3D model and performs feature-space correction to align it with the partial observation. This paradigm shifts completion from unconstrained synthesis to guided refinement, enabling structurally consistent and observation-aligned reconstruction. Building upon this paradigm, we introduce PGNet, a multi-stage framework that conducts dual-feature encoding to ground the generative prior, synthesizes a coarse yet structurally aligned scaffold, and progressively refines geometric details via hierarchical correction. Experiments on the ShapeNetViPC dataset demonstrate the superiority of PGNet over state-of-the-art baselines in terms of average Chamfer Distance (-23.5%) and F-score (+7.1%).

Keywords

Cite

@article{arxiv.2511.12170,
  title  = {Rethinking Multimodal Point Cloud Completion: A Completion-by-Correction Perspective},
  author = {Wang Luo and Di Wu and Hengyuan Na and Yinlin Zhu and Miao Hu and Guocong Quan},
  journal= {arXiv preprint arXiv:2511.12170},
  year   = {2025}
}

Comments

Accepted by AAAI 2026

R2 v1 2026-07-01T07:38:59.268Z