English

MGPC: Multimodal Network for Generalizable Point Cloud Completion With Modality Dropout and Progressive Decoding

Computer Vision and Pattern Recognition 2026-01-28 v2

Abstract

Point cloud completion aims to recover complete 3D geometry from partial observations caused by limited viewpoints and occlusions. Existing learning-based works, including 3D Convolutional Neural Network (CNN)-based, point-based, and Transformer-based methods, have achieved strong performance on synthetic benchmarks. However, due to the limitations of modality, scalability, and generative capacity, their generalization to novel objects and real-world scenarios remains challenging. In this paper, we propose MGPC, a generalizable multimodal point cloud completion framework that integrates point clouds, RGB images, and text within a unified architecture. MGPC introduces an innovative modality dropout strategy, a Transformer-based fusion module, and a novel progressive generator to improve robustness, scalability, and geometric modeling capability. We further develop an automatic data generation pipeline and construct MGPC-1M, a large-scale benchmark with over 1,000 categories and one million training pairs. Extensive experiments on MGPC-1M and in-the-wild data demonstrate that the proposed method consistently outperforms prior baselines and exhibits strong generalization under real-world conditions.

Keywords

Cite

@article{arxiv.2601.03660,
  title  = {MGPC: Multimodal Network for Generalizable Point Cloud Completion With Modality Dropout and Progressive Decoding},
  author = {Jiangyuan Liu and Yuhao Zhao and Hongxuan Ma and Zhe Liu and Jian Wang and Wei Zou},
  journal= {arXiv preprint arXiv:2601.03660},
  year   = {2026}
}

Comments

Code and dataset are available at https://github.com/L-J-Yuan/MGPC

R2 v1 2026-07-01T08:53:51.612Z