English

PU-Flow: a Point Cloud Upsampling Network with Normalizing Flows

Computer Vision and Pattern Recognition 2022-06-09 v4

Abstract

Point cloud upsampling aims to generate dense point clouds from given sparse ones, which is a challenging task due to the irregular and unordered nature of point sets. To address this issue, we present a novel deep learning-based model, called PU-Flow, which incorporates normalizing flows and weight prediction techniques to produce dense points uniformly distributed on the underlying surface. Specifically, we exploit the invertible characteristics of normalizing flows to transform points between Euclidean and latent spaces and formulate the upsampling process as ensemble of neighbouring points in a latent space, where the ensemble weights are adaptively learned from local geometric context. Extensive experiments show that our method is competitive and, in most test cases, it outperforms state-of-the-art methods in terms of reconstruction quality, proximity-to-surface accuracy, and computation efficiency. The source code will be publicly available at https://github.com/unknownue/pu-flow.

Keywords

Cite

@article{arxiv.2107.05893,
  title  = {PU-Flow: a Point Cloud Upsampling Network with Normalizing Flows},
  author = {Aihua Mao and Zihui Du and Junhui Hou and Yaqi Duan and Yong-jin Liu and Ying He},
  journal= {arXiv preprint arXiv:2107.05893},
  year   = {2022}
}