English

Density-preserving Deep Point Cloud Compression

Computer Vision and Pattern Recognition 2022-04-28 v1 Image and Video Processing

Abstract

Local density of point clouds is crucial for representing local details, but has been overlooked by existing point cloud compression methods. To address this, we propose a novel deep point cloud compression method that preserves local density information. Our method works in an auto-encoder fashion: the encoder downsamples the points and learns point-wise features, while the decoder upsamples the points using these features. Specifically, we propose to encode local geometry and density with three embeddings: density embedding, local position embedding and ancestor embedding. During the decoding, we explicitly predict the upsampling factor for each point, and the directions and scales of the upsampled points. To mitigate the clustered points issue in existing methods, we design a novel sub-point convolution layer, and an upsampling block with adaptive scale. Furthermore, our method can also compress point-wise attributes, such as normal. Extensive qualitative and quantitative results on SemanticKITTI and ShapeNet demonstrate that our method achieves the state-of-the-art rate-distortion trade-off.

Keywords

Cite

@article{arxiv.2204.12684,
  title  = {Density-preserving Deep Point Cloud Compression},
  author = {Yun He and Xinlin Ren and Danhang Tang and Yinda Zhang and Xiangyang Xue and Yanwei Fu},
  journal= {arXiv preprint arXiv:2204.12684},
  year   = {2022}
}

Comments

Accepted by CVPR 2022. Project page is available at https://yunhe20.github.io/D-PCC