English

IPR-NeRF: Ownership Verification meets Neural Radiance Field

Computer Vision and Pattern Recognition 2024-01-24 v4

Abstract

Neural Radiance Field (NeRF) models have gained significant attention in the computer vision community in the recent past with state-of-the-art visual quality and produced impressive demonstrations. Since then, technopreneurs have sought to leverage NeRF models into a profitable business. Therefore, NeRF models make it worth the risk of plagiarizers illegally copying, re-distributing, or misusing those models. This paper proposes a comprehensive intellectual property (IP) protection framework for the NeRF model in both black-box and white-box settings, namely IPR-NeRF. In the black-box setting, a diffusion-based solution is introduced to embed and extract the watermark via a two-stage optimization process. In the white-box setting, a designated digital signature is embedded into the weights of the NeRF model by adopting the sign loss objective. Our extensive experiments demonstrate that not only does our approach maintain the fidelity (\ie, the rendering quality) of IPR-NeRF models, but it is also robust against both ambiguity and removal attacks compared to prior arts.

Keywords

Cite

@article{arxiv.2401.09495,
  title  = {IPR-NeRF: Ownership Verification meets Neural Radiance Field},
  author = {Win Kent Ong and Kam Woh Ng and Chee Seng Chan and Yi Zhe Song and Tao Xiang},
  journal= {arXiv preprint arXiv:2401.09495},
  year   = {2024}
}

Comments

Error on result tabulation of state of the art method which might cause misleading to readers