English

Class-Continuous Conditional Generative Neural Radiance Field

Computer Vision and Pattern Recognition 2024-01-10 v3 Artificial Intelligence

Abstract

The 3D-aware image synthesis focuses on conserving spatial consistency besides generating high-resolution images with fine details. Recently, Neural Radiance Field (NeRF) has been introduced for synthesizing novel views with low computational cost and superior performance. While several works investigate a generative NeRF and show remarkable achievement, they cannot handle conditional and continuous feature manipulation in the generation procedure. In this work, we introduce a novel model, called Class-Continuous Conditional Generative NeRF (C3\text{C}^{3}G-NeRF), which can synthesize conditionally manipulated photorealistic 3D-consistent images by projecting conditional features to the generator and the discriminator. The proposed C3\text{C}^{3}G-NeRF is evaluated with three image datasets, AFHQ, CelebA, and Cars. As a result, our model shows strong 3D-consistency with fine details and smooth interpolation in conditional feature manipulation. For instance, C3\text{C}^{3}G-NeRF exhibits a Fr\'echet Inception Distance (FID) of 7.64 in 3D-aware face image synthesis with a 1282\text{128}^{2} resolution. Additionally, we provide FIDs of generated 3D-aware images of each class of the datasets as it is possible to synthesize class-conditional images with C3\text{C}^{3}G-NeRF.

Keywords

Cite

@article{arxiv.2301.00950,
  title  = {Class-Continuous Conditional Generative Neural Radiance Field},
  author = {Jiwook Kim and Minhyeok Lee},
  journal= {arXiv preprint arXiv:2301.00950},
  year   = {2024}
}

Comments

BMVC 2023 (Accepted)

R2 v1 2026-06-28T08:00:25.421Z