中文
相关论文

相关论文: Semantic 3D-aware Portrait Synthesis and Manipulat…

200 篇论文

Recent work on 3D-aware image synthesis has achieved compelling results using advances in neural rendering. However, 3D-aware synthesis of face dynamics hasn't received much attention. Here, we study how to explicitly control generative…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Peiye Zhuang , Liqian Ma , Oluwasanmi Koyejo , Alexander G. Schwing

The emerging Neural Radiance Field (NeRF) shows great potential in representing 3D scenes, which can render photo-realistic images from novel view with only sparse views given. However, utilizing NeRF to reconstruct real-world scenes…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Chenbin Li , Yu Xin , Gaoyi Liu , Xiang Zeng , Ligang Liu

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

3D generative models of objects enable photorealistic image synthesis with 3D control. Existing methods model the scene as a global scene representation, ignoring the compositional aspect of the scene. Compositional reasoning can enable a…

图形学 · 计算机科学 2022-11-01 Mallikarjun BR , Ayush Tewari , Xingang Pan , Mohamed Elgharib , Christian Theobalt

This paper presents a neural rendering method for controllable portrait video synthesis. Recent advances in volumetric neural rendering, such as neural radiance fields (NeRF), has enabled the photorealistic novel view synthesis of static…

计算机视觉与模式识别 · 计算机科学 2021-08-12 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Zhengfei Kuang , Fujun Luan , Sai Bi , Zhixin Shu , Gordon Wetzstein , Kalyan Sunkavalli

We present a novel approach to perform 3D semantic segmentation solely from 2D supervision by leveraging Neural Radiance Fields (NeRFs). By extracting features along a surface point cloud, we achieve a compact representation of the scene…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Dominik Hollidt , Clinton Wang , Polina Golland , Marc Pollefeys

Volumetric neural rendering methods, such as neural radiance fields (NeRFs), have enabled photo-realistic novel view synthesis. However, in their standard form, NeRFs do not support the editing of objects, such as a human head, within a…

计算机视觉与模式识别 · 计算机科学 2022-06-15 ShahRukh Athar , Zexiang Xu , Kalyan Sunkavalli , Eli Shechtman , Zhixin Shu

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

Neural rendering combines ideas from classical computer graphics and machine learning to synthesize images from real-world observations. NeRF, short for Neural Radiance Fields, is a recent innovation that uses AI algorithms to create 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-20 AKM Shahariar Azad Rabby , Chengcui Zhang

While dynamic Neural Radiance Fields (NeRF) have shown success in high-fidelity 3D modeling of talking portraits, the slow training and inference speed severely obstruct their potential usage. In this paper, we propose an efficient…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Jiaxiang Tang , Kaisiyuan Wang , Hang Zhou , Xiaokang Chen , Dongliang He , Tianshu Hu , Jingtuo Liu , Gang Zeng , Jingdong Wang

Neural Radiance Field (NeRF) has emerged as a compelling method to represent 3D objects and scenes for photo-realistic rendering. However, its implicit representation causes difficulty in manipulating the models like the explicit mesh…

计算机视觉与模式识别 · 计算机科学 2022-10-14 Jiaxiang Tang , Xiaokang Chen , Jingbo Wang , Gang Zeng

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

The neural radiance field (NERF) advocates learning the continuous representation of 3D geometry through a multilayer perceptron (MLP). By integrating this into a generative model, the generative neural radiance field (GRAF) is capable of…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Jian Liu , Zhen Yu

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

图形学 · 计算机科学 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

This paper presents ER-NeRF, a novel conditional Neural Radiance Fields (NeRF) based architecture for talking portrait synthesis that can concurrently achieve fast convergence, real-time rendering, and state-of-the-art performance with…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Jiahe Li , Jiawei Zhang , Xiao Bai , Jun Zhou , Lin Gu

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

With the success of Neural Radiance Field (NeRF) in 3D-aware portrait editing, a variety of works have achieved promising results regarding both quality and 3D consistency. However, these methods heavily rely on per-prompt optimization when…

计算机视觉与模式识别 · 计算机科学 2024-02-05 Jianhui Li , Shilong Liu , Zidong Liu , Yikai Wang , Kaiwen Zheng , Jinghui Xu , Jianmin Li , Jun Zhu

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important…

Neural Radiance Fields (NeRFs) encode the radiance in a scene parameterized by the scene's plenoptic function. This is achieved by using an MLP together with a mapping to a higher-dimensional space, and has been proven to capture scenes…

计算机视觉与模式识别 · 计算机科学 2022-12-08 Siddhant Ranade , Christoph Lassner , Kai Li , Christian Haene , Shen-Chi Chen , Jean-Charles Bazin , Sofien Bouaziz