English
Related papers

Related papers: Semantic 3D-aware Portrait Synthesis and Manipulat…

200 papers

Neural radiance field (NeRF) enables the synthesis of cutting-edge realistic novel view images of a 3D scene. It includes density and color fields to model the shape and radiance of a scene, respectively. Supervised by the photometric loss…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Qihang Fang , Yafei Song , Keqiang Li , Liefeng Bo

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

Graphics · Computer Science 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

This paper studies a combination of generative Markov random field (MRF) models and discriminatively trained deep convolutional neural networks (dCNNs) for synthesizing 2D images. The generative MRF acts on higher-levels of a dCNN feature…

Computer Vision and Pattern Recognition · Computer Science 2016-01-19 Chuan Li , Michael Wand

Recent research that combines implicit 3D representation with semantic information, like Semantic-NeRF, has proven that NeRF model could perform excellently in rendering 3D structures with semantic labels. This research aims to extend the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Ruibo Wang , Song Zhang , Ping Huang , Donghai Zhang , Wei Yan

Neural Radiance Field (NeRF) is a promising approach for synthesizing novel views, given a set of images and the corresponding camera poses of a scene. However, images photographed from a low-light scene can hardly be used to train a NeRF…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Haoyuan Wang , Xiaogang Xu , Ke Xu , Rynson WH. Lau

Tremendous progress in deep generative models has led to photorealistic image synthesis. While achieving compelling results, most approaches operate in the two-dimensional image domain, ignoring the three-dimensional nature of our world.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Michael Niemeyer , Andreas Geiger

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

The style-based GAN (StyleGAN) architecture achieved state-of-the-art results for generating high-quality images, but it lacks explicit and precise control over camera poses. The recently proposed NeRF-based GANs made great progress towards…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Peng Zhou , Lingxi Xie , Bingbing Ni , Qi Tian

Neural Radiance Fields (NeRF) are compelling techniques for modeling dynamic 3D scenes from 2D image collections. These volumetric representations would be well suited for synthesizing novel facial expressions but for two problems. First,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Heng Yu , Koichiro Niinuma , Laszlo A. Jeni

Novel view synthesis using neural radiance fields (NeRF) is the state-of-the-art technique for generating high-quality images from novel viewpoints. Existing methods require a priori knowledge about extrinsic and intrinsic camera…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Hannah Schieber , Fabian Deuser , Bernhard Egger , Norbert Oswald , Daniel Roth

We present MVSNeRF, a novel neural rendering approach that can efficiently reconstruct neural radiance fields for view synthesis. Unlike prior works on neural radiance fields that consider per-scene optimization on densely captured images,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Anpei Chen , Zexiang Xu , Fuqiang Zhao , Xiaoshuai Zhang , Fanbo Xiang , Jingyi Yu , Hao Su

Talking head generation aims to generate faces that maintain the identity information of the source image and imitate the motion of the driving image. Most pioneering methods rely primarily on 2D representations and thus will inevitably…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Weichuang Li , Longhao Zhang , Dong Wang , Bin Zhao , Zhigang Wang , Mulin Chen , Bang Zhang , Zhongjian Wang , Liefeng Bo , Xuelong Li

This work introduces a novel augmentation method that increases the diversity of a train set to improve the generalization abilities of a 6D pose estimation network. For this purpose, a Neural Radiance Field is trained from synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Antoine Legrand , Renaud Detry , Christophe De Vleeschouwer

Recent works use the Neural radiance field (NeRF) to perform multi-view 3D reconstruction, providing a significant leap in rendering photorealistic scenes. However, despite its efficacy, NeRF exhibits limited capability of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Congyue Deng , Jiawei Yang , Leonidas Guibas , Yue Wang

We propose a Few-shot Dynamic Neural Radiance Field (FDNeRF), the first NeRF-based method capable of reconstruction and expression editing of 3D faces based on a small number of dynamic images. Unlike existing dynamic NeRFs that require…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

In advanced mission concepts with high levels of autonomy, spacecraft need to internally model the pose and shape of nearby orbiting objects. Recent works in neural scene representations show promising results for inferring generic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Anne Mergy , Gurvan Lecuyer , Dawa Derksen , Dario Izzo

NeRFmm is the Neural Radiance Fields (NeRF) that deal with Joint Optimization tasks, i.e., reconstructing real-world scenes and registering camera parameters simultaneously. Despite NeRFmm producing precise scene synthesis and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yitong Xia , Hao Tang , Radu Timofte , Luc Van Gool

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smooth or self-similar…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Axel Levy , Mark Matthews , Matan Sela , Gordon Wetzstein , Dmitry Lagun

Neural Radiance Fields (NeRF) have emerged as a powerful paradigm for 3D scene representation, offering high-fidelity renderings and reconstructions from a set of sparse and unstructured sensor data. In the context of autonomous robotics,…

Robotics · Computer Science 2024-12-09 Yuhang Ming , Xingrui Yang , Weihan Wang , Zheng Chen , Jinglun Feng , Yifan Xing , Guofeng Zhang

Neural Radiance Fields (NeRF) have emerged as a powerful tool for creating highly detailed and photorealistic scenes. Existing methods for NeRF-based 3D style transfer need extensive per-scene optimization for single or multiple styles,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Adil Meric , Umut Kocasari , Matthias Nießner , Barbara Roessle
‹ Prev 1 8 9 10 Next ›