中文
相关论文

相关论文: Learning Dynamic Facial Radiance Fields for Few-Sh…

200 篇论文

Talking face generation (TFG) aims to animate a target identity's face to create realistic talking videos. Personalized TFG is a variant that emphasizes the perceptual identity similarity of the synthesized result (from the perspective of…

计算机视觉与模式识别 · 计算机科学 2024-10-16 Zhenhui Ye , Tianyun Zhong , Yi Ren , Ziyue Jiang , Jiawei Huang , Rongjie Huang , Jinglin Liu , Jinzheng He , Chen Zhang , Zehan Wang , Xize Chen , Xiang Yin , Zhou Zhao

Recent work on 3D-aware image synthesis has achieved compelling results using advances in neural rendering. However, 3D-aware synthesis of face dynamics hasn't received much attention. Here, we study how to explicitly control generative…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Peiye Zhuang , Liqian Ma , Oluwasanmi Koyejo , Alexander G. Schwing

Neural Radiance Fields (NeRF) is a technique for high quality novel view synthesis from a collection of posed input images. Like most view synthesis methods, NeRF uses tonemapped low dynamic range (LDR) as input; these images have been…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Ben Mildenhall , Peter Hedman , Ricardo Martin-Brualla , Pratul Srinivasan , Jonathan T. Barron

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

计算机视觉与模式识别 · 计算机科学 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

Neural radiance fields (NeRF) bring a new wave for 3D interactive experiences. However, as an important part of the immersive experiences, the defocus effects have not been fully explored within NeRF. Some recent NeRF-based methods generate…

计算机视觉与模式识别 · 计算机科学 2022-08-11 Yinhuai Wang , Shuzhou Yang , Yujie Hu , Jian Zhang

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

计算机视觉与模式识别 · 计算机科学 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

计算机视觉与模式识别 · 计算机科学 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

We propose PAV, Personalized Head Avatar for the synthesis of human faces under arbitrary viewpoints and facial expressions. PAV introduces a method that learns a dynamic deformable neural radiance field (NeRF), in particular from a…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Akin Caliskan , Berkay Kicanaoglu , Hyeongwoo Kim

Generating talking person portraits with arbitrary speech audio is a crucial problem in the field of digital human and metaverse. A modern talking face generation method is expected to achieve the goals of generalized audio-lip…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Zhenhui Ye , Jinzheng He , Ziyue Jiang , Rongjie Huang , Jiawei Huang , Jinglin Liu , Yi Ren , Xiang Yin , Zejun Ma , Zhou Zhao

Neural Radiance Field (NeRF) has been a mainstream in novel view synthesis with its remarkable quality of rendered images and simple architecture. Although NeRF has been developed in various directions improving continuously its…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Seunghyeon Seo , Yeonjin Chang , Nojun Kwak

Despite significant progress in talking head synthesis since the introduction of Neural Radiance Fields (NeRF), visual artifacts and high training costs persist as major obstacles to large-scale commercial adoption. We propose that…

计算机视觉与模式识别 · 计算机科学 2024-12-24 Tianqi Li , Ruobing Zheng , Bonan Li , Zicheng Zhang , Meng Wang , Jingdong Chen , Ming Yang

This paper presents a neural rendering method for controllable portrait video synthesis. Recent advances in volumetric neural rendering, such as neural radiance fields (NeRF), has enabled the photorealistic novel view synthesis of static…

计算机视觉与模式识别 · 计算机科学 2021-08-12 ShahRukh Athar , Zhixin Shu , Dimitris Samaras

Recent methods for audio-driven talking head synthesis often optimize neural radiance fields (NeRF) on a monocular talking portrait video, leveraging its capability to render high-fidelity and 3D-consistent novel-view frames. However, they…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Jaehoon Ko , Kyusun Cho , Joungbin Lee , Heeji Yoon , Sangmin Lee , Sangjun Ahn , Seungryong Kim

We address the problem of photorealistic 3D face avatar synthesis from sparse images. Existing Parametric models for face avatar reconstruction struggle to generate details that originate from inputs. Meanwhile, although current NeRF-based…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Weichen Zhang , Xiang Zhou , Yukang Cao , Wensen Feng , Chun Yuan

3D facial avatar reconstruction has been a significant research topic in computer graphics and computer vision, where photo-realistic rendering and flexible controls over poses and expressions are necessary for many related applications.…

计算机视觉与模式识别 · 计算机科学 2023-07-10 Wangbo Yu , Yanbo Fan , Yong Zhang , Xuan Wang , Fei Yin , Yunpeng Bai , Yan-Pei Cao , Ying Shan , Yang Wu , Zhongqian Sun , Baoyuan Wu

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

图形学 · 计算机科学 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

The ability to create high-quality 3D faces from a single image has become increasingly important with wide applications in video conferencing, AR/VR, and advanced video editing in movie industries. In this paper, we propose Face Diffusion…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Hao Zhang , Yanbo Xu , Tianyuan Dai , Yu-Wing Tai , Chi-Keung Tang

Dynamic neural radiance fields (dynamic NeRFs) have demonstrated impressive results in novel view synthesis on 3D dynamic scenes. However, they often require complete video sequences for training followed by novel view synthesis, which is…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Zhiwen Yan , Chen Li , Gim Hee Lee

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

NeRFs have enabled highly realistic synthesis of human faces including complex appearance and reflectance effects of hair and skin. These methods typically require a large number of multi-view input images, making the process hardware…