English
Related papers

Related papers: FaceCLIPNeRF: Text-driven 3D Face Manipulation usi…

200 papers

Neural implicit representation of visual scenes has attracted a lot of attention in recent research of computer vision and graphics. Most prior methods focus on how to reconstruct 3D scene representation from a set of images. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Wenpu Li , Pian Wan , Peng Wang , Jinghang Li , Yi Zhou , Peidong Liu

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

Graphics · Computer Science 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

A long-standing goal in scene understanding is to obtain interpretable and editable representations that can be directly constructed from a raw monocular RGB-D video, without requiring specialized hardware setup or priors. The problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yu-Shiang Wong , Niloy J. Mitra

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

Neural radiance fields (NeRFs) have recently emerged as a promising approach for 3D reconstruction and novel view synthesis. However, NeRF-based methods encode shape, reflectance, and illumination implicitly and this makes it challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Ruofan Liang , Jiahao Zhang , Haoda Li , Chen Yang , Yushi Guan , Nandita Vijaykumar

Rendering scenes with a high-quality human face from arbitrary viewpoints is a practical and useful technique for many real-world applications. Recently, Neural Radiance Fields (NeRF), a rendering technique that uses neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Satoshi Tsutsui , Weijia Mao , Sijing Lin , Yunyi Zhu , Murong Ma , Mike Zheng Shou

We present DietNeRF, a 3D neural scene representation estimated from a few images. Neural Radiance Fields (NeRF) learn a continuous volumetric representation of a scene through multi-view consistency, and can be rendered from novel…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Ajay Jain , Matthew Tancik , Pieter Abbeel

Obtaining 3D object representations is important for creating photo-realistic simulations and for collecting AR and VR assets. Neural fields have shown their effectiveness in learning a continuous volumetric representation of a scene from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Ashkan Mirzaei , Yash Kant , Jonathan Kelly , Igor Gilitschenski

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Sida Peng , Zhen Xu , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Hujun Bao , Xiaowei Zhou

High-fidelity 4D dynamic facial avatar reconstruction from monocular video is a critical yet challenging task, driven by increasing demands for immersive virtual human applications. While Neural Radiance Fields (NeRF) have advanced scene…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Zhe Chang , Haodong Jin , Ying Sun , Yan Song , Hui Yu

Traditional 3D face models are based on mesh representations with texture. One of the most important models is FLAME (Faces Learned with an Articulated Model and Expressions), which produces meshes of human faces that are fully…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Wojciech Zając , Joanna Waczyńska , Piotr Borycki , Jacek Tabor , Maciej Zięba , Przemysław Spurek

Neural Radiance Fields (NeRFs) have emerged as a standard framework for representing 3D scenes and objects, introducing a novel data type for information exchange and storage. Concurrently, significant progress has been made in multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Francesco Ballerini , Pierluigi Zama Ramirez , Roberto Mirabella , Samuele Salti , Luigi Di Stefano

Contemporary registration devices for 3D visual information, such as LIDARs and various depth cameras, capture data as 3D point clouds. In turn, such clouds are challenging to be processed due to their size and complexity. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Dominik Zimny , Joanna Waczyńska , Tomasz Trzciński , Przemysław Spurek

Recently, there has been a significant advancement in text-to-image diffusion models, leading to groundbreaking performance in 2D image generation. These advancements have been extended to 3D models, enabling the generation of novel 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jangho Park , Gihyun Kwon , Jong Chul Ye

Neural Radiance Field (NeRF) models are implicit neural scene representation methods that offer unprecedented capabilities in novel view synthesis. Semantically-aware NeRFs not only capture the shape and radiance of a scene, but also encode…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Yuzhe Zhu , Lile Cai , Kangkang Lu , Fayao Liu , Xulei Yang

This paper proposes NeuralEditor that enables neural radiance fields (NeRFs) natively editable for general shape editing tasks. Despite their impressive results on novel-view synthesis, it remains a fundamental challenge for NeRFs to edit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Jun-Kun Chen , Jipeng Lyu , Yu-Xiong Wang

Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Minye Wu , Tinne Tuytelaars

It is now possible to reconstruct dynamic human motion and shape from a sparse set of cameras using Neural Radiance Fields (NeRF) driven by an underlying skeleton. However, a challenge remains to model the deformation of cloth and skin in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Chunjin Song , Bastian Wandt , Helge Rhodin

Generating talking person portraits with arbitrary speech audio is a crucial problem in the field of digital human and metaverse. A modern talking face generation method is expected to achieve the goals of generalized audio-lip…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Zhenhui Ye , Jinzheng He , Ziyue Jiang , Rongjie Huang , Jiawei Huang , Jinglin Liu , Yi Ren , Xiang Yin , Zejun Ma , Zhou Zhao

Animating high-fidelity video portrait with speech audio is crucial for virtual reality and digital entertainment. While most previous studies rely on accurate explicit structural information, recent works explore the implicit scene…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Xian Liu , Yinghao Xu , Qianyi Wu , Hang Zhou , Wayne Wu , Bolei Zhou