English
Related papers

Related papers: PAV: Personalized Head Avatar from Unstructured Vi…

200 papers

Recent works in spatiotemporal radiance fields can produce photorealistic free-viewpoint videos. However, they are inherently unsuitable for interactive streaming scenarios (e.g. video conferencing, telepresence) because have an inevitable…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Shengze Wang , Alexey Supikov , Joshua Ratcliff , Henry Fuchs , Ronald Azuma

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

Graphics · Computer Science 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

Recent advances in diffusion models such as ControlNet have enabled geometrically controllable, high-fidelity text-to-image generation. However, none of them addresses the question of adding such controllability to text-to-3D generation. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sungwon Hwang , Junha Hyung , Jaegul Choo

Implicit radiance functions emerged as a powerful scene representation for reconstructing and rendering photo-realistic views of a 3D scene. These representations, however, suffer from poor editability. On the other hand, explicit…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Li Ma , Xiaoyu Li , Jing Liao , Xuan Wang , Qi Zhang , Jue Wang , Pedro Sander

In this paper, we present the decomposed triplane-hash neural radiance fields (DT-NeRF), a framework that significantly improves the photorealistic rendering of talking faces and achieves state-of-the-art results on key evaluation datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Yaoyu Su , Shaohui Wang , Haoqian Wang

In this paper, we propose Generalizable and Animatable Gaussian head Avatar (GAGAvatar) for one-shot animatable head avatar reconstruction. Existing methods rely on neural radiance fields, leading to heavy rendering consumption and low…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Xuangeng Chu , Tatsuya Harada

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

Creating human avatars is a highly desirable yet challenging task. Recent advancements in radiance field rendering have achieved unprecedented photorealism and real-time performance for personalized dynamic human avatars. However, these…

Graphics · Computer Science 2025-09-09 Dongliang Cao , Guoxing Sun , Marc Habermann , Florian Bernard

Recent methods for audio-driven talking head synthesis often optimize neural radiance fields (NeRF) on a monocular talking portrait video, leveraging its capability to render high-fidelity and 3D-consistent novel-view frames. However, they…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jaehoon Ko , Kyusun Cho , Joungbin Lee , Heeji Yoon , Sangmin Lee , Sangjun Ahn , Seungryong Kim

Style transfer for human face has been widely researched in recent years. Majority of the existing approaches work in 2D image domain and have 3D inconsistency issue when applied on different viewpoints of the same face. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Jianwei Feng , Prateek Singhal

Neural Radiance Field (NeRF) regresses a neural parameterized scene by differentially rendering multi-view images with ground-truth supervision. However, when interpolating novel views, NeRF often yields inconsistent and visually non-smooth…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Tianlong Chen , Peihao Wang , Zhiwen Fan , Zhangyang Wang

Numerous emerging deep-learning techniques have had a substantial impact on computer graphics. Among the most promising breakthroughs are the rise of Neural Radiance Fields (NeRFs) and Gaussian Splatting (GS). NeRFs encode the object's…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Georgii Stanishevskii , Jakub Steczkiewicz , Tomasz Szczepanik , Sławomir Tadeja , Jacek Tabor , Przemysław Spurek

Considering the problem of novel view synthesis (NVS) from only a set of 2D images, we simplify the training process of Neural Radiance Field (NeRF) on forward-facing scenes by removing the requirement of known or pre-computed camera…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Zirui Wang , Shangzhe Wu , Weidi Xie , Min Chen , Victor Adrian Prisacariu

Audio-driven talking head generation is advancing from 2D to 3D content. Notably, Neural Radiance Field (NeRF) is in the spotlight as a means to synthesize high-quality 3D talking head outputs. Unfortunately, this NeRF-based approach…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Gihoon Kim , Kwanggyoon Seo , Sihun Cha , Junyong Noh

We present a method for estimating neural scenes representations of objects given only a single image. The core of our method is the estimation of a geometric scaffold for the object and its use as a guide for the reconstruction of the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Konstantinos Rematas , Ricardo Martin-Brualla , Vittorio Ferrari

Neural rendering techniques combining machine learning with geometric reasoning have arisen as one of the most promising approaches for synthesizing novel views of a scene from a sparse set of images. Among these, stands out the Neural…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Albert Pumarola , Enric Corona , Gerard Pons-Moll , Francesc Moreno-Noguer

We present PVSeRF, a learning framework that reconstructs neural radiance fields from single-view RGB images, for novel view synthesis. Previous solutions, such as pixelNeRF, rely only on pixel-aligned features and suffer from feature…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Xianggang Yu , Jiapeng Tang , Yipeng Qin , Chenghong Li , Linchao Bao , Xiaoguang Han , Shuguang Cui

Neural Radiance Fields (NeRF) have been proposed for photorealistic novel view rendering. However, it requires many different views of one scene for training. Moreover, it has poor generalizations to new scenes and requires retraining or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Yurui Chen , Chun Gu , Feihu Zhang , Li Zhang

Neural Radiance Fields (NeRF) coupled with GANs represent a promising direction in the area of 3D reconstruction from a single view, owing to their ability to efficiently model arbitrary topologies. Recent work in this area, however, has…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Dario Pavllo , David Joseph Tan , Marie-Julie Rakotosaona , Federico Tombari

Existing talking avatar methods typically adopt an image-to-video pipeline conditioned on a static reference image within the same scene as the target generation. This restricted, single-view perspective lacks sufficient temporal and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Zujin Guo , Zhenhui Ye , Yi Ren , Yuanming Li , Ce Chen , Zhibin Hong , Chen Change Loy