中文
相关论文

相关论文: PAV: Personalized Head Avatar from Unstructured Vi…

200 篇论文

Existing approaches to animatable NeRF-based head avatars are either built upon face templates or use the expression coefficients of templates as the driving signal. Despite the promising progress, their performances are heavily bound by…

计算机视觉与模式识别 · 计算机科学 2023-05-04 Yuelang Xu , Hongwen Zhang , Lizhen Wang , Xiaochen Zhao , Han Huang , Guojun Qi , Yebin Liu

We present a unified and generalizable framework for synthesizing view-consistent and temporally coherent avatars from a single image, addressing the challenging task of single-image avatar generation. Existing diffusion-based methods often…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Yixing Lu , Junting Dong , Youngjoong Kwon , Qin Zhao , Bo Dai , Fernando De la Torre

Creating a controllable and relightable digital avatar from multi-view video with fixed illumination is a very challenging problem since humans are highly articulated, creating pose-dependent appearance effects, and skin as well as clothing…

计算机视觉与模式识别 · 计算机科学 2024-07-29 Diogo Luvizon , Vladislav Golyanik , Adam Kortylewski , Marc Habermann , Christian Theobalt

Neural Radiance Fields (NeRF) is a popular view synthesis technique that represents a scene as a continuous volumetric function, parameterized by multilayer perceptrons that provide the volume density and view-dependent emitted radiance at…

计算机视觉与模式识别 · 计算机科学 2021-12-08 Dor Verbin , Peter Hedman , Ben Mildenhall , Todd Zickler , Jonathan T. Barron , Pratul P. Srinivasan

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from computer graphics and…

计算机视觉与模式识别 · 计算机科学 2020-12-21 Ziyan Wang , Timur Bagautdinov , Stephen Lombardi , Tomas Simon , Jason Saragih , Jessica Hodgins , Michael Zollhöfer

While NeRF-based human representations have shown impressive novel view synthesis results, most methods still rely on a large number of images / views for training. In this work, we propose a novel animatable NeRF called ActorsNeRF. It is…

计算机视觉与模式识别 · 计算机科学 2023-04-28 Jiteng Mu , Shen Sang , Nuno Vasconcelos , Xiaolong Wang

We present a first step towards 4D (3D and time) human video stylization, which addresses style transfer, novel view synthesis and human animation within a unified framework. While numerous video stylization methods have been developed,…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Tiantian Wang , Xinxin Zuo , Fangzhou Mu , Jian Wang , Ming-Hsuan Yang

We propose a Transformer-based NeRF (TransNeRF) to learn a generic neural radiance field conditioned on observed-view images for the novel view synthesis task. By contrast, existing MLP-based NeRFs are not able to directly receive observed…

计算机视觉与模式识别 · 计算机科学 2022-06-14 Dan Wang , Xinrui Cui , Septimiu Salcudean , Z. Jane Wang

In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images. We first propose a double…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Guangming Yao , Hongzhi Wu , Yi Yuan , Lincheng Li , Kun Zhou , Xin Yu

Generating controllable and photorealistic digital human avatars is a long-standing and important problem in Vision and Graphics. Recent methods have shown great progress in terms of either photorealism or inference speed while the…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Youngjoong Kwon , Lingjie Liu , Henry Fuchs , Marc Habermann , Christian Theobalt

For reconstructing high-fidelity human 3D models from monocular videos, it is crucial to maintain consistent large-scale body shapes along with finely matched subtle wrinkles. This paper explores the observation that the per-frame rendering…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Chunjin Song , Zhijie Wu , Bastian Wandt , Leonid Sigal , Helge Rhodin

Neural Radiance Field (NeRF) has revolutionized novel-view rendering tasks and achieved impressive results. However, the inefficient sampling and per-scene optimization hinder its wide applications. Though some generalizable NeRFs have been…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Yue Shi , Dingyi Rong , Chang Chen , Chaofan Ma , Bingbing Ni , Wenjun Zhang

Although neural radiance fields (NeRF) have shown impressive advances for novel view synthesis, most methods typically require multiple input images of the same scene with accurate camera poses. In this work, we seek to substantially reduce…

计算机视觉与模式识别 · 计算机科学 2022-10-17 Kai-En Lin , Lin Yen-Chen , Wei-Sheng Lai , Tsung-Yi Lin , Yi-Chang Shih , Ravi Ramamoorthi

Recently, the editing of neural radiance fields (NeRFs) has gained considerable attention, but most prior works focus on static scenes while research on the appearance editing of dynamic scenes is relatively lacking. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Shangzan Zhang , Sida Peng , Yinji ShenTu , Qing Shuai , Tianrun Chen , Kaicheng Yu , Hujun Bao , Xiaowei Zhou

We introduce the first method for audio-driven universal photorealistic avatar synthesis, combining a person-agnostic speech model with our novel Universal Head Avatar Prior (UHAP). UHAP is trained on cross-identity multi-view videos. In…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Kartik Teotia , Helge Rhodin , Mohit Mendiratta , Hyeongwoo Kim , Marc Habermann , Christian Theobalt

High-quality reconstruction of controllable 3D head avatars from 2D videos is highly desirable for virtual human applications in movies, games, and telepresence. Neural implicit fields provide a powerful representation to model 3D head…

计算机视觉与模式识别 · 计算机科学 2023-04-24 Chuhan Chen , Matthew O'Toole , Gaurav Bharaj , Pablo Garrido

In this paper, we introduce an innovative method of safeguarding user privacy against the generative capabilities of Neural Radiance Fields (NeRF) models. Our novel poisoning attack method induces changes to observed views that are…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Yihan Wu , Brandon Y. Feng , Heng Huang

Real-time rendering of human head avatars is a cornerstone of many computer graphics applications, such as augmented reality, video games, and films, to name a few. Recent approaches address this challenge with computationally efficient…

计算机视觉与模式识别 · 计算机科学 2024-09-19 Kartik Teotia , Hyeongwoo Kim , Pablo Garrido , Marc Habermann , Mohamed Elgharib , Christian Theobalt

The creation of high-fidelity, digital versions of human heads is an important stepping stone in the process of further integrating virtual components into our everyday lives. Constructing such avatars is a challenging research problem, due…

计算机视觉与模式识别 · 计算机科学 2024-09-16 Simon Giebenhain , Tobias Kirschstein , Martin Rünz , Lourdes Agapito , Matthias Nießner

Neural Radiance Field (NeRF) is a powerful tool to faithfully generate novel views for scenes with only sparse captured images. Despite its strong capability for representing 3D scenes and their appearance, its editing ability is very…

计算机视觉与模式识别 · 计算机科学 2022-12-27 Qiling Wu , Jianchao Tan , Kun Xu