中文
相关论文

相关论文: MoFaNeRF: Morphable Facial Neural Radiance Field

200 篇论文

Virtual Reality (VR) is becoming ubiquitous with the rise of consumer displays and commercial VR platforms. Such displays require low latency and high quality rendering of synthetic imagery with reduced compute overheads. Recent advances in…

图形学 · 计算机科学 2022-07-25 Nianchen Deng , Zhenyi He , Jiannan Ye , Budmonde Duinkharjav , Praneeth Chakravarthula , Xubo Yang , Qi Sun

Due to the omnipresence of Neural Radiance Fields (NeRFs), the interest towards editable implicit 3D representations has surged over the last years. However, editing implicit or hybrid representations as used for NeRFs is difficult due to…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Lukas Radl , Michael Steiner , Andreas Kurz , Markus Steinberger

Accurate representations of 3D faces are of paramount importance in various computer vision and graphics applications. However, the challenges persist due to the limitations imposed by data discretization and model linearity, which hinder…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Mingwu Zheng , Haiyu Zhang , Hongyu Yang , Liming Chen , Di Huang

Implicit neural rendering, especially Neural Radiance Field (NeRF), has shown great potential in novel view synthesis of a scene. However, current NeRF-based methods cannot enable users to perform user-controlled shape deformation in the…

图形学 · 计算机科学 2022-05-11 Yu-Jie Yuan , Yang-Tian Sun , Yu-Kun Lai , Yuewen Ma , Rongfei Jia , Lin Gao

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

NeRF is a popular model that efficiently represents 3D objects from 2D images. However, vanilla NeRF has some important limitations. NeRF must be trained on each object separately. The training time is long since we encode the object's…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Dominik Zimny , Artur Kasymov , Adam Kania , Jacek Tabor , Maciej Zięba , Marcin Mazur , Przemysław Spurek

Face rendering using neural radiance fields (NeRF) is a rapidly developing research area in computer vision. While recent methods primarily focus on controlling facial attributes such as identity and expression, they often overlook the…

计算机视觉与模式识别 · 计算机科学 2023-09-13 Hengfei Wang , Zhongqun Zhang , Yihua Cheng , Hyung Jin Chang

Recent advances in Neural Radiance Fields (NeRF) boast impressive performances for generative tasks such as novel view synthesis and 3D reconstruction. Methods based on neural radiance fields are able to represent the 3D world implicitly by…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Jesus Zarzar , Sara Rojas , Silvio Giancola , Bernard Ghanem

Neural Radiance Field (NeRF) and its variants have exhibited great success on representing 3D scenes and synthesizing photo-realistic novel views. However, they are generally based on the pinhole camera model and assume all-in-focus inputs.…

计算机视觉与模式识别 · 计算机科学 2022-08-02 Zijin Wu , Xingyi Li , Juewen Peng , Hao Lu , Zhiguo Cao , Weicai Zhong

Neural Radiance Fields (NeRFs) have revolutionized scene novel view synthesis, offering visually realistic, precise, and robust implicit reconstructions. While recent approaches enable NeRF editing, such as object removal, 3D shape…

计算机视觉与模式识别 · 计算机科学 2023-09-11 Robin Courant , Xi Wang , Marc Christie , Vicky Kalogeiton

We propose PAV, Personalized Head Avatar for the synthesis of human faces under arbitrary viewpoints and facial expressions. PAV introduces a method that learns a dynamic deformable neural radiance field (NeRF), in particular from a…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Akin Caliskan , Berkay Kicanaoglu , Hyeongwoo Kim

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

计算机视觉与模式识别 · 计算机科学 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

Recently 3D-aware GAN methods with neural radiance field have developed rapidly. However, current methods model the whole image as an overall neural radiance field, which limits the partial semantic editability of synthetic results. Since…

计算机视觉与模式识别 · 计算机科学 2023-04-11 Tianxiang Ma , Bingchuan Li , Qian He , Jing Dong , Tieniu Tan

Talking head generation aims to generate faces that maintain the identity information of the source image and imitate the motion of the driving image. Most pioneering methods rely primarily on 2D representations and thus will inevitably…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Weichuang Li , Longhao Zhang , Dong Wang , Bin Zhao , Zhigang Wang , Mulin Chen , Bang Zhang , Zhongjian Wang , Liefeng Bo , Xuelong Li

This paper introduces Motion-oriented Compositional Neural Radiance Fields (MoCo-NeRF), a framework designed to perform free-viewpoint rendering of monocular human videos via novel non-rigid motion modeling approach. In the context of…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Jaehyeok Kim , Dongyoon Wee , Dan Xu

We propose a novel 3D morphable model for complete human heads based on hybrid neural fields. At the core of our model lies a neural parametric representation that disentangles identity and expressions in disjoint latent spaces. To this…

计算机视觉与模式识别 · 计算机科学 2023-04-17 Simon Giebenhain , Tobias Kirschstein , Markos Georgopoulos , Martin Rünz , Lourdes Agapito , Matthias Nießner

Neural radiance fields enable state-of-the-art photorealistic view synthesis. However, existing radiance field representations are either too compute-intensive for real-time rendering or require too much memory to scale to large scenes. We…

计算机视觉与模式识别 · 计算机科学 2023-02-24 Christian Reiser , Richard Szeliski , Dor Verbin , Pratul P. Srinivasan , Ben Mildenhall , Andreas Geiger , Jonathan T. Barron , Peter Hedman

Neural Radiance Fields (NeRF) have achieved huge success in effectively capturing and representing 3D objects and scenes. However, to establish a ubiquitous presence in everyday media formats, such as images and videos, we need to fulfill…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Gyeongjin Kang , Younggeun Lee , Seungjun Oh , Eunbyung Park

CodeNeRF is an implicit 3D neural representation that learns the variation of object shapes and textures across a category and can be trained, from a set of posed images, to synthesize novel views of unseen objects. Unlike the original…

图形学 · 计算机科学 2021-09-07 Wonbong Jang , Lourdes Agapito

Neural Radiance Fields (NeRF) have demonstrated remarkable performance in novel view synthesis. However, there is much improvement room on restoring 3D scenes based on NeRF from corrupted images, which are common in natural scene captures…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Xianliang Huang , Zhizhou Zhong , Shuhang Chen , Yi Xu , Juhong Guan , Shuigeng Zhou