中文
相关论文

相关论文: Artist-Friendly Relightable and Animatable Neural …

200 篇论文

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

We propose PAV, Personalized Head Avatar for the synthesis of human faces under arbitrary viewpoints and facial expressions. PAV introduces a method that learns a dynamic deformable neural radiance field (NeRF), in particular from a…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Akin Caliskan , Berkay Kicanaoglu , Hyeongwoo Kim

Although there has been significant progress in neural radiance fields, an issue on dynamic illumination changes still remains unsolved. Different from relevant works that parameterize time-variant/-invariant components in scenes, subjects'…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Changyeon Won , Hyunjun Jung , Jungu Cho , Seonmi Park , Chi-Hoon Lee , Hae-Gon Jeon

We present PartNerFace, a part-based neural radiance fields approach, for reconstructing animatable facial avatar from monocular RGB videos. Existing solutions either simply condition the implicit network with the morphable model parameters…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Xianggang Yu , Lingteng Qiu , Xiaohang Ren , Guanying Chen , Shuguang Cui , Xiaoguang Han , Baoyuan Wang

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Dynamic Neural Radiance Fields (NeRFs) achieve remarkable visual quality when synthesizing novel views of time-evolving 3D scenes. However, the common reliance on backward deformation fields makes reanimation of the captured object poses…

计算机视觉与模式识别 · 计算机科学 2024-02-12 Lukas Uzolas , Elmar Eisemann , Petr Kellnhofer

Creating realistic virtual assets is a time-consuming process: it usually involves an artist designing the object, then spending a lot of effort on tweaking its appearance. Intricate details and certain effects, such as subsurface…

计算机视觉与模式识别 · 计算机科学 2022-12-13 Aljaž Božič , Denis Gladkov , Luke Doukakis , Christoph Lassner

Neural Radiance Field (NeRF) is a popular method in representing 3D scenes by optimising a continuous volumetric scene function. Its large success which lies in applying volumetric rendering (VR) is also its Achilles' heel in producing…

计算机视觉与模式识别 · 计算机科学 2023-05-11 Zhe Jun Tang , Tat-Jen Cham , Haiyu Zhao

Photorealistic rendering of dynamic humans is an important ability for telepresence systems, virtual shopping, synthetic data generation, and more. Recently, neural rendering methods, which combine techniques from computer graphics and…

计算机视觉与模式识别 · 计算机科学 2020-12-21 Ziyan Wang , Timur Bagautdinov , Stephen Lombardi , Tomas Simon , Jason Saragih , Jessica Hodgins , Michael Zollhöfer

We present the first neural relighting approach for rendering high-fidelity personalized hands that can be animated in real-time under novel illumination. Our approach adopts a teacher-student framework, where the teacher learns appearance…

计算机视觉与模式识别 · 计算机科学 2023-02-10 Shun Iwase , Shunsuke Saito , Tomas Simon , Stephen Lombardi , Timur Bagautdinov , Rohan Joshi , Fabian Prada , Takaaki Shiratori , Yaser Sheikh , Jason Saragih

We propose RANA, a relightable and articulated neural avatar for the photorealistic synthesis of humans under arbitrary viewpoints, body poses, and lighting. We only require a short video clip of the person to create the avatar and assume…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Umar Iqbal , Akin Caliskan , Koki Nagano , Sameh Khamis , Pavlo Molchanov , Jan Kautz

The ability to create realistic, animatable and relightable head avatars from casual video sequences would open up wide ranging applications in communication and entertainment. Current methods either build on explicit 3D morphable meshes…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Yufeng Zheng , Wang Yifan , Gordon Wetzstein , Michael J. Black , Otmar Hilliges

Neural Radiance Fields (NeRF) has gained significant attention for its prominent implicit 3D representation and realistic novel view synthesis capabilities. Available works unexceptionally employ straight-line volume rendering, which…

图形学 · 计算机科学 2025-08-20 Nan Luo , Chenglin Ye , Jiaxu Li , Gang Liu , Bo Wan , Di Wang , Lupeng Liu , Jun Xiao

Visually exploring in a real-world 4D spatiotemporal space freely in VR has been a long-term quest. The task is especially appealing when only a few or even single RGB cameras are used for capturing the dynamic scene. To this end, we…

计算机视觉与模式识别 · 计算机科学 2023-02-21 Liangchen Song , Anpei Chen , Zhong Li , Zhang Chen , Lele Chen , Junsong Yuan , Yi Xu , Andreas Geiger

Acquisition and rendering of photo-realistic human heads is a highly challenging research problem of particular importance for virtual telepresence. Currently, the highest quality is achieved by volumetric approaches trained in a person…

计算机视觉与模式识别 · 计算机科学 2021-01-08 Amit Raj , Michael Zollhoefer , Tomas Simon , Jason Saragih , Shunsuke Saito , James Hays , Stephen Lombardi

We propose a novel framework to reconstruct accurate appearance and geometry with neural radiance fields (NeRF) for interacting hands, enabling the rendering of photo-realistic images and videos for gesture animation from arbitrary views.…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Zhiyang Guo , Wengang Zhou , Min Wang , Li Li , Houqiang Li

We propose a method for synthesizing photo-realistic digital avatars from only one portrait as the reference. Given a portrait, our method synthesizes a coarse talking head video using driving keypoints features. And with the coarse video,…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Shaoxu Li

We present PrismAvatar: a 3D head avatar model which is designed specifically to enable real-time animation and rendering on resource-constrained edge devices, while still enjoying the benefits of neural volumetric rendering at training…

计算机视觉与模式识别 · 计算机科学 2025-02-12 Prashant Raina , Felix Taubner , Mathieu Tuli , Eu Wern Teh , Kevin Ferreira

Creating high-quality controllable 3D human models from multi-view RGB videos poses a significant challenge. Neural radiance fields (NeRFs) have demonstrated remarkable quality in reconstructing and free-viewpoint rendering of static as…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Paul Knoll , Wieland Morgenstern , Anna Hilsmann , Peter Eisert

Neural Radiance Fields (NeRF) are compelling techniques for modeling dynamic 3D scenes from 2D image collections. These volumetric representations would be well suited for synthesizing novel facial expressions but for two problems. First,…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Heng Yu , Koichiro Niinuma , Laszlo A. Jeni