中文
相关论文

相关论文: AvatarStudio: Text-driven Editing of 3D Dynamic Hu…

200 篇论文

Recent advancements in diffusion models have shown remarkable proficiency in editing 2D images based on text prompts. However, extending these techniques to edit scenes in Neural Radiance Fields (NeRF) is complex, as editing individual 2D…

计算机视觉与模式识别 · 计算机科学 2024-08-02 Sara Rojas , Julien Philip , Kai Zhang , Sai Bi , Fujun Luan , Bernard Ghanem , Kalyan Sunkavall

Photo-real digital human avatars are of enormous importance in graphics, as they enable immersive communication over the globe, improve gaming and entertainment experiences, and can be particularly beneficial for AR and VR settings.…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Marc Habermann , Lingjie Liu , Weipeng Xu , Gerard Pons-Moll , Michael Zollhoefer , Christian Theobalt

We introduce AvatarForge, a framework for generating animatable 3D human avatars from text or image inputs using AI-driven procedural generation. While diffusion-based methods have made strides in general 3D object generation, they struggle…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Xinhang Liu , Yu-Wing Tai , Chi-Keung Tang

Pose and body shape editing in a human image has received increasing attention. However, current methods often struggle with dataset biases and deteriorate realism and the person's identity when users make large edits. We propose a one-shot…

计算机视觉与模式识别 · 计算机科学 2024-01-09 Yuta Okuyama , Yuki Endo , Yoshihiro Kanamori

We present a new approach for video-driven animation of high-quality neural 3D head models, addressing the challenge of person-independent animation from video input. Typically, high-quality generative models are learned for specific…

计算机视觉与模式识别 · 计算机科学 2024-03-08 Wolfgang Paier , Paul Hinzer , Anna Hilsmann , Peter Eisert

Neural volume rendering enables photo-realistic renderings of a human performer in free-view, a critical task in immersive VR/AR applications. But the practice is severely limited by high computational costs in the rendering process. To…

计算机视觉与模式识别 · 计算机科学 2023-03-06 Yue Chen , Xuan Wang , Xingyu Chen , Qi Zhang , Xiaoyu Li , Yu Guo , Jue Wang , Fei Wang

Neural radiance fields (NeRF) achieve highly photo-realistic novel-view synthesis, but it's a challenging problem to edit the scenes modeled by NeRF-based methods, especially for dynamic scenes. We propose editable neural radiance fields…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Chengwei Zheng , Wenbin Lin , Feng Xu

The generation of high-quality, animatable 3D head avatars from text has enormous potential in content creation applications such as games, movies, and embodied virtual assistants. Current text-to-3D generation methods typically combine…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Yiqian Wu , Malte Prinzler , Xiaogang Jin , Siyu Tang

Due to the increasing demand in films and games, synthesizing 3D avatar animation has attracted much attention recently. In this work, we present a production-ready text/speech-driven full-body animation synthesis system. Given the text and…

图形学 · 计算机科学 2022-06-01 Wenlin Zhuang , Jinwei Qi , Peng Zhang , Bang Zhang , Ping Tan

We present DreamHuman, a method to generate realistic animatable 3D human avatar models solely from textual descriptions. Recent text-to-3D methods have made considerable strides in generation, but are still lacking in important aspects.…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Nikos Kolotouros , Thiemo Alldieck , Andrei Zanfir , Eduard Gabriel Bazavan , Mihai Fieraru , Cristian Sminchisescu

We present NeRFEditor, an efficient learning framework for 3D scene editing, which takes a video captured over 360{\deg} as input and outputs a high-quality, identity-preserving stylized 3D scene. Our method supports diverse types of…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Chunyi Sun , Yanbin Liu , Junlin Han , Stephen Gould

We present Dynamic Neural Portraits, a novel approach to the problem of full-head reenactment. Our method generates photo-realistic video portraits by explicitly controlling head pose, facial expressions and eye gaze. Our proposed…

计算机视觉与模式识别 · 计算机科学 2022-11-28 Michail Christos Doukas , Stylianos Ploumpis , Stefanos Zafeiriou

We propose PAV, Personalized Head Avatar for the synthesis of human faces under arbitrary viewpoints and facial expressions. PAV introduces a method that learns a dynamic deformable neural radiance field (NeRF), in particular from a…

计算机视觉与模式识别 · 计算机科学 2024-08-01 Akin Caliskan , Berkay Kicanaoglu , Hyeongwoo Kim

Animating stylized avatars with dynamic poses and expressions has attracted increasing attention for its broad range of applications. Previous research has made significant progress by training controllable generative models to synthesize…

We present Instant Volumetric Head Avatars (INSTA), a novel approach for reconstructing photo-realistic digital avatars instantaneously. INSTA models a dynamic neural radiance field based on neural graphics primitives embedded around a…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Wojciech Zielonka , Timo Bolkart , Justus Thies

Synthesizing photorealistic 4D human head avatars from videos is essential for VR/AR, telepresence, and video game applications. Although existing Neural Radiance Fields (NeRF)-based methods achieve high-fidelity results, the computational…

图形学 · 计算机科学 2023-11-29 Hao-Bin Duan , Miao Wang , Jin-Chuan Shi , Xu-Chuan Chen , Yan-Pei Cao

While neural fields have made significant strides in view synthesis and scene reconstruction, editing them poses a formidable challenge due to their implicit encoding of geometry and texture information from multi-view inputs. In this…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Umar Khalid , Hasan Iqbal , Nazmul Karim , Jing Hua , Chen Chen

Real-time, streaming interactive avatars represent a critical yet challenging goal in digital human research. Although diffusion-based human avatar generation methods achieve remarkable success, their non-causal architecture and high…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Zhiyao Sun , Ziqiao Peng , Yifeng Ma , Yi Chen , Zhengguang Zhou , Zixiang Zhou , Guozhen Zhang , Youliang Zhang , Yuan Zhou , Qinglin Lu , Yong-Jin Liu

In this paper, we propose HeadNeRF, a novel NeRF-based parametric head model that integrates the neural radiance field to the parametric representation of the human head. It can render high fidelity head images in real-time on modern GPUs,…

计算机视觉与模式识别 · 计算机科学 2022-05-03 Yang Hong , Bo Peng , Haiyao Xiao , Ligang Liu , Juyong Zhang

We present a novel approach for generating animatable 3D-aware art avatars from a single image, with controllable facial expressions, head poses, and shoulder movements. Unlike previous reenactment methods, our approach utilizes a…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Shaoxu Li