中文
相关论文

相关论文: AvatarStudio: Text-driven Editing of 3D Dynamic Hu…

200 篇论文

In this paper, we propose a novel diffusion-based multi-condition controllable framework for video head swapping, which seamlessly transplant a human head from a static image into a dynamic video, while preserving the original body and…

计算机视觉与模式识别 · 计算机科学 2025-06-23 Chaonan Ji , Jinwei Qi , Peng Zhang , Bang Zhang , Liefeng Bo

We propose a method for synthesizing photo-realistic digital avatars from only one portrait as the reference. Given a portrait, our method synthesizes a coarse talking head video using driving keypoints features. And with the coarse video,…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Shaoxu Li

We present a novel pipeline for learning high-quality triangular human avatars from multi-view videos. Recent methods for avatar learning are typically based on neural radiance fields (NeRF), which is not compatible with traditional…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Yushuo Chen , Zerong Zheng , Zhe Li , Chao Xu , Yebin Liu

Face editing modifies the appearance of face, which plays a key role in customization and enhancement of personal images. Although much work have achieved remarkable success in text-driven face editing, they still face significant…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Xin Zhang , Siting Huang , Xiangyang Luo , Yifan Xie , Weijiang Yu , Heng Chang , Fei Ma , Fei Yu

We introduce a novel framework for 3D human avatar generation and personalization, leveraging text prompts to enhance user engagement and customization. Central to our approach are key innovations aimed at overcoming the challenges in…

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

Recently, several point-based image editing methods (e.g., DragDiffusion, FreeDrag, DragNoise) have emerged, yielding precise and high-quality results based on user instructions. However, these methods often make insufficient use of…

计算机视觉与模式识别 · 计算机科学 2024-12-04 DuoSheng Chen , Binghui Chen , Yifeng Geng , Liefeng Bo

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

计算机视觉与模式识别 · 计算机科学 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

We present a method that enables synthesizing novel views and novel poses of arbitrary human performers from sparse multi-view images. A key ingredient of our method is a hybrid appearance blending module that combines the advantages of the…

计算机视觉与模式识别 · 计算机科学 2023-04-12 Youngjoong Kwon , Dahun Kim , Duygu Ceylan , Henry Fuchs

Recent methods for synthesizing 3D-aware face images have achieved rapid development thanks to neural radiance fields, allowing for high quality and fast inference speed. However, existing solutions for editing facial geometry and…

图形学 · 计算机科学 2022-11-16 Kaiwen Jiang , Shu-Yu Chen , Feng-Lin Liu , Hongbo Fu , Lin Gao

Recent advances in generative diffusion models have enabled the previously unfeasible capability of generating 3D assets from a single input image or a text prompt. In this work, we aim to enhance the quality and functionality of these…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Xiyi Chen , Marko Mihajlovic , Shaofei Wang , Sergey Prokudin , Siyu Tang

Recent advancements in personalized image generation using diffusion models have been noteworthy. However, existing methods suffer from inefficiencies due to the requirement for subject-specific fine-tuning. This computationally intensive…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Xu Peng , Junwei Zhu , Boyuan Jiang , Ying Tai , Donghao Luo , Jiangning Zhang , Wei Lin , Taisong Jin , Chengjie Wang , Rongrong Ji

This paper presents a method that can quickly adapt dynamic 3D avatars to arbitrary text descriptions of novel styles. Among existing approaches for avatar stylization, direct optimization methods can produce excellent results for arbitrary…

计算机视觉与模式识别 · 计算机科学 2023-05-31 Thu Nguyen-Phuoc , Gabriel Schwartz , Yuting Ye , Stephen Lombardi , Lei Xiao

Recently, denoising diffusion models have achieved promising results in 2D image generation and editing. Instruct-NeRF2NeRF (IN2N) introduces the success of diffusion into 3D scene editing through an "Iterative dataset update" (IDU)…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Yuxuan Xiong , Yue Shi , Yishun Dou , Bingbing Ni

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views. Our method is based on a dynamic Neural Radiance Field (NeRF) rigged by…

计算机视觉与模式识别 · 计算机科学 2022-08-19 Gusi Te , Xiu Li , Xiao Li , Jinglu Wang , Wei Hu , Yan Lu

Recently, there has been a significant advancement in text-to-image diffusion models, leading to groundbreaking performance in 2D image generation. These advancements have been extended to 3D models, enabling the generation of novel 3D…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Jangho Park , Gihyun Kwon , Jong Chul Ye

Large text-to-image diffusion models have achieved remarkable success in generating diverse, high-quality images. Additionally, these models have been successfully leveraged to edit input images by just changing the text prompt. But when…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Anant Khandelwal

Rapid advances in the field of generative AI and text-to-image methods in particular have transformed the way we interact with and perceive computer-generated imagery today. In parallel, much progress has been made in 3D face…

计算机视觉与模式识别 · 计算机科学 2024-09-27 Mirela Ostrek , Justus Thies

For the last decades, the concern of producing convincing facial animation has garnered great interest, that has only been accelerating with the recent explosion of 3D content in both entertainment and professional activities. The use of…

图形学 · 计算机科学 2020-10-13 Eloïse Berson , Catherine Soladié , Nicolas Stoiber

We propose a simple yet effective pipeline for stylizing a 3D scene, harnessing the power of 2D image diffusion models. Given a NeRF model reconstructed from a set of multi-view images, we perform 3D style transfer by refining the source…

计算机视觉与模式识别 · 计算机科学 2024-09-05 Haruo Fujiwara , Yusuke Mukuta , Tatsuya Harada