中文
相关论文

相关论文: PERSE: Personalized 3D Generative Avatars from A S…

200 篇论文

Modeling animatable human avatars from RGB videos is a long-standing and challenging problem. Recent works usually adopt MLP-based neural radiance fields (NeRF) to represent 3D humans, but it remains difficult for pure MLPs to regress…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Zhe Li , Yipengjing Sun , Zerong Zheng , Lizhen Wang , Shengping Zhang , Yebin Liu

Digital human avatars aim to simulate the dynamic appearance of humans in virtual environments, enabling immersive experiences across gaming, film, virtual reality, and more. However, the conventional process for creating and animating…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Felix Taubner , Ruihang Zhang , Mathieu Tuli , Sherwin Bahmani , David B. Lindell

In this paper, we present a diffusion model-based framework for animating people from a single image for a given target 3D motion sequence. Our approach has two core components: a) learning priors about invisible parts of the human body and…

计算机视觉与模式识别 · 计算机科学 2024-12-23 Boyi Li , Junming Chen , Jathushan Rajasegaran , Yossi Gandelsman , Alexei A. Efros , Jitendra Malik

One-shot video-driven talking face generation aims at producing a synthetic talking video by transferring the facial motion from a video to an arbitrary portrait image. Head pose and facial expression are always entangled in facial motion…

计算机视觉与模式识别 · 计算机科学 2023-03-03 Youxin Pang , Yong Zhang , Weize Quan , Yanbo Fan , Xiaodong Cun , Ying Shan , Dong-ming Yan

We present a new pose transfer method for synthesizing a human animation from a single image of a person controlled by a sequence of body poses. Existing pose transfer methods exhibit significant visual artifacts when applying to a novel…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Jae Shin Yoon , Lingjie Liu , Vladislav Golyanik , Kripasindhu Sarkar , Hyun Soo Park , Christian Theobalt

In video understanding tasks, particularly those involving human motion, synthetic data generation often suffers from uncanny features, diminishing its effectiveness for training. Tasks such as sign language translation, gesture…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Vaclav Knapp , Matyas Bohacek

In this paper, we propose to create animatable avatars for interacting hands with 3D Gaussian Splatting (GS) and single-image inputs. Existing GS-based methods designed for single subjects often yield unsatisfactory results due to limited…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Xuan Huang , Hanhui Li , Wanquan Liu , Xiaodan Liang , Yiqiang Yan , Yuhao Cheng , Chengqiang Gao

Although neural rendering has made significant advances in creating lifelike, animatable full-body and head avatars, incorporating detailed expressions into full-body avatars remains largely unexplored. We present DEGAS, the first 3D…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Zhijing Shao , Duotun Wang , Qing-Yao Tian , Yao-Dong Yang , Hengyu Meng , Zeyu Cai , Bo Dong , Yu Zhang , Kang Zhang , Zeyu Wang

Similar to facial beautification in real life, 3D virtual avatars require personalized customization to enhance their visual appeal, yet this area remains insufficiently explored. Although current 3D Gaussian editing methods can be adapted…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Yiming Zhong , Xiaolin Zhang , Ligang Liu , Yao Zhao , Yunchao Wei

We propose a neural rendering-based system that creates head avatars from a single photograph. Our approach models a person's appearance by decomposing it into two layers. The first layer is a pose-dependent coarse image that is synthesized…

计算机视觉与模式识别 · 计算机科学 2020-08-25 Egor Zakharov , Aleksei Ivakhnenko , Aliaksandra Shysheya , Victor Lempitsky

The recent advancements in image-text diffusion models have stimulated research interest in large-scale 3D generative models. Nevertheless, the limited availability of diverse 3D resources presents significant challenges to learning. In…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Chi Zhang , Yiwen Chen , Yijun Fu , Zhenglin Zhou , Gang YU , Billzb Wang , Bin Fu , Tao Chen , Guosheng Lin , Chunhua Shen

Recently, synthesizing personalized characters from a single user-given portrait has received remarkable attention as a drastic popularization of social media and the metaverse. The input image is not always in frontal view, thus it is…

计算机视觉与模式识别 · 计算机科学 2022-07-12 Jeong-gi Kwak , Yuanming Li , Dongsik Yoon , David Han , Hanseok Ko

Facial editing is an important task with applications in entertainment, virtual reality, and digital avatars. Most existing approaches rely on generative models in the 2D image domain, while in 3D the task is typically performed through…

In this paper, we propose an approach to obtain a personalized generative prior with explicit control over a set of attributes. We build upon MyStyle, a recently introduced method, that tunes the weights of a pre-trained StyleGAN face…

计算机视觉与模式识别 · 计算机科学 2023-10-12 Libing Zeng , Lele Chen , Yi Xu , Nima Kalantari

Our goal is to create a realistic 3D facial avatar with hair and accessories using only a text description. While this challenge has attracted significant recent interest, existing methods either lack realism, produce unrealistic shapes, or…

计算机视觉与模式识别 · 计算机科学 2023-09-14 Hao Zhang , Yao Feng , Peter Kulits , Yandong Wen , Justus Thies , Michael J. Black

Recent advances in Gaussian Splatting have significantly boosted the reconstruction of head avatars, enabling high-quality facial modeling by representing an 3D avatar as a collection of 3D Gaussians. However, existing methods predominantly…

计算机视觉与模式识别 · 计算机科学 2025-08-29 Shiqi Xin , Xiaolin Zhang , Yanbin Liu , Peng Zhang , Caifeng Shan

Face photo synthesis from simple line drawing is a one-to-many task as simple line drawing merely contains the contour of human face. Previous exemplar-based methods are over-dependent on the datasets and are hard to generalize to…

计算机视觉与模式识别 · 计算机科学 2017-02-10 Qi Guo , Ce Zhu , Zhiqiang Xia , Zhengtao Wang , Yipeng Liu

Generating portrait images by controlling the motions of existing faces is an important task of great consequence to social media industries. For easy use and intuitive control, semantically meaningful and fully disentangled parameters…

计算机视觉与模式识别 · 计算机科学 2021-09-20 Yurui Ren , Ge Li , Yuanqi Chen , Thomas H. Li , Shan Liu

The field of photorealistic 3D avatar reconstruction and generation has garnered significant attention in recent years; however, animating such avatars remains challenging. Recent advances in diffusion models have notably enhanced the…

Diffusion-based models have gained wide adoption in the virtual human generation due to their outstanding expressiveness. However, their substantial computational requirements have constrained their deployment in real-time interactive…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Haojie Yu , Zhaonian Wang , Yihan Pan , Meng Cheng , Hao Yang , Chao Wang , Tao Xie , Xiaoming Xu , Xiaoming Wei , Xunliang Cai