English
Related papers

Related papers: One-shot Compositional 3D Head Avatars with Deform…

200 papers

We propose an audio-driven talking-head method to generate photo-realistic talking-head videos from a single reference image. In this work, we tackle two key challenges: (i) producing natural head motions that match speech prosody, and (ii)…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Suzhen Wang , Lincheng Li , Yu Ding , Changjie Fan , Xin Yu

Our goal is to create a realistic 3D facial avatar with hair and accessories using only a text description. While this challenge has attracted significant recent interest, existing methods either lack realism, produce unrealistic shapes, or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Hao Zhang , Yao Feng , Peter Kulits , Yandong Wen , Justus Thies , Michael J. Black

Recent advancements in learning techniques that employ coordinate-based neural representations have yielded remarkable results in multi-view 3D reconstruction tasks. However, these approaches often require a substantial number of input…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Pol Caselles , Eduard Ramon , Jaime Garcia , Gil Triginer , Francesc Moreno-Noguer

Reconstructing high-fidelity, animatable 3D head avatars from effortlessly captured monocular videos is a pivotal yet formidable challenge. Although significant progress has been made in rendering performance and manipulation capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Jiawei Zhang , Zijian Wu , Zhiyang Liang , Yicheng Gong , Dongfang Hu , Yao Yao , Xun Cao , Hao Zhu

The one-shot talking-head synthesis task aims to animate a source image to another pose and expression, which is dictated by a driving frame. Recent methods rely on warping the appearance feature extracted from the source, by using motion…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Kangning Liu , Yu-Chuan Su , Wei , Hong , Ruijin Cang , Xuhui Jia

We introduce a deep learning-based method to generate full 3D hair geometry from an unconstrained image. Our method can recover local strand details and has real-time performance. State-of-the-art hair modeling techniques rely on large…

Graphics · Computer Science 2018-07-12 Yi Zhou , Liwen Hu , Jun Xing , Weikai Chen , Han-Wei Kung , Xin Tong , Hao Li

In this paper, we present a novel method that facilitates the creation of vivid 3D Gaussian avatars from monocular video inputs (GVA). Our innovation lies in addressing the intricate challenges of delivering high-fidelity human body…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Xinqi Liu , Chenming Wu , Jialun Liu , Xing Liu , Jinbo Wu , Chen Zhao , Haocheng Feng , Errui Ding , Jingdong Wang

We introduce Hair-GANs, an architecture of generative adversarial networks, to recover the 3D hair structure from a single image. The goal of our networks is to build a parametric transformation from 2D hair maps to 3D hair structure. The…

Graphics · Computer Science 2018-11-16 Meng Zhang , Youyi Zheng

We propose a method to learn a high-quality implicit 3D head avatar from a monocular RGB video captured in the wild. The learnt avatar is driven by a parametric face model to achieve user-controlled facial expressions and head poses. Our…

Creating digital avatars from textual prompts has long been a desirable yet challenging task. Despite the promising results achieved with 2D diffusion priors, current methods struggle to create high-quality and consistent animated avatars…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Zhenglin Zhou , Fan Ma , Hehe Fan , Zongxin Yang , Yi Yang

Here we introduce three-dimensional single-shot ptychography (3DSSP). 3DSSP leverages an additional constraint unique to the single-shot geometry to deconvolve multiple 2D planes of a 3D object. Numeric simulations and analytic calculations…

Image and Video Processing · Electrical Eng. & Systems 2020-07-15 David Goldberger , Jonathan Barolak , Charles G. Durfee , Daniel E. Adams

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

Neural radiance fields are capable of reconstructing high-quality drivable human avatars but are expensive to train and render and not suitable for multi-human scenes with complex shadows. To reduce consumption, we propose Animatable 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Yang Liu , Xiang Huang , Minghan Qin , Qinwei Lin , Haoqian Wang

Audio-driven talking head generation is advancing from 2D to 3D content. Notably, Neural Radiance Field (NeRF) is in the spotlight as a means to synthesize high-quality 3D talking head outputs. Unfortunately, this NeRF-based approach…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Gihoon Kim , Kwanggyoon Seo , Sihun Cha , Junyong Noh

Hand-drawn character animation is a vibrant field in computer graphics, presenting challenges in achieving geometric consistency while conveying expressive motion. Traditional skeletal animation methods maintain geometric consistency but…

Graphics · Computer Science 2025-09-09 Jie Zhou , Linzi Qu , Miu-Ling Lam , Hongbo Fu

In this paper we present a new deep learning-driven approach to image-based synthesis of animations involving humanoid characters. Unlike previous deep approaches to image-based animation our method makes no assumptions on the type of…

Graphics · Computer Science 2019-08-14 John Kanji , David I. W. Levin

We propose PFAvatar (Pose-Fusion Avatar), a new method that reconstructs high-quality 3D avatars from Outfit of the Day(OOTD) photos, which exhibit diverse poses, occlusions, and complex backgrounds. Our method consists of two stages: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Dianbing Xi , Guoyuan An , Jingsen Zhu , Zhijian Liu , Yuan Liu , Ruiyuan Zhang , Jiayuan Lu , Yuchi Huo , Rui Wang

We introduce a novel framework for modeling high-fidelity, animatable 3D human avatars from motion-blurred monocular video inputs. Motion blur is prevalent in real-world dynamic video capture, especially due to human movements in 3D human…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Xianrui Luo , Juewen Peng , Zhongang Cai , Lei Yang , Fan Yang , Zhiguo Cao , Guosheng Lin

While there has been significant progress in the field of 3D avatar creation from visual observations, modeling physically plausible dynamics of humans with loose garments remains a challenging problem. Although a few existing works address…

Graphics · Computer Science 2025-10-03 Changmin Lee , Jihyun Lee , Tae-Kyun Kim

A key challenge in 3D talking head synthesis lies in the reliance on a long-duration talking head video to train a new model for each target identity from scratch. Recent methods have attempted to address this issue by extracting general…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Yuhang Guo , Kaijun Deng , Siyang Song , Jindong Xie , Wenhui Ma , Linlin Shen