English
Related papers

Related papers: OTAvatar: One-shot Talking Face Avatar with Contro…

200 papers

We present a novel framework for generating high-quality, animatable 4D avatar from a single image. While recent advances have shown promising results in 4D avatar creation, existing methods either require extensive multiview data or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Fei Yin , Mallikarjun B R , Chun-Han Yao , Rafał Mantiuk , Varun Jampani

The human face is central to communication. For immersive applications, the digital presence of a person should mirror the physical reality, capturing the users idiosyncrasies and detailed facial expressions. However, current 3D head avatar…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Jalees Nehvi , Timo Bolkart , Thabo Beeler , Justus Thies

Audio-driven 3D talking avatar generation is increasingly important in virtual communication, digital humans, and interactive media, where avatars must preserve identity, synchronize lip motion with speech, express emotion, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Zhongju Wang , Zhenhong Sun , Beier Wang , Yifu Wang , Daoyi Dong , Huadong Mo , Hongdong Li

The ability to create realistic, animatable and relightable head avatars from casual video sequences would open up wide ranging applications in communication and entertainment. Current methods either build on explicit 3D morphable meshes…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yufeng Zheng , Wang Yifan , Gordon Wetzstein , Michael J. Black , Otmar Hilliges

Traditional methods for constructing high-quality, personalized head avatars from monocular videos demand extensive face captures and training time, posing a significant challenge for scalability. This paper introduces a novel approach to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Zhixuan Yu , Ziqian Bai , Abhimitra Meka , Feitong Tan , Qiangeng Xu , Rohit Pandey , Sean Fanello , Hyun Soo Park , Yinda Zhang

With the booming of virtual reality (VR) technology, there is a growing need for customized 3D avatars. However, traditional methods for 3D avatar modeling are either time-consuming or fail to retain similarity to the person being modeled.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Chuanyu Pan , Guowei Yang , Taijiang Mu , Yu-Kun Lai

Creating high-fidelity, animatable 3D avatars from a single image remains a formidable challenge. We identified three desirable attributes of avatar generation: 1) the method should be feed-forward, 2) model a 360{\deg} full-head, and 3)…

Graphics · Computer Science 2026-02-13 Zehao Xia , Yiqun Wang , Zhengda Lu , Kai Liu , Jun Xiao , Peter Wonka

We present FastAvatar, a fast and robust algorithm for single-image 3D face reconstruction using 3D Gaussian Splatting (3DGS). Given a single input image from an arbitrary pose, FastAvatar recovers a high-quality, full-head 3DGS avatar in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Hao Liang , Zhixuan Ge , Soumendu Majee , Ashish Tiwari , G. M. Dilshan Godaliyadda , Ashok Veeraraghavan , Guha Balakrishnan

We propose TextToon, a method to generate a drivable toonified avatar. Given a short monocular video sequence and a written instruction about the avatar style, our model can generate a high-fidelity toonified avatar that can be driven in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Luchuan Song , Lele Chen , Celong Liu , Pinxin Liu , Chenliang Xu

SmartAvatar is a vision-language-agent-driven framework for generating fully rigged, animation-ready 3D human avatars from a single photo or textual prompt. While diffusion-based methods have made progress in general 3D object generation,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Alexander Huang-Menders , Xinhang Liu , Andy Xu , Yuyao Zhang , Chi-Keung Tang , Yu-Wing Tai

While high fidelity and efficiency are central to the creation of digital head avatars, recent methods relying on 2D or 3D generative models often experience limitations such as shape distortion, expression inaccuracy, and identity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaochen Zhao , Jingxiang Sun , Lizhen Wang , Jinli Suo , Yebin Liu

Recent years have witnessed considerable achievements in facial avatar reconstruction with neural volume rendering. Despite notable advancements, the reconstruction of complex and dynamic head movements from monocular videos still suffers…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Luchuan Song , Pinxin Liu , Lele Chen , Guojun Yin , Chenliang Xu

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

Significant progress has been made in audio-driven human animation, while most existing methods focus mainly on facial movements, limiting their ability to create full-body animations with natural synchronization and fluidity. They also…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Qijun Gan , Ruizi Yang , Jianke Zhu , Shaofei Xue , Steven Hoi

Despite significant progress in 3D avatar reconstruction, it still faces challenges such as high time complexity, sensitivity to data quality, and low data utilization. We propose FastAvatar, a feedforward 3D avatar framework capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yue Wu , Xuanhong Chen , Yufan Wu , Wen Li , Yuxi Lu , Kairui Feng

Face reenactment methods attempt to restore and re-animate portrait videos as realistically as possible. Existing methods face a dilemma in quality versus controllability: 2D GAN-based methods achieve higher image quality but suffer in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Lizhen Wang , Xiaochen Zhao , Jingxiang Sun , Yuxiang Zhang , Hongwen Zhang , Tao Yu , Yebin Liu

Audio-driven talking face generation is a challenging task in digital communication. Despite significant progress in the area, most existing methods concentrate on audio-lip synchronization, often overlooking aspects such as visual quality,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Fatemeh Nazarieh , Zhenhua Feng , Diptesh Kanojia , Muhammad Awais , Josef Kittler

We propose PFAvatar (Pose-Fusion Avatar), a new method that reconstructs high-quality 3D avatars from Outfit of the Day(OOTD) photos, which exhibit diverse poses, occlusions, and complex backgrounds. Our method consists of two stages: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Dianbing Xi , Guoyuan An , Jingsen Zhu , Zhijian Liu , Yuan Liu , Ruiyuan Zhang , Jiayuan Lu , Yuchi Huo , Rui Wang

Recently, animating portrait images using audio input is a popular task. Creating lifelike talking head videos requires flexible and natural movements, including facial and head dynamics, camera motion, realistic light and shadow effects.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Wenzhang Sun , Xiang Li , Donglin Di , Zhuding Liang , Qiyuan Zhang , Hao Li , Wei Chen , Jianxun Cui

The paper introduces AniTalker, an innovative framework designed to generate lifelike talking faces from a single portrait. Unlike existing models that primarily focus on verbal cues such as lip synchronization and fail to capture the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Tao Liu , Feilong Chen , Shuai Fan , Chenpeng Du , Qi Chen , Xie Chen , Kai Yu