English
Related papers

Related papers: DreamFace: Progressive Generation of Animatable 3D…

200 papers

The emergence of virtual reality has necessitated the generation of detailed and customizable 3D hand models for interaction in the virtual world. However, the current methods for 3D hand model generation are both expensive and cumbersome,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Green Rosh , Prateek Kukreja , Vishakha SR , Pawan Prasad B H

We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Francesca Babiloni , Alexandros Lattas , Jiankang Deng , Stefanos Zafeiriou

Recent remarkable advances in large-scale text-to-image diffusion models have inspired a significant breakthrough in text-to-3D generation, pursuing 3D content creation solely from a given text prompt. However, existing text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yang Chen , Yingwei Pan , Yehao Li , Ting Yao , Tao Mei

Recently, emotional talking face generation has received considerable attention. However, existing methods only adopt one-hot coding, image, or audio as emotion conditions, thus lacking flexible control in practical applications and failing…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chao Xu , Junwei Zhu , Jiangning Zhang , Yue Han , Wenqing Chu , Ying Tai , Chengjie Wang , Zhifeng Xie , Yong Liu

Audio-driven 3D facial animation has achieved significant progress in both research and applications. While recent baselines struggle to generate natural and continuous facial movements due to their frame-by-frame vertex generation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Xuanmeng Sha , Liyun Zhang , Tomohiro Mashita , Naoya Chiba , Yuki Uranishi

Text-to-Avatar generation has recently made significant strides due to advancements in diffusion models. However, most existing work remains constrained by limited diversity, producing avatars with subtle differences in appearance for a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Weijing Tao , Biwen Lei , Kunhao Liu , Shijian Lu , Miaomiao Cui , Xuansong Xie , Chunyan Miao

Although existing speech-driven talking face generation methods achieve significant progress, they are far from real-world application due to the avatar-specific training demand and unstable lip movements. To address the above issues, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Haiming Zhang , Zhihao Yuan , Chaoda Zheng , Xu Yan , Baoyuan Wang , Guanbin Li , Song Wu , Shuguang Cui , Zhen Li

Creating animatable 3D avatars from a single image remains challenging due to style limitations (realistic, cartoon, anime) and difficulties in handling accessories or hairstyles. While 3D diffusion models advance single-view reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Tingting Liao , Yujian Zheng , Adilbek Karmanov , Liwen Hu , Leyang Jin , Yuliang Xiu , Hao Li

Generating realistic talking faces is an interesting and long-standing topic in the field of computer vision. Although significant progress has been made, it is still challenging to generate high-quality dynamic faces with personalized…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Bo Ding , Zhenfeng Fan , Shuang Yang , Shihong Xia

Previous animatable 3D-aware GANs for human generation have primarily focused on either the human head or full body. However, head-only videos are relatively uncommon in real life, and full body generation typically does not deal with…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yue Wu , Sicheng Xu , Jianfeng Xiang , Fangyun Wei , Qifeng Chen , Jiaolong Yang , Xin Tong

Transferring appearance to 3D assets using different representations of the appearance object - such as images or text - has garnered interest due to its wide range of applications in industries like gaming, augmented reality, and digital…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Sayan Deb Sarkar , Sinisa Stekovic , Vincent Lepetit , Iro Armeni

Facial attribute editing plays a crucial role in synthesizing realistic faces with specific characteristics while maintaining realistic appearances. Despite advancements, challenges persist in achieving precise, 3D-aware attribute…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yu-Kai Huang , Yutong Zheng , Yen-Shuo Su , Anudeepsekhar Bolimera , Han Zhang , Fangyi Chen , Marios Savvides

Diffusion-based video generation techniques have significantly improved zero-shot talking-head avatar generation, enhancing the naturalness of both head motion and facial expressions. However, existing methods suffer from poor…

Graphics · Computer Science 2025-04-24 Lingzhou Mu , Baiji Liu , Ruonan Zhang , Guiming Mo , Jiawei Jin , Kai Zhang , Haozhi Huang

Our goal is to create a realistic 3D facial avatar with hair and accessories using only a text description. While this challenge has attracted significant recent interest, existing methods either lack realism, produce unrealistic shapes, or…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Hao Zhang , Yao Feng , Peter Kulits , Yandong Wen , Justus Thies , Michael J. Black

Generating realistic 3D faces is of high importance for computer graphics and computer vision applications. Generally, research on 3D face generation revolves around linear statistical models of the facial surface. Nevertheless, these…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Baris Gecer , Alexander Lattas , Stylianos Ploumpis , Jiankang Deng , Athanasios Papaioannou , Stylianos Moschoglou , Stefanos Zafeiriou

We present TextureDreamer, a novel image-guided texture synthesis method to transfer relightable textures from a small number of input images (3 to 5) to target 3D shapes across arbitrary categories. Texture creation is a pivotal challenge…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yu-Ying Yeh , Jia-Bin Huang , Changil Kim , Lei Xiao , Thu Nguyen-Phuoc , Numair Khan , Cheng Zhang , Manmohan Chandraker , Carl S Marshall , Zhao Dong , Zhengqin Li

Generating articulated objects, such as laptops and microwaves, is a crucial yet challenging task with extensive applications in Embodied AI and AR/VR. Current image-to-3D methods primarily focus on surface geometry and texture, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Ruijie Lu , Yu Liu , Jiaxiang Tang , Junfeng Ni , Yuxiang Wang , Diwen Wan , Gang Zeng , Yixin Chen , Siyuan Huang

In facial image generation, current text-to-image models often suffer from facial attribute leakage and insufficient physical consistency when responding to local semantic instructions. In this study, we propose Face-MakeUpV2, a facial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Dawei Dai , Yinxiu Zhou , Chenghang Li , Guolai Jiang , Chengfang Zhang

Scene text synthesis involves rendering specified texts onto arbitrary images. Current methods typically formulate this task in an end-to-end manner but lack effective character-level guidance during training. Besides, their text encoders,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yibin Wang , Weizhong Zhang , Honghui Xu , Cheng Jin

Drawing upon StyleGAN's expressivity and disentangled latent space, existing 2D approaches employ textual prompting to edit facial images with different attributes. In contrast, 3D-aware approaches that generate faces at different target…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Amandeep Kumar , Muhammad Awais , Sanath Narayan , Hisham Cholakkal , Salman Khan , Rao Muhammad Anwer