English
Related papers

Related papers: Hyper Diffusion Avatars: Dynamic Human Avatar Gene…

200 papers

Animatable head avatar generation typically requires extensive data for training. To reduce the data requirements, a natural solution is to leverage existing data-free static avatar generation methods, such as pre-trained diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Zhenglin Zhou , Fan Ma , Hehe Fan , Tat-Seng Chua

Generating high-quality 360-degree views of human heads from single-view images is essential for enabling accessible immersive telepresence applications and scalable personalized content creation. While cutting-edge methods for full head…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuming Gu , Phong Tran , Yujian Zheng , Hongyi Xu , Heyuan Li , Adilbek Karmanov , Hao Li

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…

In this paper, we rethink text-to-avatar generative models by proposing TeRA, a more efficient and effective framework than the previous SDS-based models and general large 3D generative models. Our approach employs a two-stage training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Yanwen Wang , Yiyu Zhuang , Jiawei Zhang , Li Wang , Yifei Zeng , Xun Cao , Xinxin Zuo , Hao Zhu

Large-scale pre-trained vision-language models allow for the zero-shot text-based generation of 3D avatars. The previous state-of-the-art method utilized CLIP to supervise neural implicit models that reconstructed a human body mesh.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Shuo Huang , Zongxin Yang , Liangting Li , Yi Yang , Jia Jia

While diffusion models have shown great potential in portrait generation, generating expressive, coherent, and controllable cinematic portrait videos remains a significant challenge. Existing intermediate signals for portrait generation,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Junyi Wang , Yudong Guo , Boyang Guo , Shengming Yang , Juyong Zhang

This paper aims to generate physically-layered 3D humans from text prompts. Existing methods either generate 3D clothed humans as a whole or support only tight and simple clothing generation, which limits their applications to virtual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yi Wang , Jian Ma , Ruizhi Shao , Qiao Feng , Yu-kun Lai , Kun Li

The generation of high-quality, animatable 3D head avatars from text has enormous potential in content creation applications such as games, movies, and embodied virtual assistants. Current text-to-3D generation methods typically combine…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Yiqian Wu , Malte Prinzler , Xiaogang Jin , Siyu Tang

We introduce TurboPortrait3D: a method for low-latency novel-view synthesis of human portraits. Our approach builds on the observation that existing image-to-3D models for portrait generation, while capable of producing renderable 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Emily Kim , Julieta Martinez , Timur Bagautdinov , Jessica Hodgins

Existing methods for image-to-3D avatar generation struggle to produce highly detailed, animation-ready avatars suitable for real-world applications. We introduce AdaHuman, a novel framework that generates high-fidelity animatable 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Yangyi Huang , Ye Yuan , Xueting Li , Jan Kautz , Umar Iqbal

Recent advances in diffusion models such as ControlNet have enabled geometrically controllable, high-fidelity text-to-image generation. However, none of them addresses the question of adding such controllability to text-to-3D generation. In…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Sungwon Hwang , Junha Hyung , Jaegul Choo

Transfer learning has gained significant attention in recent deep learning research due to its ability to accelerate convergence and enhance performance on new tasks. However, its success is often contingent on the similarity between source…

Machine Learning · Computer Science 2024-10-28 Bedionita Soro , Bruno Andreis , Hayeon Lee , Wonyong Jeong , Song Chong , Frank Hutter , Sung Ju Hwang

Talking head generation creates lifelike avatars from static portraits for virtual communication and content creation. However, current models do not yet convey the feeling of truly interactive communication, often generating one-way…

Machine Learning · Computer Science 2026-01-05 Taekyung Ki , Sangwon Jang , Jaehyeong Jo , Jaehong Yoon , Sung Ju Hwang

Recent progress in diffusion models has significantly advanced the field of human image animation. While existing methods can generate temporally consistent results for short or regular motions, significant challenges remain, particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Shen Zheng , Jiaran Cai , Yuansheng Guan , Shenneng Huang , Xingpei Ma , Junjie Cao , Hanfeng Zhao , Qiang Zhang , Shunsi Zhang , Xiao-Ping Zhang

Capturing and editing full head performances enables the creation of virtual characters with various applications such as extended reality and media production. The past few years witnessed a steep rise in the photorealism of human head…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Mohit Mendiratta , Xingang Pan , Mohamed Elgharib , Kartik Teotia , Mallikarjun B R , Ayush Tewari , Vladislav Golyanik , Adam Kortylewski , Christian Theobalt

In this paper, we present a diffusion model-based framework for animating people from a single image for a given target 3D motion sequence. Our approach has two core components: a) learning priors about invisible parts of the human body and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Boyi Li , Junming Chen , Jathushan Rajasegaran , Yossi Gandelsman , Alexei A. Efros , Jitendra Malik

To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Xu Chen , Tianjian Jiang , Jie Song , Jinlong Yang , Michael J. Black , Andreas Geiger , Otmar Hilliges

Personalized text-to-image generation has gained significant attention for its capability to generate high-fidelity portraits of specific identities conditioned on user-defined prompts. Existing methods typically involve test-time…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yujia Wu , Yiming Shi , Jiwei Wei , Chengwei Sun , Yang Yang , Heng Tao Shen

Reconstructing photorealistic and dynamic portrait avatars from images is essential to many applications including advertising, visual effects, and virtual reality. Depending on the application, avatar reconstruction involves different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Felix Taubner , Ruihang Zhang , Mathieu Tuli , David B. Lindell

Generating high-fidelity upper-body 3D avatars from one-shot input image remains a significant challenge. Current 3D avatar generation methods, which rely on large reconstruction models, are fast and capable of producing stable body…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Fan Yang , Heyuan Li , Peihao Li , Weihao Yuan , Lingteng Qiu , Chaoyue Song , Cheng Chen , Yisheng He , Shifeng Zhang , Xiaoguang Han , Steven Hoi , Guosheng Lin