English
Related papers

Related papers: DreamAvatar: Text-and-Shape Guided 3D Human Avatar…

200 papers

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

Generating high-fidelity upper-body 3D avatars from one-shot input image remains a significant challenge. Current 3D avatar generation methods, which rely on large reconstruction models, are fast and capable of producing stable body…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Fan Yang , Heyuan Li , Peihao Li , Weihao Yuan , Lingteng Qiu , Chaoyue Song , Cheng Chen , Yisheng He , Shifeng Zhang , Xiaoguang Han , Steven Hoi , Guosheng Lin

We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yushi Lan , Feitong Tan , Di Qiu , Qiangeng Xu , Kyle Genova , Zeng Huang , Sean Fanello , Rohit Pandey , Thomas Funkhouser , Chen Change Loy , Yinda Zhang

Creating high-fidelity 3D head avatars has always been a research hotspot, but it remains a great challenge under lightweight sparse view setups. In this paper, we propose HHAvatar represented by controllable 3D Gaussians for high-fidelity…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zhanfeng Liao , Yuelang Xu , Zhe Li , Qijing Li , Boyao Zhou , Ruifeng Bai , Di Xu , Hongwen Zhang , Yebin Liu

Creating 3D head avatars is a significant yet challenging task for many applicated scenarios. Previous studies have set out to learn 3D human head generative models using massive 2D image data. Although these models are highly generalizable…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yiyu Zhuang , Yuxiao He , Jiawei Zhang , Yanwen Wang , Jiahe Zhu , Yao Yao , Siyu Zhu , Xun Cao , Hao Zhu

The field of photorealistic 3D avatar reconstruction and generation has garnered significant attention in recent years; however, animating such avatars remains challenging. Recent advances in diffusion models have notably enhanced the…

Text-driven avatar generation has gained significant attention owing to its convenience. However, existing methods typically model the human body with all garments as a single 3D model, limiting its usability, such as clothing replacement,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Jingyu Zhuang , Di Kang , Linchao Bao , Liang Lin , Guanbin Li

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

Recently, 2D speaking avatars have increasingly participated in everyday scenarios due to the fast development of facial animation techniques. However, most existing works neglect the explicit control of human bodies. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jiazhi Guan , Quanwei Yang , Kaisiyuan Wang , Hang Zhou , Shengyi He , Zhiliang Xu , Haocheng Feng , Errui Ding , Jingdong Wang , Hongtao Xie , Youjian Zhao , Ziwei Liu

Human video generation task has gained significant attention with the advancement of deep generative models. Generating realistic videos with human movements is challenging in nature, due to the intricacies of human body topology and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhangsihao Yang , Mengyi Shan , Mohammad Farazi , Wenhui Zhu , Yanxi Chen , Xuanzhao Dong , Yalin Wang

In this paper, we present a diffusion model-based framework for animating people from a single image for a given target 3D motion sequence. Our approach has two core components: a) learning priors about invisible parts of the human body and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Boyi Li , Junming Chen , Jathushan Rajasegaran , Yossi Gandelsman , Alexei A. Efros , Jitendra Malik

3D human avatar animation aims at transforming a human avatar from an arbitrary initial pose to a specified target pose using deformation algorithms. Existing approaches typically divide this task into two stages: canonical template…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jian Shu , Nanjie Yao , Gangjian Zhang , Junlong Ren , Yu Feng , Hao Wang

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…

Head avatar reconstruction, crucial for applications in virtual reality, online meetings, gaming, and film industries, has garnered substantial attention within the computer vision community. The fundamental objective of this field is to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Xuangeng Chu , Yu Li , Ailing Zeng , Tianyu Yang , Lijian Lin , Yunfei Liu , Tatsuya Harada

Synthesizing photorealistic 4D human head avatars from videos is essential for VR/AR, telepresence, and video game applications. Although existing Neural Radiance Fields (NeRF)-based methods achieve high-fidelity results, the computational…

Graphics · Computer Science 2023-11-29 Hao-Bin Duan , Miao Wang , Jin-Chuan Shi , Xu-Chuan Chen , Yan-Pei Cao

Recently, text-guided digital portrait editing has attracted more and more attentions. However, existing methods still struggle to maintain consistency across time, expression, and view or require specific data prerequisites. To solve these…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Haiyao Xiao , Chenglai Zhong , Xuan Gao , Yudong Guo , Juyong Zhang

3D modeling holds significant importance in the realms of AR/VR and gaming, allowing for both artistic creativity and practical applications. However, the process is often time-consuming and demands a high level of skill. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Eddy Chu , Yiyang Chen , Chedy Raissi , Anand Bhojan

The increasing demand for high-quality 3D content creation has motivated the development of automated methods for creating 3D object models from a single image and/or from a text prompt. However, the reconstructed 3D objects using…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Hoigi Seo , Hayeon Kim , Gwanghyun Kim , Se Young Chun

Recent advances in 3D generation have been remarkable, with methods such as DreamFusion leveraging large-scale text-to-image diffusion-based models to guide 3D object generation. These methods enable the synthesis of detailed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Bohan Zeng , Shanglin Li , Yutang Feng , Ling Yang , Hong Li , Sicheng Gao , Jiaming Liu , Conghui He , Wentao Zhang , Jianzhuang Liu , Baochang Zhang , Shuicheng Yan

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero