English
Related papers

Related papers: AG3D: Learning to Generate 3D Avatars from 2D Imag…

200 papers

We propose a method for constructing generative models of 3D objects from a single 3D mesh and improving them through unsupervised low-shot learning from 2D images. Our method produces a 3D morphable model that represents shape and albedo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

Pose-driven full-body avatars built on neural rendering produce high-quality novel views of a captured subject. Yet loose clothing and other dynamic elements deform in ways pose alone cannot explain: the same pose can correspond to many…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Shichong Peng , Chengxiang Yin , Fei Jiang , Zhongshi Jiang , Lingchen Yang , Qingyang Tan , Amin Jourabloo , Jason Saragih , Ke Li , Christian Häne

Creating realistic 3D objects and clothed avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

Unsupervised learning of 3D-aware generative adversarial networks (GANs) using only collections of single-view 2D photographs has very recently made much progress. These 3D GANs, however, have not been demonstrated for human bodies and the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Alexander W. Bergman , Petr Kellnhofer , Wang Yifan , Eric R. Chan , David B. Lindell , Gordon Wetzstein

Modeling animatable human avatars from monocular or multi-view videos has been widely studied, with recent approaches leveraging neural radiance fields (NeRFs) or 3D Gaussian Splatting (3DGS) achieving impressive results in novel-view and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yahui Li , Zhi Zeng , Liming Pang , Guixuan Zhang , Shuwu Zhang

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

3D face modeling has been an active area of research in computer vision and computer graphics, fueling applications ranging from facial expression transfer in virtual avatars to synthetic data generation. Existing 3D deep learning…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Fariborz Taherkhani , Aashish Rai , Quankai Gao , Shaunak Srivastava , Xuanbai Chen , Fernando de la Torre , Steven Song , Aayush Prakash , Daeil Kim

For humans, visual understanding is inherently generative: given a 3D shape, we can postulate how it would look in the world; given a 2D image, we can infer the 3D structure that likely gave rise to it. We can thus translate between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tristan Aumentado-Armstrong , Alex Levinshtein , Stavros Tsogkas , Konstantinos G. Derpanis , Allan D. Jepson

This paper aims to generate physically-layered 3D humans from text prompts. Existing methods either generate 3D clothed humans as a whole or support only tight and simple clothing generation, which limits their applications to virtual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yi Wang , Jian Ma , Ruizhi Shao , Qiao Feng , Yu-kun Lai , Kun Li

Editable 3D-aware generation, which supports user-interacted editing, has witnessed rapid development recently. However, existing editable 3D GANs either fail to achieve high-accuracy local editing or suffer from huge computational costs.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Fan Yang , Tianyi Chen , Xiaosheng He , Zhongang Cai , Lei Yang , Si Wu , Guosheng Lin

We propose a new type of full-body human avatars, which combines parametric mesh-based body model with a neural texture. We show that with the help of neural textures, such avatars can successfully model clothing and hair, which usually…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Artur Grigorev , Karim Iskakov , Anastasia Ianina , Renat Bashirov , Ilya Zakharkin , Alexander Vakhitov , Victor Lempitsky

Existing data-driven methods for garment animation, usually driven by linear skinning, although effective on tight garments, do not handle loose-fitting garments with complex deformations well. To address these limitations, we develop a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Yifu Liu , Xiaoxia Li , Zhiling Luo , Wei Zhou

Creating and customizing a 3D clothed avatar from textual descriptions is a critical and challenging task. Traditional methods often treat the human body and clothing as inseparable, limiting users' ability to freely mix and match garments.…

Graphics · Computer Science 2025-03-18 Jia Gong , Shenyu Ji , Lin Geng Foo , Kang Chen , Hossein Rahmani , Jun Liu

In this paper, we rethink text-to-avatar generative models by proposing TeRA, a more efficient and effective framework than the previous SDS-based models and general large 3D generative models. Our approach employs a two-stage training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Yanwen Wang , Yiyu Zhuang , Jiawei Zhang , Li Wang , Yifei Zeng , Xun Cao , Xinxin Zuo , Hao Zhu

We propose a novel framework for decomposing arbitrarily posed humans into animatable multi-layered 3D human avatars, separating the body and garments. Conventional single-layer reconstruction methods lock clothing to one identity, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yinghan Xu , John Dingliana

Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limited number of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Mallikarjun B R , Ayush Tewari , Hans-Peter Seidel , Mohamed Elgharib , Christian Theobalt

Deep generative models have been recently extended to synthesizing 3D digital humans. However, previous approaches treat clothed humans as a single chunk of geometry without considering the compositionality of clothing and accessories. As a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Taeksoo Kim , Shunsuke Saito , Hanbyul Joo

The demand for efficient 3D model generation techniques has grown exponentially, as manual creation of 3D models is time-consuming and requires specialized expertise. While generative models have shown potential in creating 3D textured…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Fanghua Yu , Xintao Wang , Zheyuan Li , Yan-Pei Cao , Ying Shan , Chao Dong

We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image. To estimate the face geometry, we use a deep neural network to directly predict vertex coordinates of the 3D face…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Ruizhe Wang , Chih-Fan Chen , Hao Peng , Xudong Liu , Oliver Liu , Xin Li