English
Related papers

Related papers: gDNA: Towards Generative Detailed Neural Avatars

200 papers

3D modeling has long been an important area in computer vision and computer graphics. Recently, thanks to the breakthroughs in neural representations and generative models, we witnessed a rapid development of 3D modeling. 3D human modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Ruihe Wang , Yukang Cao , Kai Han , Kwan-Yee K. Wong

We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Kaiyue Shen , Chen Guo , Manuel Kaufmann , Juan Jose Zarate , Julien Valentin , Jie Song , Otmar Hilliges

Deep generative models have been recently extended to synthesizing 3D digital humans. However, previous approaches treat clothed humans as a single chunk of geometry without considering the compositionality of clothing and accessories. As a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Taeksoo Kim , Shunsuke Saito , Hanbyul Joo

We study the problem of 3D-aware full-body human generation, aiming at creating animatable human avatars with high-quality textures and geometries. Generally, two challenges remain in this field: i) existing methods struggle to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Xuanmeng Zhang , Jianfeng Zhang , Rohan Chacko , Hongyi Xu , Guoxian Song , Yi Yang , Jiashi Feng

Most recent garment capturing techniques rely on acquiring multiple views of clothing, which may not always be readily available, especially in the case of pre-existing photographs from the web. As an alternative, we pro- pose a method that…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 Shan Yang , Tanya Ambert , Zherong Pan , Ke Wang , Licheng Yu , Tamara Berg , Ming C. Lin

Creating human avatars is a highly desirable yet challenging task. Recent advancements in radiance field rendering have achieved unprecedented photorealism and real-time performance for personalized dynamic human avatars. However, these…

Graphics · Computer Science 2025-09-09 Dongliang Cao , Guoxing Sun , Marc Habermann , Florian Bernard

We address the problem of estimating human pose and body shape from 3D scans over time. Reliable estimation of 3D body shape is necessary for many applications including virtual try-on, health monitoring, and avatar creation for virtual…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Chao Zhang , Sergi Pujades , Michael Black , Gerard Pons-Moll

Creating detailed 3D human avatars with fitted garments traditionally requires specialized expertise and labor-intensive workflows. While recent advances in generative AI have enabled text-to-3D human and clothing synthesis, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Zhiyao Sun , Yu-Hui Wen , Ho-Jui Fang , Sheng Ye , Matthieu Lin , Tian Lv , Yong-Jin Liu

Creating 3D head avatars is a significant yet challenging task for many applicated scenarios. Previous studies have set out to learn 3D human head generative models using massive 2D image data. Although these models are highly generalizable…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yiyu Zhuang , Yuxiao He , Jiawei Zhang , Yanwen Wang , Jiahe Zhu , Yao Yao , Siyu Zhu , Xun Cao , Hao Zhu

We propose a 3D generation pipeline that uses diffusion models to generate realistic human digital avatars. Due to the wide variety of human identities, poses, and stochastic details, the generation of 3D human meshes has been a challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Byungjun Kim , Patrick Kwon , Kwangho Lee , Myunggi Lee , Sookwan Han , Daesik Kim , Hanbyul Joo

In this paper, we aim to create generalizable and controllable neural signed distance fields (SDFs) that represent clothed humans from monocular depth observations. Recent advances in deep learning, especially neural implicit…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Shaofei Wang , Marko Mihajlovic , Qianli Ma , Andreas Geiger , Siyu Tang

Hair plays a significant role in personal identity and appearance, making it an essential component of high-quality, photorealistic avatars. Existing approaches either focus on modeling the facial region only or rely on personalized models,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ziyan Wang , Giljoo Nam , Aljaz Bozic , Chen Cao , Jason Saragih , Michael Zollhoefer , Jessica Hodgins

We introduce Garment3DGen a new method to synthesize 3D garment assets from a base mesh given a single input image as guidance. Our proposed approach allows users to generate 3D textured clothes based on both real and synthetic images, such…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Nikolaos Sarafianos , Tuur Stuyck , Xiaoyu Xiang , Yilei Li , Jovan Popovic , Rakesh Ranjan

We introduce a new silhouette-based representation for modeling clothed human bodies using deep generative models. Our method can reconstruct a complete and textured 3D model of a person wearing clothes from a single input picture. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Ryota Natsume , Shunsuke Saito , Zeng Huang , Weikai Chen , Chongyang Ma , Hao Li , Shigeo Morishima

We present a novel method for generating 3D garment deformations from given body poses, which is key to a wide range of applications, including virtual try-on and extended reality. To simplify the cloth dynamics, existing methods mostly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Rong Wang , Wei Mao , Changsheng Lu , Hongdong Li

Generative Neural Radiance Field (GNeRF) models, which extract implicit 3D representations from 2D images, have recently been shown to produce realistic images representing rigid/semi-rigid objects, such as human faces or cars. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jichao Zhang , Enver Sangineto , Hao Tang , Aliaksandr Siarohin , Zhun Zhong , Nicu Sebe , Wei Wang

This paper addresses the task of 3D clothed human generation from textural descriptions. Previous works usually encode the human body and clothes as a holistic model and generate the whole model in a single-stage optimization, which makes…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Junting Dong , Qi Fang , Zehuan Huang , Xudong Xu , Jingbo Wang , Sida Peng , Bo Dai

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

This work addresses the problem of real-time rendering of photorealistic human body avatars learned from multi-view videos. While the classical approaches to model and render virtual humans generally use a textured mesh, recent research has…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Arthur Moreau , Jifei Song , Helisa Dhamo , Richard Shaw , Yiren Zhou , Eduardo Pérez-Pellitero

This paper presents a novel learning-based clothing deformation method to generate rich and reasonable detailed deformations for garments worn by bodies of various shapes in various animations. In contrast to existing learning-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Tianxing Li , Rui Shi , Takashi Kanai