English
Related papers

Related papers: AvatarFusion: Zero-shot Generation of Clothing-Dec…

200 papers

3D human generation from 2D images has achieved remarkable progress through the synergistic utilization of neural rendering and generative models. Existing 3D human generative models mainly generate a clothed 3D human as an undetectable 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Shoukang Hu , Fangzhou Hong , Tao Hu , Liang Pan , Haiyi Mei , Weiye Xiao , Lei Yang , Ziwei Liu

Photo-real digital human avatars are of enormous importance in graphics, as they enable immersive communication over the globe, improve gaming and entertainment experiences, and can be particularly beneficial for AR and VR settings.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Marc Habermann , Lingjie Liu , Weipeng Xu , Gerard Pons-Moll , Michael Zollhoefer , Christian Theobalt

Manipulating the material appearance of objects in images is critical for applications like augmented reality, virtual prototyping, and digital content creation. We present MaterialFusion, a novel framework for high-quality material…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Kamil Garifullin , Maxim Nikolaev , Andrey Kuznetsov , Aibek Alanov

We present DiffPortrait3D, a conditional diffusion model that is capable of synthesizing 3D-consistent photo-realistic novel views from as few as a single in-the-wild portrait. Specifically, given a single RGB input, we aim to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yuming Gu , You Xie , Hongyi Xu , Guoxian Song , Yichun Shi , Di Chang , Jing Yang , Linjie Luo

We present DINAR, an approach for creating realistic rigged fullbody avatars from single RGB images. Similarly to previous works, our method uses neural textures combined with the SMPL-X body model to achieve photo-realistic quality of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 David Svitov , Dmitrii Gudkov , Renat Bashirov , Victor Lempitsky

Recent advancements in large scale text-to-image models have opened new possibilities for guiding the creation of images through human-devised natural language. However, while prior literature has primarily focused on the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Hyeonho Jeong , Gihyun Kwon , Jong Chul Ye

We propose a 3D generation pipeline that uses diffusion models to generate realistic human digital avatars. Due to the wide variety of human identities, poses, and stochastic details, the generation of 3D human meshes has been a challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Byungjun Kim , Patrick Kwon , Kwangho Lee , Myunggi Lee , Sookwan Han , Daesik Kim , Hanbyul Joo

Reconstructing complete and animatable 3D human avatars from monocular videos remains challenging, particularly under severe occlusions. While 3D Gaussian Splatting has enabled photorealistic human rendering, existing methods struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jinlong Fan , Shanshan Zhao , Liang Zheng , Jing Zhang , Yuxiang Yang , Mingming Gong

Existing methods for human parsing into body parts and clothing often use fixed mask categories with broad labels that obscure fine-grained clothing types. Recent open-vocabulary segmentation approaches leverage pretrained text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Kiran Chhatre , Christopher Peters , Srikrishna Karanam

Recent communities have seen significant progress in building photo-realistic animatable avatars from sparse multi-view videos. However, current workflows struggle to render realistic garment dynamics for loose-fitting characters as they…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Beijia Chen , Yuefan Shen , Qing Shuai , Xiaowei Zhou , Kun Zhou , Youyi Zheng

Virtual try-on can significantly improve the garment shopping experiences in both online and in-store scenarios, attracting broad interest in computer vision. However, to achieve high-fidelity try-on performance, most state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Yunfang Niu , Dong Yi , Lingxiang Wu , Zhiwei Liu , Pengxiang Cai , Jinqiao Wang

Existing 3D clothed avatar reconstruction methods achieve high visual fidelity but ignore geometric structure and physical plausibility. They either model clothed humans as a single deformable surface or attempt garment disentanglement…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Daniel Eskandar , Berna Kabadayi , Garvita Tiwari , Gerard Pons-Moll

Reconstructing realistic 3D human avatars from monocular videos is a challenging task due to the limited geometric information and complex non-rigid motion involved. We present MonoCloth, a new method for reconstructing and animating…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Daisheng Jin , Ying He

As the digital and physical worlds become more intertwined, there has been a lot of interest in digital avatars that closely resemble their real-world counterparts. Current digitization methods used in 3D production pipelines require costly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yifan Wang , Ivan Molodetskikh , Ondrej Texler , Dimitar Dinev

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

With the increasing demand for 3D animation, generating high-fidelity, controllable 4D avatars from textual descriptions remains a significant challenge. Despite notable efforts in 4D generative modeling, existing methods exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Eddie Pokming Sheung , Qihao Liu , Wufei Ma , Prakhar Kaushik , Jianwen Xie , Alan Yuille

Diffusion models have shown unprecedented success in the task of text-to-image generation. While these models are capable of generating high-quality and realistic images, the complexity of sequential denoising has raised societal concerns…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Qinchan Li , Kenneth Chen , Changyue Su , Qi Sun

Two major approaches exist for creating animatable human avatars. The first, a 3D-based approach, optimizes a NeRF- or 3DGS-based avatar from videos of a single person, achieving personalization through a disentangled identity…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Geonhee Sim , Gyeongsik Moon

Generating high-fidelity upper-body 3D avatars from one-shot input image remains a significant challenge. Current 3D avatar generation methods, which rely on large reconstruction models, are fast and capable of producing stable body…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Fan Yang , Heyuan Li , Peihao Li , Weihao Yuan , Lingteng Qiu , Chaoyue Song , Cheng Chen , Yisheng He , Shifeng Zhang , Xiaoguang Han , Steven Hoi , Guosheng Lin

4D modeling of human-object interactions is critical for numerous applications. However, efficient volumetric capture and rendering of complex interaction scenarios, especially from sparse inputs, remain challenging. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yuheng Jiang , Suyi Jiang , Guoxing Sun , Zhuo Su , Kaiwen Guo , Minye Wu , Jingyi Yu , Lan Xu