English
Related papers

Related papers: Layered 3D Human Generation via Semantic-Aware Dif…

200 papers

Creating realistic 3D objects and clothed avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

We propose a 3D generation pipeline that uses diffusion models to generate realistic human digital avatars. Due to the wide variety of human identities, poses, and stochastic details, the generation of 3D human meshes has been a challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Byungjun Kim , Patrick Kwon , Kwangho Lee , Myunggi Lee , Sookwan Han , Daesik Kim , Hanbyul Joo

Dressed people reconstruction from images is a popular task with promising applications in the creative media and game industry. However, most existing methods reconstruct the human body and garments as a whole with the supervision of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yue Shi , Yuxuan Xiong , Jingyi Chai , Bingbing Ni , Wenjun Zhang

We propose a simple and novel method for generating 3D human motion from complex natural language sentences, which describe different velocity, direction and composition of all kinds of actions. Different from existing methods that use…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Zhiyuan Ren , Zhihong Pan , Xin Zhou , Le Kang

3D human modeling has been widely used for engaging interaction in gaming, film, and animation. The customization of these characters is crucial for creativity and scalability, which highlights the importance of controllability. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Tsu-Jui Fu , Wenhan Xiong , Yixin Nie , Jingyu Liu , Barlas Oğuz , William Yang Wang

Diffusion models have emerged as the state-of-the-art for image generation, among other tasks. Here, we present an efficient diffusion-based model for 3D-aware generation of neural fields. Our approach pre-processes training data, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 J. Ryan Shue , Eric Ryan Chan , Ryan Po , Zachary Ankner , Jiajun Wu , Gordon Wetzstein

Unsupervised generation of 3D-aware clothed humans with various appearances and controllable geometries is important for creating virtual human avatars and other AR/VR applications. Existing methods are either limited to rigid object…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

Garment sewing patterns are fundamental design elements that bridge the gap between design concepts and practical manufacturing. The generative modeling of sewing patterns is crucial for creating diversified garments. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xinyu Li , Qi Yao , Yuanda Wang

Achieving realistic animated human avatars requires accurate modeling of pose-dependent clothing deformations. Existing learning-based methods heavily rely on the Linear Blend Skinning (LBS) of minimally-clothed human models like SMPL to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hang Ye , Xiaoxuan Ma , Hai Ci , Wentao Zhu , Yizhou Wang

Generating a 3D human model from a single reference image is challenging because it requires inferring textures and geometries in invisible views while maintaining consistency with the reference image. Previous methods utilizing 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Jingbo Zhang , Xiaoyu Li , Qi Zhang , Yanpei Cao , Ying Shan , Jing Liao

In this paper, we tackle a new and challenging problem of text-driven generation of 3D garments with high-quality textures. We propose "WordRobe", a novel framework for the generation of unposed & textured 3D garment meshes from…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Astitva Srivastava , Pranav Manu , Amit Raj , Varun Jampani , Avinash Sharma

Recent advances in large models have significantly advanced image-to-3D reconstruction. However, the generated models are often fused into a single piece, limiting their applicability in downstream tasks. This paper focuses on 3D garment…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Xuan Li , Chang Yu , Wenxin Du , Ying Jiang , Tianyi Xie , Yunuo Chen , Yin Yang , Chenfanfu Jiang

3D human generation is an important problem with a wide range of applications in computer vision and graphics. Despite recent progress in generative AI such as diffusion models or rendering methods like Neural Radiance Fields or Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Maksym Ivashechkin , Oscar Mendez , Richard Bowden

Although the recent rapid evolution of 3D generative neural networks greatly improves 3D shape generation, it is still not convenient for ordinary users to create 3D shapes and control the local geometry of generated shapes. To address…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Xin-Yang Zheng , Hao Pan , Peng-Shuai Wang , Xin Tong , Yang Liu , Heung-Yeung Shum

Textile pattern generation (TPG) aims to synthesize fine-grained textile pattern images based on given clothing images. Although previous studies have not explicitly investigated TPG, existing image-to-image models appear to be natural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Chenggong Hu , Yi Wang , Mengqi Xue , Haofei Zhang , Jie Song , Li Sun

We present the first image-based generative model of people in clothing for the full body. We sidestep the commonly used complex graphics rendering pipeline and the need for high-quality 3D scans of dressed people. Instead, we learn…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Christoph Lassner , Gerard Pons-Moll , Peter V. Gehler

Text-driven image generation using diffusion models has recently gained significant attention. To enable more flexible image manipulation and editing, recent research has expanded from single image generation to transparent layer generation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Junjia Huang , Pengxiang Yan , Jinhang Cai , Jiyang Liu , Zhao Wang , Yitong Wang , Xinglong Wu , Guanbin Li

This paper introduces Multi-Garment Customized Model Generation, a unified framework based on Latent Diffusion Models (LDMs) aimed at addressing the unexplored task of synthesizing images with free combinations of multiple pieces of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Yichen Liu , Penghui Du , Yi Liu Quanwei Zhang

In this paper, we introduce a novel 3D-aware image generation method that leverages 2D diffusion models. We formulate the 3D-aware image generation task as multiview 2D image set generation, and further to a sequential…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Jianfeng Xiang , Jiaolong Yang , Binbin Huang , Xin Tong

The recent advancements in image-text diffusion models have stimulated research interest in large-scale 3D generative models. Nevertheless, the limited availability of diverse 3D resources presents significant challenges to learning. In…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Chi Zhang , Yiwen Chen , Yijun Fu , Zhenglin Zhou , Gang YU , Billzb Wang , Bin Fu , Tao Chen , Guosheng Lin , Chunhua Shen