English
Related papers

Related papers: Spatio-Temporal Garment Reconstruction Using Diffu…

200 papers

Textured 3D morphing creates smooth and plausible interpolation sequences between two 3D objects, focusing on transitions in both shape and texture. This is important for creative applications like visual effects in filmmaking. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Songlin Yang , Yushi Lan , Honghua Chen , Xingang Pan

We propose a novel diffusion-based framework for reconstructing 3D geometry of hand-held objects from monocular RGB images by leveraging hand-object interaction as geometric guidance. Our method conditions a latent diffusion model on an…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ayce Idil Aytekin , Helge Rhodin , Rishabh Dabral , Christian Theobalt

We propose a novel approach to generate temporally coherent UV coordinates for loose clothing. Our method is not constrained by human body outlines and can capture loose garments and hair. We implemented a differentiable pipeline to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 You Xie , Huiqi Mao , Angela Yao , Nils Thuerey

Fashion image editing is a crucial tool for designers to convey their creative ideas by visualizing design concepts interactively. Current fashion image editing techniques, though advanced with multimodal prompts and powerful diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xiaolong Wang , Zhi-Qi Cheng , Jue Wang , Xiaojiang Peng

Reconstructing complete and animatable 3D human avatars from monocular videos remains challenging, particularly under severe occlusions. While 3D Gaussian Splatting has enabled photorealistic human rendering, existing methods struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jinlong Fan , Shanshan Zhao , Liang Zheng , Jing Zhang , Yuxiang Yang , Mingming Gong

Creating realistic 3D objects and clothed avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xue Hu , Xinghui Li , Benjamin Busam , Yiren Zhou , Ales Leonardis , Shanxin Yuan

The realism of digital avatars is crucial in enabling telepresence applications with self-expression and customization. While physical simulations can produce realistic motions for clothed humans, they require high-quality garment assets…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yifei Li , Hsiao-yu Chen , Egor Larionov , Nikolaos Sarafianos , Wojciech Matusik , Tuur Stuyck

Reconstructing 3D clothed human avatars from single images is a challenging task, especially when encountering complex poses and loose clothing. Current methods exhibit limitations in performance, largely attributable to their dependence on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zechuan Zhang , Li Sun , Zongxin Yang , Ling Chen , Yi Yang

We introduce GarmentCrafter, a new approach that enables non-professional users to create and modify 3D garments from a single-view image. While recent advances in image generation have facilitated 2D garment design, creating and editing 3D…

Image-based virtual try-on systems,which fit new garments onto human portraits,are gaining research attention.An ideal pipeline should preserve the static features of clothes(like textures and logos)while also generating dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Yanlong Zang , Han Yang , Jiaxu Miao , Yi Yang

Modeling animatable human avatars from monocular or multi-view videos has been widely studied, with recent approaches leveraging neural radiance fields (NeRFs) or 3D Gaussian Splatting (3DGS) achieving impressive results in novel-view and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yahui Li , Zhi Zeng , Liming Pang , Guixuan Zhang , Shuwu Zhang

Monocular 3D human pose estimation poses significant challenges due to the inherent depth ambiguities that arise during the reprojection process from 2D to 3D. Conventional approaches that rely on estimating an over-fit projection matrix…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Junkun Jiang , Jie Chen

We present DiffHuman, a probabilistic method for photorealistic 3D human reconstruction from a single RGB image. Despite the ill-posed nature of this problem, most methods are deterministic and output a single solution, often resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Akash Sengupta , Thiemo Alldieck , Nikos Kolotouros , Enric Corona , Andrei Zanfir , Cristian Sminchisescu

While high-quality texture maps are essential for realistic 3D asset rendering, few studies have explored learning directly in the texture space, especially on large-scale datasets. In this work, we depart from the conventional approach of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Xin Yu , Ze Yuan , Yuan-Chen Guo , Ying-Tian Liu , JianHui Liu , Yangguang Li , Yan-Pei Cao , Ding Liang , Xiaojuan Qi

Virtual try-on focuses on adjusting the given clothes to fit a specific person seamlessly while avoiding any distortion of the patterns and textures of the garment. However, the clothing identity uncontrollability and training inefficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiazheng Xing , Chao Xu , Yijie Qian , Yang Liu , Guang Dai , Baigui Sun , Yong Liu , Jingdong Wang

The generation of 3D clothed humans has attracted increasing attention in recent years. However, existing work cannot generate layered high-quality 3D humans with consistent body structures. As a result, these methods are unable to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yi Wang , Jian Ma , Ruizhi Shao , Qiao Feng , Yu-Kun Lai , Yebin Liu , Kun Li

Large-scale pre-trained vision-language models allow for the zero-shot text-based generation of 3D avatars. The previous state-of-the-art method utilized CLIP to supervise neural implicit models that reconstructed a human body mesh.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Shuo Huang , Zongxin Yang , Liangting Li , Yi Yang , Jia Jia

We present a self-supervised method to learn dynamic 3D deformations of garments worn by parametric human bodies. State-of-the-art data-driven approaches to model 3D garment deformations are trained using supervised strategies that require…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Igor Santesteban , Miguel A. Otaduy , Dan Casas

We present a novel method for temporal coherent reconstruction and tracking of clothed humans. Given a monocular RGB-D sequence, we learn a person-specific body model which is based on a dynamic surface function network. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Andrei Burov , Matthias Nießner , Justus Thies