English
Related papers

Related papers: Spatio-Temporal Garment Reconstruction Using Diffu…

200 papers

Given two images depicting a person and a garment worn by another person, our goal is to generate a visualization of how the garment might look on the input person. A key challenge is to synthesize a photorealistic detail-preserving…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Luyang Zhu , Dawei Yang , Tyler Zhu , Fitsum Reda , William Chan , Chitwan Saharia , Mohammad Norouzi , Ira Kemelmacher-Shlizerman

In this paper, we present TightCap, a data-driven scheme to capture both the human shape and dressed garments accurately with only a single 3D human scan, which enables numerous applications such as virtual try-on, biometrics and body…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Xin Chen , Anqi Pang , Yang Wei , Lan Xui , Jingyi Yu

We present a learning-based model to infer the personalized 3D shape of people from a few frames (1-8) of a monocular video in which the person is moving, in less than 10 seconds with a reconstruction accuracy of 5mm. Our model learns to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Thiemo Alldieck , Marcus Magnor , Bharat Lal Bhatnagar , Christian Theobalt , Gerard Pons-Moll

Virtual try-on, which aims to seamlessly fit garments onto person images, has recently seen significant progress with diffusion-based models. However, existing methods commonly resort to duplicated backbones or additional image encoders to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Haifeng Ni , Ming Xu

We propose CrossHuman, a novel method that learns cross-guidance from parametric human model and multi-frame RGB images to achieve high-quality 3D human reconstruction. To recover geometry details and texture even in invisible regions, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Liliang Chen , Jiaqi Li , Han Huang , Yandong Guo

Generating high-quality 3D objects from textual descriptions remains a challenging problem due to computational cost, the scarcity of 3D data, and complex 3D representations. We introduce Geometry Image Diffusion (GIMDiffusion), a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Slava Elizarov , Ciara Rowles , Simon Donné

With the aim of creating virtual cloth deformations more similar to real world clothing, we propose a new computational framework that recasts three dimensional cloth deformation as an RGB image in a two dimensional pattern space. Then a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Ning Jin , Yilin Zhu , Zhenglin Geng , Ronald Fedkiw

Virtual clothes try-on has emerged as a vital feature in online shopping, offering consumers a critical tool to visualize how clothing fits. In our research, we introduce an innovative approach for virtual clothes try-on, utilizing a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Lingxiao Lu , Shengyi Wu , Haoxuan Sun , Junhong Gou , Jianlou Si , Chen Qian , Jianfu Zhang , Liqing Zhang

In this paper, we tackle the problem of static 3D cloth draping on virtual human bodies. We introduce a two-stream deep network model that produces a visually plausible draping of a template cloth on virtual 3D bodies by extracting features…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Erhan Gundogdu , Victor Constantin , Shaifali Parashar , Amrollah Seifoddini , Minh Dang , Mathieu Salzmann , Pascal Fua

Diffusion models have emerged as the best approach for generative modeling of 2D images. Part of their success is due to the possibility of training them on millions if not billions of images with a stable learning objective. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Animesh Karnewar , Andrea Vedaldi , David Novotny , Niloy Mitra

Fabricating and designing 3D garments has become extremely demanding with the increasing need for synthesizing realistic dressed persons for a variety of applications, e.g. 3D virtual try-on, digitalization of 2D clothes into 3D apparel,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Daiheng Gao , Xu Chen , Xindi Zhang , Qi Wang , Ke Sun , Bang Zhang , Liefeng Bo , Qixing Huang

Humans can infer 3D structure from 2D images of an object based on past experience and improve their 3D understanding as they see more images. Inspired by this behavior, we introduce SAP3D, a system for 3D reconstruction and novel view…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Xinyang Han , Zelin Gao , Angjoo Kanazawa , Shubham Goel , Yossi Gandelsman

Reconstructing 3D clothed human involves creating a detailed geometry of individuals in clothing, with applications ranging from virtual try-on, movies, to games. To enable practical and widespread applications, recent advances propose to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yifan Yang , Dong Liu , Shuhai Zhang , Zeshuai Deng , Zixiong Huang , Mingkui Tan

Virtual try-on is a critical image synthesis task that aims to transfer clothes from one image to another while preserving the details of both humans and clothes. While many existing methods rely on Generative Adversarial Networks (GANs) to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Junhong Gou , Siyu Sun , Jianfu Zhang , Jianlou Si , Chen Qian , Liqing Zhang

Image-based Virtual Try-On (VITON) aims to transfer an in-shop garment image onto a target person. While existing methods focus on warping the garment to fit the body pose, they often overlook the synthesis quality around the garment-skin…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 xujie zhang , Xiu Li , Michael Kampffmeyer , Xin Dong , Zhenyu Xie , Feida Zhu , Haoye Dong , Xiaodan Liang

Recent advances in 3D human shape reconstruction from single images have shown impressive results, leveraging on deep networks that model the so-called implicit function to learn the occupancy status of arbitrarily dense 3D points in space.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Nicolas Ugrinovic , Albert Pumarola , Alberto Sanfeliu , Francesc Moreno-Noguer

Existing data-driven methods for draping garments over human bodies, despite being effective, cannot handle garments of arbitrary topology and are typically not end-to-end differentiable. To address these limitations, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Ren Li , Benoît Guillard , Edoardo Remelli , Pascal Fua

We propose SelfRecon, a clothed human body reconstruction method that combines implicit and explicit representations to recover space-time coherent geometries from a monocular self-rotating human video. Explicit methods require a predefined…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Boyi Jiang , Yang Hong , Hujun Bao , Juyong Zhang

Single image 3D reconstruction is an important but challenging task that requires extensive knowledge of our natural world. Many existing methods solve this problem by optimizing a neural radiance field under the guidance of 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Minghua Liu , Chao Xu , Haian Jin , Linghao Chen , Mukund Varma T , Zexiang Xu , Hao Su

Generating consistent multiple views for 3D reconstruction tasks is still a challenge to existing image-to-3D diffusion models. Generally, incorporating 3D representations into diffusion model decrease the model's speed as well as…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Emmanuelle Bourigault , Pauline Bourigault