English
Related papers

Related papers: DreamVTON: Customizing 3D Virtual Try-on with Pers…

200 papers

Virtual try-on (VTON) has been widely explored for rendering garments onto person images, while its inverse task, virtual try-off (VTOFF), remains largely overlooked. VTOFF aims to recover standardized product images of garments directly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Davide Lobba , Fulvio Sanguigni , Bin Ren , Marcella Cornia , Rita Cucchiara , Nicu Sebe

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan

This paper presents a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models. The primary obstacle in developing foundation 3D generative models is the limited availability of 3D data. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Junlin Han , Filippos Kokkinos , Philip Torr

While diffusion model fine-tuning offers a powerful approach for customizing pre-trained models to generate specific objects, it frequently suffers from overfitting when training samples are limited, compromising both generalization…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Vera Soboleva , Aibek Alanov , Andrey Kuznetsov , Konstantin Sobolev

The task of image-based virtual try-on aims to transfer a target clothing item onto the corresponding region of a person, which is commonly tackled by fitting the item to the desired body part and fusing the warped item with the person.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Seunghwan Choi , Sunghyun Park , Minsoo Lee , Jaegul Choo

Creating realistic 3D objects and clothed avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

We introduce MD-ProjTex, a method for fast and consistent text-guided texture generation for 3D shapes using pretrained text-to-image diffusion models. At the core of our approach is a multi-view consistency mechanism in UV space, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ahmet Burak Yildirim , Mustafa Utku Aydogdu , Duygu Ceylan , Aysegul Dundar

We present DreamHuman, a method to generate realistic animatable 3D human avatar models solely from textual descriptions. Recent text-to-3D methods have made considerable strides in generation, but are still lacking in important aspects.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Nikos Kolotouros , Thiemo Alldieck , Andrei Zanfir , Eduard Gabriel Bazavan , Mihai Fieraru , Cristian Sminchisescu

As online shopping is growing, the ability for buyers to virtually visualize products in their settings-a phenomenon we define as "Virtual Try-All"-has become crucial. Recent diffusion models inherently contain a world model, rendering them…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Mehmet Saygin Seyfioglu , Karim Bouyarmane , Suren Kumar , Amir Tavanaei , Ismail B. Tutar

Virtual Try-On technology has garnered significant attention for its potential to transform the online fashion retail experience by allowing users to visualize how garments would look on them without physical trials. While recent advances…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Minh Tran , Johnmark Clements , Annie Prasanna , Tri Nguyen , Ngan Le

Text-to-image diffusion models pre-trained on billions of image-text pairs have recently enabled 3D content creation by optimizing a randomly initialized differentiable 3D representation with score distillation. However, the optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Yukun Huang , Jianan Wang , Yukai Shi , Boshi Tang , Xianbiao Qi , Lei Zhang

RLHF techniques like DPO can significantly improve the generation quality of text-to-image diffusion models. However, these methods optimize for a single reward that aligns model generation with population-level preferences, neglecting the…

Machine Learning · Computer Science 2025-01-14 Meihua Dang , Anikait Singh , Linqi Zhou , Stefano Ermon , Jiaming Song

Virtual try-on technology has become increasingly important in the fashion and retail industries, enabling the generation of high-fidelity garment images that adapt seamlessly to target human models. While existing methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Ming Meng , Qi Dong , Jiajie Li , Zhe Zhu , Xingyu Wang , Zhaoxin Fan , Wei Zhao , Wenjun Wu

3D human reconstruction from a single image is a challenging problem and has been exclusively studied in the literature. Recently, some methods have resorted to diffusion models for guidance, optimizing a 3D representation via Score…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Kaiqiang Xiong , Ying Feng , Qi Zhang , Jianbo Jiao , Yang Zhao , Zhihao Liang , Huachen Gao , Ronggang Wang

Recent text-to-image personalization methods have shown great promise in teaching a diffusion model user-specified concepts given a few images for reusing the acquired concepts in a novel context. With massive efforts being dedicated to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Zhengyang Yu , Zhaoyuan Yang , Jing Zhang

We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Francesca Babiloni , Alexandros Lattas , Jiankang Deng , Stefanos Zafeiriou

The growing digital landscape of fashion e-commerce calls for interactive and user-friendly interfaces for virtually trying on clothes. Traditional try-on methods grapple with challenges in adapting to diverse backgrounds, poses, and…

Human-Computer Interaction · Computer Science 2024-02-06 Justin Blalock , David Munechika , Harsha Karanth , Alec Helbling , Pratham Mehta , Seongmin Lee , Duen Horng Chau

Generating lifelike 3D humans from a single RGB image remains a challenging task in computer vision, as it requires accurate modeling of geometry, high-quality texture, and plausible unseen parts. Existing methods typically use multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Zhibin Liu , Haoye Dong , Aviral Chharia , Hefeng Wu

Recent innovations on text-to-3D generation have featured Score Distillation Sampling (SDS), which enables the zero-shot learning of implicit 3D models (NeRF) by directly distilling prior knowledge from 2D diffusion models. However, current…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yang Chen , Yingwei Pan , Haibo Yang , Ting Yao , Tao Mei

Diffusion models enable high-quality virtual try-on (VTO) with their established image synthesis abilities. Despite the extensive end-to-end training of large pre-trained models involved in current VTO methods, real-world applications often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xingzi Xu , Qi Li , Shuwen Qiu , Julien Han , Karim Bouyarmane