English
Related papers

Related papers: Incorporating Visual Correspondence into Diffusion…

200 papers

This paper proposes a novel garment transfer method supervised with knowledge distillation from virtual try-on. Our method first reasons the transfer parsing to provide shape prior to downstream tasks. We employ a multi-phase teaching…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Naiyu Fang , Lemiao Qiu , Shuyou Zhang , Zili Wang , Kerui Hu , Jianrong Tan

The issue of generative pretraining for vision models has persisted as a long-standing conundrum. At present, the text-to-image (T2I) diffusion model demonstrates remarkable proficiency in generating high-definition images matching textual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Qiang Wan , Zilong Huang , Bingyi Kang , Jiashi Feng , Li Zhang

Image-based Virtual Try-ON aims to transfer an in-shop garment onto a specific person. Existing methods employ a global warping module to model the anisotropic deformation for different garment parts, which fails to preserve the semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhenyu Xie , Zaiyu Huang , Xin Dong , Fuwei Zhao , Haoye Dong , Xijin Zhang , Feida Zhu , Xiaodan Liang

Virtual try-on (VTON) has advanced single-garment visualization, yet real-world fashion centers on full outfits with multiple garments, accessories, fine-grained categories, layering, and diverse styling, remaining beyond current VTON…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Junyao Hu , Zhongwei Cheng , Waikeung Wong , Xingxing Zou

Image Virtual try-on aims at replacing the cloth on a personal image with a garment image (in-shop clothes), which has attracted increasing attention from the multimedia and computer vision communities. Prior methods successfully preserve…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Zhijing Yang , Junyang Chen , Yukai Shi , Hao Li , Tianshui Chen , Liang Lin

Text-to-image diffusion models generate impressive and realistic images, but do they learn to represent the 3D world from only 2D supervision? We demonstrate that yes, certain 3D scene representations are encoded in the text embedding space…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 James Burgess , Kuan-Chieh Wang , Serena Yeung-Levy

Virtual Try-On (trying clothes virtually) is a promising application of the Generative Adversarial Network (GAN). However, it is an arduous task to transfer the desired clothing item onto the corresponding regions of a human body because of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Santosh Adhikari , Bishnu Bhusal , Prashant Ghimire , Anil Shrestha

Virtual try-on system under arbitrary human poses has huge application potential, yet raises quite a lot of challenges, e.g. self-occlusions, heavy misalignment among diverse poses, and diverse clothes textures. Existing methods aim at…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Haoye Dong , Xiaodan Liang , Bochao Wang , Hanjiang Lai , Jia Zhu , Jian Yin

In this paper, we first investigate a visual quality degradation problem observed in recent high-resolution virtual try-on approach. The tendency is empirically found that the textures of clothes are squeezed at the sleeve, as visualized in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Sang-Heon Shim , Jiwoo Chung , Jae-Pil Heo

Registering clothes from 4D scans with vertex-accurate correspondence is challenging, yet important for dynamic appearance modeling and physics parameter estimation from real-world data. However, previous methods either rely on texture…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Jingfan Guo , Fabian Prada , Donglai Xiang , Javier Romero , Chenglei Wu , Hyun Soo Park , Takaaki Shiratori , Shunsuke Saito

With the development of deep learning technology, virtual try-on technology has devel-oped important application value in the fields of e-commerce, fashion, and entertainment. The recently proposed Leffa technology has addressed the texture…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Sehyun Kim , Hye Jun Lee , Jiwoo Lee , Taemin Lee

In this paper, we investigate the use of diffusion models which are pre-trained on large-scale image-caption pairs for open-vocabulary 3D semantic understanding. We propose a novel method, namely Diff2Scene, which leverages frozen…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Xiaoyu Zhu , Hao Zhou , Pengfei Xing , Long Zhao , Hao Xu , Junwei Liang , Alexander Hauptmann , Ting Liu , Andrew Gallagher

We introduce RefTon, a flux-based person-to-person virtual try-on framework that enhances garment realism through unpaired visual references. Unlike conventional approaches that rely on complex auxiliary inputs such as body parsing and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Liuzhuozheng Li , Yue Gong , Shanyuan Liu , Dengyang Jiang , Zanyi Wang , Bo Cheng , Yuhang Ma , Leibucha Wu , Dawei Leng , Yuhui Yin

Depth information provides valuable insights into the 3D structure especially the outline of objects, which can be utilized to improve the semantic segmentation tasks. However, a naive fusion of depth information can disrupt feature and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Wei Sun , Yuan Li , Qixiang Ye , Jianbin Jiao , Yanzhao Zhou

Image-based virtual try-on aims to fit an in-shop garment onto a clothed person image. Garment warping, which aligns the target garment with the corresponding body parts in the person image, is a crucial step in achieving this goal.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Sanhita Pathak , Vinay Kaushik , Brejesh Lall

Recent advances in garment-centric image generation from text and image prompts based on diffusion models are impressive. However, existing methods lack support for various combinations of attire, and struggle to preserve the garment…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Xinghui Li , Qichao Sun , Pengze Zhang , Fulong Ye , Zhichao Liao , Wanquan Feng , Songtao Zhao , Qian He

Text-to-image diffusion models like Stable Diffusion generate high-quality images from text, but lack a way to inject visual guidance (e.g. sketches, styles) at inference without retraining. Existing methods either require computationally…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Agata Żywot , Iason Skylitsis , Thijmen Nijdam , Zoe Tzifa-Kratira , Derck Prinzhorn , Konrad Szewczyk , Aritra Bhowmik

Virtual try-on(VTON) aims at fitting target clothes to reference person images, which is widely adopted in e-commerce.Existing VTON approaches can be narrowly categorized into Parser-Based(PB) and Parser-Free(PF) by whether relying on the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Chao Lin , Zhao Li , Sheng Zhou , Shichang Hu , Jialun Zhang , Linhao Luo , Jiarun Zhang , Longtao Huang , Yuan He

The growing digital landscape of fashion e-commerce calls for interactive and user-friendly interfaces for virtually trying on clothes. Traditional try-on methods grapple with challenges in adapting to diverse backgrounds, poses, and…

Human-Computer Interaction · Computer Science 2024-02-06 Justin Blalock , David Munechika , Harsha Karanth , Alec Helbling , Pratham Mehta , Seongmin Lee , Duen Horng Chau

Despite its great potential, virtual try-on technology is hindered from real-world application by two major challenges: the inability of current methods to support multi-reference outfit compositions (including garments and accessories),…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zheng Chong , Yanwei Lei , Shiyue Zhang , Zhuandi He , Zhen Wang , Xujie Zhang , Xiao Dong , Yiling Wu , Dongmei Jiang , Xiaodan Liang