English
Related papers

Related papers: Learning-Based Animation of Clothing for Virtual T…

200 papers

We investigated the application of haptic feedback control and deep reinforcement learning (DRL) to robot-assisted dressing. Our method uses DRL to simultaneously train human and robot control policies as separate neural networks using…

Robotics · Computer Science 2019-12-20 Alexander Clegg , Zackory Erickson , Patrick Grady , Greg Turk , Charles C. Kemp , C. Karen Liu

Virtual try-on methods aim to generate images of fashion models wearing arbitrary combinations of garments. This is a challenging task because the generated image must appear realistic and accurately display the interaction between…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Kedan Li , Min jin Chong , Jeffrey Zhang , Jingen Liu

This paper addresses a new virtual try-on problem of fitting any size of clothes to a reference person in the image domain. While previous image-based virtual try-on methods can produce highly natural try-on images, these methods fit the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yohei Yamashita , Chihiro Nakatani , Norimichi Ukita

Modeling animatable human avatars from monocular or multi-view videos has been widely studied, with recent approaches leveraging neural radiance fields (NeRFs) or 3D Gaussian Splatting (3DGS) achieving impressive results in novel-view and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yahui Li , Zhi Zeng , Liming Pang , Guixuan Zhang , Shuwu Zhang

Studies of virtual try-on (VITON) have been shown their effectiveness in utilizing the generative neural network for virtually exploring fashion products, and some of recent researches of VITON attempted to synthesize human image wearing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Soonchan Park , Jinah Park

This paper introduces a novel clothed human model that can be learned from multiview RGB videos, with a particular emphasis on recovering physically accurate body and cloth movements. Our method, Position Based Dynamic Gaussians (PBDyG),…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shota Sasaki , Jane Wu , Ko Nishino

Recent monocular human performance capture approaches have shown compelling dense tracking results of the full body from a single RGB camera. However, existing methods either do not estimate clothing at all or model cloth deformation with…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yue Li , Marc Habermann , Bernhard Thomaszewski , Stelian Coros , Thabo Beeler , Christian Theobalt

Virtual try-on is a promising computer vision topic with a high commercial value wherein a new garment is visually worn on a person with a photo-realistic effect. Previous studies conduct their shape and content inference at one stage,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Naiyu Fang , Lemiao Qiu , Shuyou Zhang , Zili Wang , Kerui Hu

Video virtual try-on aims to transfer a clothing item onto the video of a target person. Directly applying the technique of image-based try-on to the video domain in a frame-wise manner will cause temporal-inconsistent outcomes while…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Zixun Fang , Wei Zhai , Aimin Su , Hongliang Song , Kai Zhu , Mao Wang , Yu Chen , Zhiheng Liu , Yang Cao , Zheng-Jun Zha

We propose a diffusion model-based approach, FloAtControlNet to generate cinemagraphs composed of animations of human clothing. We focus on human clothing like dresses, skirts and pants. The input to our model is a text prompt depicting the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Swasti Shreya Mishra , Kuldeep Kulkarni , Duygu Ceylan , Balaji Vasan Srinivasan

We present the first image-based generative model of people in clothing for the full body. We sidestep the commonly used complex graphics rendering pipeline and the need for high-quality 3D scans of dressed people. Instead, we learn…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Christoph Lassner , Gerard Pons-Moll , Peter V. Gehler

Clothing is an important part of human appearance but challenging to model in photorealistic avatars. In this work we present avatars with dynamically moving loose clothing that can be faithfully driven by sparse RGB-D inputs as well as…

Graphics · Computer Science 2023-10-12 Donglai Xiang , Fabian Prada , Zhe Cao , Kaiwen Guo , Chenglei Wu , Jessica Hodgins , Timur Bagautdinov

The fields of SocialVR, performance capture, and virtual try-on are often faced with a need to faithfully reproduce real garments in the virtual world. One critical task is the disentanglement of the intrinsic garment shape from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-29 Maria Korosteleva , Sung-Hee Lee

An outfit visualization method generates an image of a person wearing real garments from images of those garments. Current methods can produce images that look realistic and preserve garment identity, captured in details such as collar,…

Graphics · Computer Science 2022-12-01 Kedan Li , Jeffrey Zhang , Shao-Yu Chang , David Forsyth

In this paper, we develop a robust 3D garment digitization solution that can generalize well on real-world fashion catalog images with cloth texture occlusions and large body pose variations. We assumed fixed topology parametric template…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Sahib Majithia , Sandeep N. Parameswaran , Sadbhavana Babar , Vikram Garg , Astitva Srivastava , Avinash Sharma

Cosplay has grown from its origins at fan conventions into a billion-dollar global dress phenomenon. To facilitate imagination and reinterpretation from animated images to real garments, this paper presents an automatic costume image…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Koya Tango , Marie Katsurai , Hayato Maki , Ryosuke Goto

Unified and scalable Transformers have recently achieved remarkable success in modeling diverse phenomena traditionally associated with computer graphics, such as 3D visual effects, rendering processes, and motion in videos. In this work,…

Graphics · Computer Science 2026-05-28 Yu Zhang , Yidi Shao , Wenqi Ouyang , Yushi Lan , Zhexin Liang , Chengrui Wu , Xudong Xu , Xingang Pan

Achieving realistic animated human avatars requires accurate modeling of pose-dependent clothing deformations. Existing learning-based methods heavily rely on the Linear Blend Skinning (LBS) of minimally-clothed human models like SMPL to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hang Ye , Xiaoxuan Ma , Hai Ci , Wentao Zhu , Yizhou Wang

Virtual character animation control is a problem for which Reinforcement Learning (RL) is a viable approach. While current work have applied RL effectively to portray physics-based skills, social behaviours are challenging to design reward…

Machine Learning · Computer Science 2021-04-14 Vihanga Gamage , Cathy Ennis , Robert Ross

Robotic manipulation of cloth remains challenging for robotics due to the complex dynamics of the cloth, lack of a low-dimensional state representation, and self-occlusions. In contrast to previous model-based approaches that learn a…

Robotics · Computer Science 2022-01-07 Xingyu Lin , Yufei Wang , Zixuan Huang , David Held