English
Related papers

Related papers: Realistic, Animatable Human Reconstructions for Vi…

200 papers

We propose SelfRecon, a clothed human body reconstruction method that combines implicit and explicit representations to recover space-time coherent geometries from a monocular self-rotating human video. Explicit methods require a predefined…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Boyi Jiang , Yang Hong , Hujun Bao , Juyong Zhang

Virtual try-on focuses on adjusting the given clothes to fit a specific person seamlessly while avoiding any distortion of the patterns and textures of the garment. However, the clothing identity uncontrollability and training inefficiency…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiazheng Xing , Chao Xu , Yijie Qian , Yang Liu , Guang Dai , Baigui Sun , Yong Liu , Jingdong Wang

Virtual try-on has emerged as a pivotal task at the intersection of computer vision and fashion, aimed at digitally simulating how clothing items fit on the human body. Despite notable progress in single-image virtual try-on (VTO), current…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Siqi Li , Zhengkai Jiang , Jiawei Zhou , Zhihong Liu , Xiaowei Chi , Haoqian Wang

We propose a method for generating video-realistic animations of real humans under user control. In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Hyeongwoo Kim , Florian Bernard , Marc Habermann , Wenping Wang , Christian Theobalt

We present a method for fast 3D reconstruction and real-time rendering of dynamic humans from monocular videos with accompanying parametric body fits. Our method can reconstruct a dynamic human in less than 3h using a single GPU, compared…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Ignacio Rocco , Iurii Makarov , Filippos Kokkinos , David Novotny , Benjamin Graham , Natalia Neverova , Andrea Vedaldi

In this paper, we introduce FitMe, a facial reflectance model and a differentiable rendering optimization pipeline, that can be used to acquire high-fidelity renderable human avatars from single or multiple images. The model consists of a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Alexandros Lattas , Stylianos Moschoglou , Stylianos Ploumpis , Baris Gecer , Jiankang Deng , Stefanos Zafeiriou

Latest advances have achieved realistic virtual try-on (VTON) through localized garment inpainting using latent diffusion models, significantly enhancing consumers' online shopping experience. However, existing VTON technologies neglect the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Fei Shen , Xin Jiang , Xin He , Hu Ye , Cong Wang , Xiaoyu Du , Zechao Li , Jinhui Tang

Modeling animatable human avatars from monocular or multi-view videos has been widely studied, with recent approaches leveraging neural radiance fields (NeRFs) or 3D Gaussian Splatting (3DGS) achieving impressive results in novel-view and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Yahui Li , Zhi Zeng , Liming Pang , Guixuan Zhang , Shuwu Zhang

Widespread RGB-Depth (RGB-D) sensors and advanced 3D reconstruction technologies facilitate the capture of indoor spaces, improving the fields of augmented reality (AR), virtual reality (VR), and extended reality (XR). Nevertheless, current…

Robotics · Computer Science 2026-04-22 Seok Joon Kim , Dinh Duc Cao , Federica Spinola , Se Jin Lee , Kyu Sung Cho

Virtual try-on attracts increasing research attention as a promising way for enhancing the user experience for online cloth shopping. Though existing methods can generate impressive results, users need to provide a well-designed reference…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Anran Lin , Nanxuan Zhao , Shuliang Ning , Yuda Qiu , Baoyuan Wang , Xiaoguang Han

A vital task of the wider digital human effort is the creation of realistic garments on digital avatars, both in the form of characteristic fold patterns and wrinkles in static frames as well as richness of garment dynamics under avatars'…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Meng Zhang , Duygu Ceylan , Tuanfeng Wang , Niloy J. Mitra

The task of image-based virtual try-on aims to transfer a target clothing item onto the corresponding region of a person, which is commonly tackled by fitting the item to the desired body part and fusing the warped item with the person.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Seunghwan Choi , Sunghyun Park , Minsoo Lee , Jaegul Choo

Estimating 3D poses and shapes in the form of meshes from monocular RGB images is challenging. Obviously, it is more difficult than estimating 3D poses only in the form of skeletons or heatmaps. When interacting persons are involved, the 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Junuk Cha , Muhammad Saqlain , GeonU Kim , Mingyu Shin , Seungryul Baek

Lightweight creation of 3D digital avatars is a highly desirable but challenging task. With only sparse videos of a person under unknown illumination, we propose a method to create relightable and animatable neural avatars, which can be…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Wenbin Lin , Chengwei Zheng , Jun-Hai Yong , Feng Xu

We propose a new generative model for 3D garment deformations that enables us to learn, for the first time, a data-driven method for virtual try-on that effectively addresses garment-body collisions. In contrast to existing methods that…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Igor Santesteban , Nils Thuerey , Miguel A. Otaduy , Dan Casas

We propose a method to build in real-time animated 3D head models using a consumer-grade RGB-D camera. Our proposed method is the first one to provide simultaneously comprehensive facial motion tracking and a detailed 3D model of the user's…

Computer Vision and Pattern Recognition · Computer Science 2020-04-23 Diego Thomas

In this paper, we rethink the problem of scene reconstruction from an embodied agent's perspective: While the classic view focuses on the reconstruction accuracy, our new perspective emphasizes the underlying functions and constraints such…

Robotics · Computer Science 2021-03-31 Muzhi Han , Zeyu Zhang , Ziyuan Jiao , Xu Xie , Yixin Zhu , Song-Chun Zhu , Hangxin Liu

Digital humans and, especially, 3D facial avatars have raised a lot of attention in the past years, as they are the backbone of several applications like immersive telepresence in AR or VR. Despite the progress, facial avatars reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Berna Kabadayi , Wojciech Zielonka , Bharat Lal Bhatnagar , Gerard Pons-Moll , Justus Thies

In this paper, we consider a novel problem of reconstructing a 3D human avatar from multiple unconstrained frames, independent of assumptions on camera calibration, capture space, and constrained actions. The problem should be addressed by…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Xiangyu Zhu , Tingting Liao , Jiangjing Lyu , Xiang Yan , Yunfeng Wang , Kan Guo , Qiong Cao , Stan Z. Li , Zhen Lei

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton