English
Related papers

Related papers: Realistic Clothed Human and Object Joint Reconstru…

200 papers

We present a method to reconstruct time-consistent human body models from monocular videos, focusing on extremely loose clothing or handheld object interactions. Prior work in human reconstruction is either limited to tight clothing with no…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jeff Tan , Donglai Xiang , Shubham Tulsiani , Deva Ramanan , Gengshan Yang

Reconstructing 3D clothed human involves creating a detailed geometry of individuals in clothing, with applications ranging from virtual try-on, movies, to games. To enable practical and widespread applications, recent advances propose to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yifan Yang , Dong Liu , Shuhai Zhang , Zeshuai Deng , Zixiong Huang , Mingkui Tan

We present a learning-based model to infer the personalized 3D shape of people from a few frames (1-8) of a monocular video in which the person is moving, in less than 10 seconds with a reconstruction accuracy of 5mm. Our model learns to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Thiemo Alldieck , Marcus Magnor , Bharat Lal Bhatnagar , Christian Theobalt , Gerard Pons-Moll

Reconstructing 3D humans from a single image has been extensively investigated. However, existing approaches often fall short on capturing fine geometry and appearance details, hallucinating occluded parts with plausible details, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhenzhen Weng , Jingyuan Liu , Hao Tan , Zhan Xu , Yang Zhou , Serena Yeung-Levy , Jimei Yang

Occlusion is a common issue in 3D reconstruction from RGB-D videos, often blocking the complete reconstruction of objects and presenting an ongoing problem. In this paper, we propose a novel framework, empowered by a 2D diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yubin Hu , Sheng Ye , Wang Zhao , Matthieu Lin , Yuze He , Yu-Hui Wen , Ying He , Yong-Jin Liu

We introduce Structured 3D Features, a model based on a novel implicit 3D representation that pools pixel-aligned image features onto dense 3D points sampled from a parametric, statistical human mesh surface. The 3D points have associated…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Enric Corona , Mihai Zanfir , Thiemo Alldieck , Eduard Gabriel Bazavan , Andrei Zanfir , Cristian Sminchisescu

While previous years have seen great progress in the 3D reconstruction of humans from monocular videos, few of the state-of-the-art methods are able to handle loose garments that exhibit large non-rigid surface deformations during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Chen Guo , Tianjian Jiang , Manuel Kaufmann , Chengwei Zheng , Julien Valentin , Jie Song , Otmar Hilliges

We introduce an approach that accurately reconstructs 3D human poses and detailed 3D full-body geometric models from single images in realtime. The key idea of our approach is a novel end-to-end multi-task deep learning framework that uses…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Liguo Jiang , Miaopeng Li , Jianjie Zhang , Congyi Wang , Juntao Ye , Xinguo Liu , Jinxiang Chai

Current methods for learning realistic and animatable 3D clothed avatars need either posed 3D scans or 2D images with carefully controlled user poses. In contrast, our goal is to learn an avatar from only 2D images of people in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuliang Xiu , Jinlong Yang , Dimitrios Tzionas , Michael J. Black

Object reconstruction is an important task in many fields of application as it allows to generate digital representations of our physical world used as base for analysis, planning, construction, visualization or other aims. A reconstruction…

Reconstructing 3D human-object interaction (HOI) from single-view RGB images is challenging due to the absence of depth information and potential occlusions. Existing methods simply predict the body poses merely rely on network training on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yuhang Chen , Chenxing Wang

Reconstructing realistic 3D human avatars from monocular videos is a challenging task due to the limited geometric information and complex non-rigid motion involved. We present MonoCloth, a new method for reconstructing and animating…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Daisheng Jin , Ying He

In this paper, we tackle the problem of 3D human shape estimation from single RGB images. While the recent progress in convolutional neural networks has allowed impressive results for 3D human pose estimation, estimating the full 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Valentin Gabeur , Jean-Sebastien Franco , Xavier Martin , Cordelia Schmid , Gregory Rogez

We present a method that can recognize new objects and estimate their 3D pose in RGB images even under partial occlusions. Our method requires neither a training phase on these objects nor real images depicting them, only their CAD models.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Van Nguyen Nguyen , Yinlin Hu , Yang Xiao , Mathieu Salzmann , Vincent Lepetit

3D human body reconstruction from monocular images is an interesting and ill-posed problem in computer vision with wider applications in multiple domains. In this paper, we propose SHARP, a novel end-to-end trainable network that accurately…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Sai Sagar Jinka , Rohan Chacko , Astitva Srivastava , Avinash Sharma , P. J. Narayanan

Creating animatable avatars from static scans requires the modeling of clothing deformations in different poses. Existing learning-based methods typically add pose-dependent deformations upon a minimally-clothed mesh template or a learned…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Hongwen Zhang , Siyou Lin , Ruizhi Shao , Yuxiang Zhang , Zerong Zheng , Han Huang , Yandong Guo , Yebin Liu

We present an end-to-end virtual try-on pipeline, that can fit different clothes on a personalized 3-D human model, reconstructed using a single RGB image. Our main idea is to construct an animatable 3-D human model and try-on different…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Gayal Kuruppu , Bumuthu Dilshan , Shehan Samarasinghe , Nipuna Madhushan , Ranga Rodrigo

We present a method for inferring diverse 3D models of human-object interactions from images. Reasoning about how humans interact with objects in complex scenes from a single 2D image is a challenging task given ambiguities arising from the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Xi Wang , Gen Li , Yen-Ling Kuo , Muhammed Kocabas , Emre Aksan , Otmar Hilliges

In this work, we address the problem of multi-person 3D pose estimation from a single image. A typical regression approach in the top-down setting of this problem would first detect all humans and then reconstruct each one of them…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Wen Jiang , Nikos Kolotouros , Georgios Pavlakos , Xiaowei Zhou , Kostas Daniilidis

Recently, learning-based approaches for 3D reconstruction from 2D images have gained popularity due to its modern applications, e.g., 3D printers, autonomous robots, self-driving cars, virtual reality, and augmented reality. The computer…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Andrey Salvi , Nathan Gavenski , Eduardo Pooch , Felipe Tasoniero , Rodrigo Barros