English
Related papers

Related papers: SCALE: Modeling Clothed Humans with a Surface Code…

200 papers

It is challenging to directly estimate the human geometry from a single image due to the high diversity and complexity of body shapes with the various clothing styles. Most of model-based approaches are limited to predict the shape and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Lixiang Lin , Jianke Zhu

Recent monocular human performance capture approaches have shown compelling dense tracking results of the full body from a single RGB camera. However, existing methods either do not estimate clothing at all or model cloth deformation with…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yue Li , Marc Habermann , Bernhard Thomaszewski , Stelian Coros , Thabo Beeler , Christian Theobalt

We have recently seen great progress in building photorealistic animatable full-body codec avatars, but generating high-fidelity animation of clothing is still difficult. To address these difficulties, we propose a method to build an…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Donglai Xiang , Fabian Prada , Timur Bagautdinov , Weipeng Xu , Yuan Dong , He Wen , Jessica Hodgins , Chenglei Wu

Learning to reconstruct 3D garments is important for dressing 3D human bodies of different shapes in different poses. Previous works typically rely on 2D images as input, which however suffer from the scale and pose ambiguities. To…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Fangzhou Hong , Liang Pan , Zhongang Cai , Ziwei Liu

We present a novel neural implicit representation for articulated human bodies. Compared to explicit template meshes, neural implicit body representations provide an efficient mechanism for modeling interactions with the environment, which…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Marko Mihajlovic , Shunsuke Saito , Aayush Bansal , Michael Zollhoefer , Siyu Tang

Obtaining personalized 3D animatable avatars from a monocular camera has several real world applications in gaming, virtual try-on, animation, and VR/XR, etc. However, it is very challenging to model dynamic and fine-grained clothing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Yuxuan Xue , Bharat Lal Bhatnagar , Riccardo Marin , Nikolaos Sarafianos , Yuanlu Xu , Gerard Pons-Moll , Tony Tung

We present a new approach to 3D object representation where a neural network encodes the geometry of an object directly into the weights and biases of a second 'mapping' network. This mapping network can be used to reconstruct an object by…

Machine Learning · Computer Science 2020-04-07 Eric Mitchell , Selim Engin , Volkan Isler , Daniel D Lee

This paper presents a novel framework to recover detailed human body shapes from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Hao Zhu , Xinxin Zuo , Sen Wang , Xun Cao , Ruigang Yang

Articulated objects (e.g., doors and drawers) exist everywhere in our life. Different from rigid objects, articulated objects have higher degrees of freedom and are rich in geometries, semantics, and part functions. Modeling different kinds…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Yushi Du , Ruihai Wu , Yan Shen , Hao Dong

The combination of deep learning, artist-curated scans, and Implicit Functions (IF), is enabling the creation of detailed, clothed, 3D humans from images. However, existing methods are far from perfect. IF-based methods recover free-form…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yuliang Xiu , Jinlong Yang , Xu Cao , Dimitrios Tzionas , Michael J. Black

3D Garment modeling is a critical and challenging topic in the area of computer vision and graphics, with increasing attention focused on garment representation learning, garment reconstruction, and controllable garment manipulation,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Xipeng Chen , Guangrun Wang , Dizhong Zhu , Xiaodan Liang , Philip H. S. Torr , Liang Lin

While previous years have seen great progress in the 3D reconstruction of humans from monocular videos, few of the state-of-the-art methods are able to handle loose garments that exhibit large non-rigid surface deformations during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Chen Guo , Tianjian Jiang , Manuel Kaufmann , Chengwei Zheng , Julien Valentin , Jie Song , Otmar Hilliges

This paper explores a novel approach to model strategies for flattening wrinkled cloth learning from humans. A human participant study was conducted where the participants were presented with various wrinkle types and tasked with flattening…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Nilay Kant , Ashrut Aryal , Rajiv Ranganathan , Ranjan Mukherjee , Charles Owen

With the aim of creating virtual cloth deformations more similar to real world clothing, we propose a new computational framework that recasts three dimensional cloth deformation as an RGB image in a two dimensional pattern space. Then a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Ning Jin , Yilin Zhu , Zhenglin Geng , Ronald Fedkiw

A key challenge of learning a visual representation for the 3D high fidelity geometry of dressed humans lies in the limited availability of the ground truth data (e.g., 3D scanned models), which results in the performance degradation of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Yasamin Jafarian , Hyun Soo Park

Learning 3D shape representation with dense correspondence for deformable objects is a fundamental problem in computer vision. Existing approaches often need additional annotations of specific semantic domain, e.g., skeleton poses for human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Baowen Zhang , Jiahe Li , Xiaoming Deng , Yinda Zhang , Cuixia Ma , Hongan Wang

3D Reconstruction of moving articulated objects without additional information about object structure is a challenging problem. Current methods overcome such challenges by employing category-specific skeletal models. Consequently, they do…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Hao Zhang , Fang Li , Samyak Rawlekar , Narendra Ahuja

Human shape spaces have been extensively studied, as they are a core element of human shape and pose inference tasks. Classic methods for creating a human shape model register a surface template mesh to a database of 3D scans and use…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Stephan Wenninger , Fabian Kemper , Ulrich Schwanecke , Mario Botsch

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xue Hu , Xinghui Li , Benjamin Busam , Yiren Zhou , Ales Leonardis , Shanxin Yuan