English
Related papers

Related papers: ICON: Implicit Clothed humans Obtained from Normal…

200 papers

Unsupervised generation of 3D-aware clothed humans with various appearances and controllable geometries is important for creating virtual human avatars and other AR/VR applications. Existing methods are either limited to rigid object…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

We propose SelfRecon, a clothed human body reconstruction method that combines implicit and explicit representations to recover space-time coherent geometries from a monocular self-rotating human video. Explicit methods require a predefined…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Boyi Jiang , Yang Hong , Hujun Bao , Juyong Zhang

This paper presents a framework for efficient 3D clothed avatar reconstruction. By combining the advantages of the high accuracy of optimization-based methods and the efficiency of learning-based methods, we propose a coarse-to-fine way to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Tingting Liao , Xiaomei Zhang , Yuliang Xiu , Hongwei Yi , Xudong Liu , Guo-Jun Qi , Yong Zhang , Xuan Wang , Xiangyu Zhu , Zhen Lei

We propose united implicit functions (UNIF), a part-based method for clothed human reconstruction and animation with raw scans and skeletons as the input. Previous part-based methods for human reconstruction rely on ground-truth part labels…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Shenhan Qian , Jiale Xu , Ziwei Liu , Liqian Ma , Shenghua Gao

Neural Radiance Fields (NeRF) exhibit remarkable performance for Novel View Synthesis (NVS) given a set of 2D images. However, NeRF training requires accurate camera pose for each input view, typically obtained by Structure-from-Motion…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Weiyao Wang , Pierre Gleize , Hao Tang , Xingyu Chen , Kevin J Liang , Matt Feiszli

We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Kaiyue Shen , Chen Guo , Manuel Kaufmann , Juan Jose Zarate , Julien Valentin , Jie Song , Otmar Hilliges

Reconstructing realistic 3D human avatars from monocular videos is a challenging task due to the limited geometric information and complex non-rigid motion involved. We present MonoCloth, a new method for reconstructing and animating…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Daisheng Jin , Ying He

We present ARCH++, an image-based method to reconstruct 3D avatars with arbitrary clothing styles. Our reconstructed avatars are animation-ready and highly realistic, in both the visible regions from input views and the unseen regions.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Tong He , Yuanlu Xu , Shunsuke Saito , Stefano Soatto , Tony Tung

The task of reconstructing detailed 3D human body models from images is interesting but challenging in computer vision due to the high freedom of human bodies. In order to tackle the problem, we propose a coarse-to-fine method to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongguo Li , Magnus Oskarsson , Anders Heyden

In this report, we focus on reconstructing clothed humans in the canonical space given multiple views and poses of a human as the input. To achieve this, we utilize the geometric prior of the SMPLX model in the canonical space to learn the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Jianchuan Chen , Wentao Yi , Tiantian Wang , Xing Li , Liqian Ma , Yangyu Fan , Huchuan Lu

Traditional 3D morphable face models (3DMMs) provide fine-grained control over expression but cannot easily capture geometric and appearance details. Neural volumetric representations approach photorealism but are hard to animate and do not…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Yufeng Zheng , Victoria Fernández Abrevaya , Marcel C. Bühler , Xu Chen , Michael J. Black , Otmar Hilliges

Parametric 3D body models like SMPL only represent minimally-clothed people and are hard to extend to clothing because they have a fixed mesh topology and resolution. To address these limitations, recent work uses implicit surfaces or point…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Qianli Ma , Jinlong Yang , Michael J. Black , Siyu Tang

We introduce Pixel-aligned Implicit Function (PIFu), a highly effective implicit representation that locally aligns pixels of 2D images with the global context of their corresponding 3D object. Using PIFu, we propose an end-to-end deep…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Shunsuke Saito , Zeng Huang , Ryota Natsume , Shigeo Morishima , Angjoo Kanazawa , Hao Li

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

We propose a novel framework for decomposing arbitrarily posed humans into animatable multi-layered 3D human avatars, separating the body and garments. Conventional single-layer reconstruction methods lock clothing to one identity, while…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yinghan Xu , John Dingliana

3D Reconstruction of moving articulated objects without additional information about object structure is a challenging problem. Current methods overcome such challenges by employing category-specific skeletal models. Consequently, they do…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Hao Zhang , Fang Li , Samyak Rawlekar , Narendra Ahuja

Learning to model and reconstruct humans in clothing is challenging due to articulation, non-rigid deformation, and varying clothing types and topologies. To enable learning, the choice of representation is the key. Recent work uses neural…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Qianli Ma , Shunsuke Saito , Jinlong Yang , Siyu Tang , Michael J. Black

We introduce PICA, a novel representation for high-fidelity animatable clothed human avatars with physics-accurate dynamics, even for loose clothing. Previous neural rendering-based representations of animatable clothed humans typically…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Bo Peng , Yunfan Tao , Haoyu Zhan , Yudong Guo , Juyong Zhang

To reconstruct a 3D human surface from a single image, it is crucial to simultaneously consider human pose, shape, and clothing details. Recent approaches have combined parametric body models (such as SMPL), which capture body pose and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Baoxing Li , Yong Deng , Yehui Yang , Xu Zhao

Combining human body models with differentiable rendering has recently enabled animatable avatars of clothed humans from sparse sets of multi-view RGB videos. While state-of-the-art approaches achieve realistic appearance with neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Shaofei Wang , Katja Schwarz , Andreas Geiger , Siyu Tang