English
Related papers

Related papers: Pixel2ISDF: Implicit Signed Distance Fields based …

200 papers

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

Signed distance functions (SDFs) is an attractive framework that has recently shown promising results for 3D shape reconstruction from images. SDFs seamlessly generalize to different shape resolutions and topologies but lack explicit…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Zerui Chen , Shizhe Chen , Cordelia Schmid , Ivan Laptev

We present Pose-NDF, a continuous model for plausible human poses based on neural distance fields (NDFs). Pose or motion priors are important for generating realistic new poses and for reconstructing accurate poses from noisy or partial…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Garvita Tiwari , Dimitrije Antic , Jan Eric Lenssen , Nikolaos Sarafianos , Tony Tung , Gerard Pons-Moll

Recent advances in image-based 3D human shape estimation have been driven by the significant improvement in representation power afforded by deep neural networks. Although current approaches have demonstrated the potential in real world…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Shunsuke Saito , Tomas Simon , Jason Saragih , Hanbyul Joo

3D textured shape recovery from partial scans is crucial for many real-world applications. Existing approaches have demonstrated the efficacy of implicit function representation, but they suffer from partial inputs with severe occlusions…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Lei Li , Zhizheng Liu , Weining Ren , Liudi Yang , Fangjinhua Wang , Marc Pollefeys , Songyou Peng

We introduce Pixel-aligned Implicit Function (PIFu), a highly effective implicit representation that locally aligns pixels of 2D images with the global context of their corresponding 3D object. Using PIFu, we propose an end-to-end deep…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Shunsuke Saito , Zeng Huang , Ryota Natsume , Shigeo Morishima , Angjoo Kanazawa , Hao Li

A signed distance function (SDF) as the 3D shape description is one of the most effective approaches to represent 3D geometry for rendering and reconstruction. Our work is inspired by the state-of-the-art method DeepSDF that learns and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Shun Yao , Fei Yang , Yongmei Cheng , Mikhail G. Mozerov

This paper addresses the challenge of reconstructing an animatable human model from a multi-view video. Some recent works have proposed to decompose a non-rigidly deforming scene into a canonical neural radiance field and a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Sida Peng , Zhen Xu , Junting Dong , Qianqian Wang , Shangzhan Zhang , Qing Shuai , Hujun Bao , Xiaowei Zhou

We present a novel method to improve the accuracy of the 3D reconstruction of clothed human shape from a single image. Recent work has introduced volumetric, implicit and model-based shape learning frameworks for reconstruction of objects…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Akin Caliskan , Armin Mustafa , Evren Imre , Adrian Hilton

We introduce a novel bottom-up approach for human body mesh reconstruction, specifically designed to address the challenges posed by partial visibility and occlusion in input images. Traditional top-down methods, relying on whole-body…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Tianyu Luan , Zhongpai Gao , Luyuan Xie , Abhishek Sharma , Hao Ding , Benjamin Planche , Meng Zheng , Ange Lou , Terrence Chen , Junsong Yuan , Ziyan Wu

Dressed people reconstruction from images is a popular task with promising applications in the creative media and game industry. However, most existing methods reconstruct the human body and garments as a whole with the supervision of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yue Shi , Yuxuan Xiong , Jingyi Chai , Bingbing Ni , Wenjun Zhang

This paper presents a novel framework to recover detailed human body shapes from a single image. It is a challenging task due to factors such as variations in human shapes, body poses, and viewpoints. Prior methods typically attempt to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Hao Zhu , Xinxin Zuo , Sen Wang , Xun Cao , Ruigang Yang

Deep implicit functions have shown remarkable shape modeling ability in various 3D computer vision tasks. One drawback is that it is hard for them to represent a 3D shape as multiple parts. Current solutions learn various primitives and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chao Chen , Yu-Shen Liu , Zhizhong Han

The 3D world limits the human body pose and the human body pose conveys information about the surrounding objects. Indeed, from a single image of a person placed in an indoor scene, we as humans are adept at resolving ambiguities of the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Zhenzhen Weng , Serena Yeung

We present MeshLeTemp, a powerful method for 3D human pose and mesh reconstruction from a single image. In terms of human body priors encoding, we propose using a learnable template human mesh instead of a constant template as utilized by…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Trung Tran-Quang , Cuong Than-Cao , Hai Nguyen-Thanh , Hong Hoang Si

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

Learning to model and reconstruct humans in clothing is challenging due to articulation, non-rigid deformation, and varying clothing types and topologies. To enable learning, the choice of representation is the key. Recent work uses neural…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Qianli Ma , Shunsuke Saito , Jinlong Yang , Siyu Tang , Michael J. Black

We present HIPNet, a neural implicit pose network trained on multiple subjects across many poses. HIPNet can disentangle subject-specific details from pose-specific details, effectively enabling us to retarget motion from one subject to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Sourav Biswas , Kangxue Yin , Maria Shugrina , Sanja Fidler , Sameh Khamis

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Amine Ouasfi , Adnane Boukhayma

In this work, we focus on the task of learning and representing dense correspondences in deformable object categories. While this problem has been considered before, solutions so far have been rather ad-hoc for specific object types (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Natalia Neverova , David Novotny , Vasil Khalidov , Marc Szafraniec , Patrick Labatut , Andrea Vedaldi