English
Related papers

Related papers: Inferring Implicit 3D Representations from Human F…

200 papers

It is very challenging to accurately reconstruct sophisticated human geometry caused by various poses and garments from a single image. Recently, works based on pixel-aligned implicit function (PIFu) have made a big step and achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Zhangyang Xiong , Dong Du , Yushuang Wu , Jingqi Dong , Di Kang , Linchao Bao , Xiaoguang Han

There has been significant progress in generating an animatable 3D human avatar from a single image. However, recovering texture for the 3D human avatar from a single image has been relatively less addressed. Because the generated 3D human…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Sihun Cha , Kwanggyoon Seo , Amirsaman Ashtari , Junyong Noh

Personalised 3D vascular models are valuable for diagnosis, prognosis and treatment planning in patients with cardiovascular disease. Traditionally, such models have been constructed with explicit representations such as meshes and voxel…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Dieuwertje Alblas , Christoph Brune , Kak Khee Yeung , Jelmer M. Wolterink

Current methods for learning realistic and animatable 3D clothed avatars need either posed 3D scans or 2D images with carefully controlled user poses. In contrast, our goal is to learn an avatar from only 2D images of people in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Yuliang Xiu , Jinlong Yang , Dimitrios Tzionas , Michael J. Black

Implicit fields have recently shown increasing success in representing and learning 3D shapes accurately. Signed distance fields and occupancy fields are decades old and still the preferred representations, both with well-studied…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Edoardo Mello Rella , Ajad Chhatkuli , Ender Konukoglu , Luc Van Gool

In this paper, we present a simple yet effective method to automatically transfer textures of clothing images (front and back) to 3D garments worn on top SMPL, in real time. We first automatically compute training pairs of images with…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Aymen Mir , Thiemo Alldieck , Gerard Pons-Moll

We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image. To estimate the face geometry, we use a deep neural network to directly predict vertex coordinates of the 3D face…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Ruizhe Wang , Chih-Fan Chen , Hao Peng , Xudong Liu , Oliver Liu , Xin Li

3D Morphable Model (3DMM) based methods have achieved great success in recovering 3D face shapes from single-view images. However, the facial textures recovered by such methods lack the fidelity as exhibited in the input images. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiangke Lin , Yi Yuan , Tianjia Shao , Kun Zhou

We present 3DP3, a framework for inverse graphics that uses inference in a structured generative model of objects, scenes, and images. 3DP3 uses (i) voxel models to represent the 3D shape of objects, (ii) hierarchical scene graphs to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Nishad Gothoskar , Marco Cusumano-Towner , Ben Zinberg , Matin Ghavamizadeh , Falk Pollok , Austin Garrett , Joshua B. Tenenbaum , Dan Gutfreund , Vikash K. Mansinghka

We present an approach to infer the 3D shape, texture, and camera pose for an object from a single RGB image, using only category-level image collections with foreground masks as supervision. We represent the shape as an image-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Shubham Tulsiani , Nilesh Kulkarni , Abhinav Gupta

Neural implicit representations have become a popular choice for modeling surfaces due to their adaptability in resolution and support for complex topology. While previous works have achieved impressive reconstruction quality by training on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Lu Sang , Abhishek Saroha , Maolin Gao , Daniel Cremers

Realistic virtual humans play a crucial role in numerous industries, such as metaverse, intelligent healthcare, and self-driving simulation. But creating them on a large scale with high levels of realism remains a challenge. The utilization…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Xueting Yang , Yihao Luo , Yuliang Xiu , Wei Wang , Hao Xu , Zhaoxin Fan

Recent advances in 3D human shape estimation build upon parametric representations that model very well the shape of the naked body, but are not appropriate to represent the clothing geometry. In this paper, we present an approach to model…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Albert Pumarola , Jordi Sanchez , Gary P. T. Choi , Alberto Sanfeliu , Francesc Moreno-Noguer

Clothes undergo complex geometric deformations, which lead to appearance changes. To edit human videos in a physically plausible way, a texture map must take into account not only the garment transformation induced by the body movements and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Yasamin Jafarian , Tuanfeng Y. Wang , Duygu Ceylan , Jimei Yang , Nathan Carr , Yi Zhou , Hyun Soo Park

Human pose estimation (i.e., locating the body parts / joints of a person) is a fundamental problem in human-computer interaction and multimedia applications. Significant progress has been made based on the development of depth sensors,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-16 Keze Wang , Shengfu Zhai , Hui Cheng , Xiaodan Liang , Liang Lin

When interacting in a three dimensional world, humans must estimate 3D structure from visual inputs projected down to two dimensional retinal images. It has been shown that humans use the persistence of object shape over motion-induced…

Neurons and Cognition · Quantitative Biology 2023-04-03 Marissa Connor , Bruno Olshausen , Christopher Rozell

Recent advances in 3D deep learning have shown that it is possible to train highly effective deep models for 3D shape generation, directly from 2D images. This is particularly interesting since the availability of 3D models is still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Shichen Liu , Shunsuke Saito , Weikai Chen , Hao Li

Combining human body models with differentiable rendering has recently enabled animatable avatars of clothed humans from sparse sets of multi-view RGB videos. While state-of-the-art approaches achieve realistic appearance with neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Shaofei Wang , Katja Schwarz , Andreas Geiger , Siyu Tang

Realistic reconstruction of 3D clothing from an image has wide applications, such as avatar creation and virtual try-on. This paper presents a novel framework that reconstructs the texture map for 3D garments from a single image with pose.…

Graphics · Computer Science 2023-10-27 Hyun-Song Kwon , Sung-Hee Lee

We propose a simple and efficient method for exploiting synthetic images when training a Deep Network to predict a 3D pose from an image. The ability of using synthetic images for training a Deep Network is extremely valuable as it is easy…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Mahdi Rad , Markus Oberweger , Vincent Lepetit