English
Related papers

Related papers: Structured 3D Features for Reconstructing Controll…

200 papers

In this paper, we propose a novel multi-level aggregation network to regress the coordinates of the vertices of a 3D face from a single 2D image in an end-to-end manner. This is achieved by seamlessly combining standard convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Yanda Meng , Xu Chen , Dongxu Gao , Yitian Zhao , Xiaoyun Yang , Yihong Qiao , Xiaowei Huang , Yalin Zheng

Morphable Models (3DMMs) are a type of morphable model that takes 2D images as inputs and recreates the structure and physical appearance of 3D objects, especially human faces and bodies. 3DMM combines identity and expression blendshapes…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Gulraiz Khan , Kenneth Y. Wertheim , Kevin Pimbblet , Waqas Ahmed

Physically-based simulation is a powerful approach for 3D facial animation as the resulting deformations are governed by physical constraints, allowing to easily resolve self-collisions, respond to external forces and perform realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Lingchen Yang , Gaspard Zoss , Prashanth Chandran , Markus Gross , Barbara Solenthaler , Eftychios Sifakis , Derek Bradley

Learning geometry, motion, and appearance priors of object classes is important for the solution of a large variety of computer vision problems. While the majority of approaches has focused on static objects, dynamic objects, especially…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Fangyin Wei , Rohan Chabra , Lingni Ma , Christoph Lassner , Michael Zollhöfer , Szymon Rusinkiewicz , Chris Sweeney , Richard Newcombe , Mira Slavcheva

We present a novel method to improve the accuracy of the 3D reconstruction of clothed human shape from a single image. Recent work has introduced volumetric, implicit and model-based shape learning frameworks for reconstruction of objects…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Akin Caliskan , Armin Mustafa , Evren Imre , Adrian Hilton

We present the first method that automatically transfers poses between stylized 3D characters without skeletal rigging. In contrast to previous attempts to learn pose transformations on fixed or topology-equivalent skeleton templates, our…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Zhouyingcheng Liao , Jimei Yang , Jun Saito , Gerard Pons-Moll , Yang Zhou

Recovery of articulated 3D structure from 2D observations is a challenging computer vision problem with many applications. Current learning-based approaches achieve state-of-the-art accuracy on public benchmarks but are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Onorina Kovalenko , Vladislav Golyanik , Jameel Malik , Ahmed Elhayek , Didier Stricker

Reconstructing personalized animatable head avatars has significant implications in the fields of AR/VR. Existing methods for achieving explicit face control of 3D Morphable Models (3DMM) typically rely on multi-view images or videos of a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Haoyu Ma , Tong Zhang , Shanlin Sun , Xiangyi Yan , Kun Han , Xiaohui Xie

Reconstructing 3D shapes from a single image plays an important role in computer vision. Many methods have been proposed and achieve impressive performance. However, existing methods mainly focus on extracting semantic information from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Shaoming Li , Qing Cai , Songqi Kong , Runqing Tan , Heng Tong , Shiji Qiu , Yongguo Jiang , Zhi Liu

Humans can infer the three-dimensional structure of objects from two-dimensional visual inputs. Modeling this ability has been a longstanding goal for the science and engineering of visual intelligence, yet decades of computational methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Tyler Bonnen , Jitendra Malik , Angjoo Kanazawa

We consider the problem of active 3D imaging using single-shot structured light systems, which are widely employed in commercial 3D sensing devices such as Apple Face ID and Intel RealSense. Traditional structured light methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Jiaheng Li , Qiyu Dai , Lihan Li , Praneeth Chakravarthula , He Sun , Baoquan Chen , Wenzheng Chen

One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces. Specifically, the suboptimally disentangled identity information of driving subjects would inevitably interfere with the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Yunfan Liu , Qi Li , Zhenan Sun , Tieniu Tan

Accurately predicting the 3D shape of any arbitrary object in any pose from a single image is a key goal of computer vision research. This is challenging as it requires a model to learn a representation that can infer both the visible and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Anh Thai , Stefan Stojanov , Vijay Upadhya , James M. Rehg

Scene reconstruction from multi-view images is a fundamental problem in computer vision and graphics. Recent neural implicit surface reconstruction methods have achieved high-quality results; however, editing and manipulating the 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xiaoyang Lyu , Chirui Chang , Peng Dai , Yang-Tian Sun , Xiaojuan Qi

Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limited number of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Mallikarjun B R , Ayush Tewari , Hans-Peter Seidel , Mohamed Elgharib , Christian Theobalt

In this paper, we present a diffusion model-based framework for animating people from a single image for a given target 3D motion sequence. Our approach has two core components: a) learning priors about invisible parts of the human body and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Boyi Li , Junming Chen , Jathushan Rajasegaran , Yossi Gandelsman , Alexei A. Efros , Jitendra Malik

We introduce a highly robust GAN-based framework for digitizing a normalized 3D avatar of a person from a single unconstrained photo. While the input image can be of a smiling person or taken in extreme lighting conditions, our method can…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Huiwen Luo , Koki Nagano , Han-Wei Kung , Mclean Goldwhite , Qingguo Xu , Zejian Wang , Lingyu Wei , Liwen Hu , Hao Li

We propose a new framework for creating and easily manipulating 3D models of arbitrary objects using casually captured videos. Our core ingredient is a novel hierarchy deformation model, which captures motions of objects with a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Subin Jeon , In Cho , Minsu Kim , Woong Oh Cho , Seon Joo Kim

Monocular 3D human pose estimation poses significant challenges due to the inherent depth ambiguities that arise during the reprojection process from 2D to 3D. Conventional approaches that rely on estimating an over-fit projection matrix…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Junkun Jiang , Jie Chen

We propose a Transformer-based framework for 3D human texture estimation from a single image. The proposed Transformer is able to effectively exploit the global information of the input image, overcoming the limitations of existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xiangyu Xu , Chen Change Loy