English
Related papers

Related papers: i3DMM: Deep Implicit 3D Morphable Model of Human H…

200 papers

3D Morphable Models (3DMMs) are statistical models that represent facial texture and shape variations using a set of linear bases and more particular Principal Component Analysis (PCA). 3DMMs were used as statistical priors for…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yuxiang Zhou , Jiankang Deng , Irene Kotsia , Stefanos Zafeiriou

Most 3D face reconstruction methods rely on 3D morphable models, which disentangle the space of facial deformations into identity geometry, expressions and skin reflectance. These models are typically learned from a limited number of 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Mallikarjun B R , Ayush Tewari , Hans-Peter Seidel , Mohamed Elgharib , Christian Theobalt

We present a new end-to-end learning framework to obtain detailed and spatially coherent reconstructions of multiple people from a single image. Existing multi-person methods suffer from two main drawbacks: they are often model-based and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Armin Mustafa , Akin Caliskan , Lourdes Agapito , Adrian Hilton

We present imGHUM, the first holistic generative model of 3D human shape and articulated pose, represented as a signed distance function. In contrast to prior work, we model the full human body implicitly as a function zero-level-set and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Thiemo Alldieck , Hongyi Xu , Cristian Sminchisescu

Morphable Models (3DMMs) are a type of morphable model that takes 2D images as inputs and recreates the structure and physical appearance of 3D objects, especially human faces and bodies. 3DMM combines identity and expression blendshapes…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Gulraiz Khan , Kenneth Y. Wertheim , Kevin Pimbblet , Waqas Ahmed

3D Morphable Models (3DMMs) enable controllable facial geometry and expression editing for reconstruction, animation, and AR/VR, but traditional PCA-based mesh models are limited in resolution, detail, and photorealism. Neural volumetric…

In this paper, we introduce the Volumetric Relightable Morphable Model (VRMM), a novel volumetric and parametric facial prior for 3D face modeling. While recent volumetric prior models offer improvements over traditional methods like 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Haotian Yang , Mingwu Zheng , Chongyang Ma , Yu-Kun Lai , Pengfei Wan , Haibin Huang

As a classic statistical model of 3D facial shape and albedo, 3D Morphable Model (3DMM) is widely used in facial analysis, e.g., model fitting, image synthesis. Conventional 3DMM is learned from a set of 3D face scans with associated…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Luan Tran , Xiaoming Liu

In this work, we present a new method for 3D face reconstruction from sparse-view RGB images. Unlike previous methods which are built upon 3D morphable models (3DMMs) with limited details, we leverage an implicit representation to encode…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Moran Li , Haibin Huang , Yi Zheng , Mengtian Li , Nong Sang , Chongyang Ma

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

The 3D shapes of faces are well known to be discriminative. Yet despite this, they are rarely used for face recognition and always under controlled viewing conditions. We claim that this is a symptom of a serious but often overlooked…

Computer Vision and Pattern Recognition · Computer Science 2016-12-16 Anh Tuan Tran , Tal Hassner , Iacopo Masi , Gerard Medioni

Deep implicit functions (DIFs), as a kind of 3D shape representation, are becoming more and more popular in the 3D vision community due to their compactness and strong representation power. However, unlike polygon mesh-based templates, it…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Zerong Zheng , Tao Yu , Qionghai Dai , Yebin Liu

Inverse rendering in a 3D format denoted to recovering the 3D properties of a scene given 2D input image(s) and is typically done using 3D Morphable Model (3DMM) based methods from single view images. These models formulate each face as a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Shima Kamyab , Ali Ghodsi , S. Zohreh Azimifar

Recent learning approaches that implicitly represent surface geometry using coordinate-based neural representations have shown impressive results in the problem of multi-view 3D reconstruction. The effectiveness of these techniques is,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Eduard Ramon , Gil Triginer , Janna Escur , Albert Pumarola , Jaime Garcia , Xavier Giro-i-Nieto , Francesc Moreno-Noguer

Human perception of 3D shapes goes beyond reconstructing them as a set of points or a composition of geometric primitives: we also effortlessly understand higher-level shape structure such as the repetition and reflective symmetry of object…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yonglong Tian , Andrew Luo , Xingyuan Sun , Kevin Ellis , William T. Freeman , Joshua B. Tenenbaum , Jiajun Wu

We introduce a novel approach for high-resolution talking head generation from a single image and audio input. Prior methods using explicit face models, like 3D morphable models (3DMM) and facial landmarks, often fall short in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Sejong Yang , Seoung Wug Oh , Yang Zhou , Seon Joo Kim

For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xue Hu , Xinghui Li , Benjamin Busam , Yiren Zhou , Ales Leonardis , Shanxin Yuan

3D Morphable Models (3DMMs) are powerful statistical models of 3D facial shape and texture, and among the state-of-the-art methods for reconstructing facial shape from single images. With the advent of new 3D sensors, many 3D facial…

Computer Vision and Pattern Recognition · Computer Science 2017-01-20 James Booth , Epameinondas Antonakos , Stylianos Ploumpis , George Trigeorgis , Yannis Panagakis , Stefanos Zafeiriou

We introduce StyleMM, a novel framework that can construct a stylized 3D Morphable Model (3DMM) based on user-defined text descriptions specifying a target style. Building upon a pre-trained mesh deformation network and a texture generator…

Graphics · Computer Science 2025-08-18 Seungmi Lee , Kwan Yun , Junyong Noh

The task of shape abstraction with semantic part consistency is challenging due to the complex geometries of natural objects. Recent methods learn to represent an object shape using a set of simple primitives to fit the target.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Di Liu , Long Zhao , Qilong Zhangli , Yunhe Gao , Ting Liu , Dimitris N. Metaxas