English
Related papers

Related papers: Riggable 3D Face Reconstruction via In-Network Opt…

200 papers

Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities. However, it is not practical to assume that 2D input images and their…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yi-Lun Liao , Yao-Cheng Yang , Yu-Chiang Frank Wang

We propose SelfRecon, a clothed human body reconstruction method that combines implicit and explicit representations to recover space-time coherent geometries from a monocular self-rotating human video. Explicit methods require a predefined…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Boyi Jiang , Yang Hong , Hujun Bao , Juyong Zhang

Self-localization on a 3D map by using an inexpensive monocular camera is required to realize autonomous driving. Self-localization based on a camera often uses a convolutional neural network (CNN) that can extract local features that are…

Robotics · Computer Science 2025-12-19 Satoshi Kikuchi , Masaya Kato , Tsuyoshi Tasaki

We present a novel strategy to automatically reconstruct 3D faces from monocular images with explicitly disentangled facial geometry (pose, identity and expression), reflectance (diffuse and specular albedo), and self-shadows. The scene…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Abdallah Dib , Gaurav Bharaj , Junghyun Ahn , Cedric Thebault , Philippe-Henri Gosselin , Louis Chevallier

3D face reconstruction and face alignment are two fundamental and highly related topics in computer vision. Recently, some works start to use deep learning models to estimate the 3DMM coefficients to reconstruct 3D face geometry. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Zihao Jian , Minshan Xie

Recent advances in self-supervised learning havedemonstrated that it is possible to learn accurate monoculardepth reconstruction from raw video data, without using any 3Dground truth for supervision. However, in robotics…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Robert McCraith , Lukas Neumann , Andrew Zisserman , Andrea Vedaldi

This work focuses on the 3D reconstruction of non-rigid objects based on monocular RGB video sequences. Concretely, we aim at building high-fidelity models for generic object categories and casually captured scenes. To this end, we do not…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yikai Wang , Yinpeng Dong , Fuchun Sun , Xiao Yang

3D face reconstruction is an important task in the field of computer vision. Although 3D face reconstruction has being developing rapidly in recent years, it is still a challenge for face reconstruction under large pose. That is because…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Lei Jiang , XiaoJun Wu , Josef Kittler

To be suitable for film-quality animation, rigs for character deformation must fulfill a broad set of requirements. They must be able to create highly stylized deformation, allow a wide variety of controls to permit artistic freedom, and…

Graphics · Computer Science 2020-08-19 Steven L. Song , Weiqi Shi , Michael Reed

Many recent works have reconstructed distinctive 3D face shapes by aggregating shape parameters of the same identity and separating those of different people based on parametric models (e.g., 3D morphable models (3DMMs)). However, despite…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Diqiong Jiang , Yiwei Jin , Fanglue Zhang , Yukun Yai , Risheng Deng , Ruofeng Tong , Min Tang

Recent progress in human shape learning, shows that neural implicit models are effective in generating 3D human surfaces from limited number of views, and even from a single RGB image. However, existing monocular approaches still struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Marco Pesavento , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Ziyan Wang , Chun-Han Yao , Marco Volino , Edmond Boyer , Adrian Hilton , Tony Tung

Motivated by augmented and virtual reality applications such as telepresence, there has been a recent focus in real-time performance capture of humans under motion. However, given the real-time constraint, these systems often suffer from…

In this paper, we introduce a novel approach to learn a 3D face model using a joint-based face rig and a neural skinning network. Thanks to the joint-based representation, our model enjoys some significant advantages over prior…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Noranart Vesdapunt , Mitch Rundle , HsiangTao Wu , Baoyuan Wang

Accurate depth estimation is at the core of many applications in computer graphics, vision, and robotics. Current state-of-the-art monocular depth estimators, trained on extensive datasets, generalize well but lack 3D consistency needed for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Laura Fink , Linus Franke , Bernhard Egger , Joachim Keinert , Marc Stamminger

Single-view 3D face reconstruction is a fundamental Computer Vision problem of extraordinary difficulty. Current systems often assume the input is unobstructed faces which makes their method not suitable for in-the-wild conditions. We…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Dapeng Zhao , Yue Qi

Recent advances in full-head reconstruction have been obtained by optimizing a neural field through differentiable surface or volume rendering to represent a single scene. While these techniques achieve an unprecedented accuracy, they take…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Antonio Canela , Pol Caselles , Ibrar Malik , Eduard Ramon , Jaime García , Jordi Sánchez-Riera , Gil Triginer , Francesc Moreno-Noguer

Existing methods for 3D face reconstruction from a few casually captured images employ deep learning based models along with a 3D Morphable Model(3DMM) as face geometry prior. Structure From Motion(SFM), followed by Multi-View Stereo (MVS),…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Raja Kumar , Jiahao Luo , Alex Pang , James Davis

In this work, we develop a novel technique for reconstructing images from projection-based nano- and microtomography. Our contribution focuses on enhancing reconstruction quality, particularly for specimen composed of homogeneous material…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Anuraag Mishra , Andrea Gilch , Benjamin Apeleo Zubiri , Jan Rolfes , Frauke Liers

Recent 3D face reconstruction methods have made remarkable advancements, yet there remain huge challenges in monocular high-quality facial reflectance reconstruction. Existing methods rely on a large amount of light-stage captured data to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Xingyu Ren , Jiankang Deng , Yuhao Cheng , Jia Guo , Chao Ma , Yichao Yan , Wenhan Zhu , Xiaokang Yang

Recently, deep neural network has shown promising performance in face image recognition. The inputs of most networks are face images, and there is hardly any work reported in literature on network with face videos as input. To sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2016-03-23 Zhen Dong , Su Jia , Chi Zhang , Mingtao Pei