English
Related papers

Related papers: Learning to Decouple the Lights for 3D Face Textur…

200 papers

In this paper, we present an end-to-end learning framework for detailed 3D face reconstruction from a single image. Our approach uses a 3DMM-based coarse model and a displacement map in UV-space to represent a 3D face. Unlike previous work…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Yajing Chen , Fanzi Wu , Zeyu Wang , Yibing Song , Yonggen Ling , Linchao Bao

In this work, a system for creating a relightable 3D portrait of a human head is presented. Our neural pipeline operates on a sequence of frames captured by a smartphone camera with the flash blinking (flash-no flash sequence). A coarse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-21 Artem Sevastopolsky , Savva Ignatiev , Gonzalo Ferrer , Evgeny Burnaev , Victor Lempitsky

A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathan T. Barron , Jitendra Malik

Imaging in low light is challenging due to low photon count and low SNR. Short-exposure images suffer from noise, while long exposure can induce blur and is often impractical. A variety of denoising, deblurring, and enhancement techniques…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Chen Chen , Qifeng Chen , Jia Xu , Vladlen Koltun

One of the serious issues in communication between people is hiding information from others, and the best way for this, is deceiving them. Since nowadays face images are mostly used in three dimensional format, in this paper we are going to…

Multimedia · Computer Science 2018-01-19 Mohsen Moradi , Mohammad-Reza Sadeghi

Monocular depth estimation, enabled by self-supervised learning, is a key technique for 3D perception in computer vision. However, it faces significant challenges in real-world scenarios, which encompass adverse weather variations, motion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Runze Chen , Haiyong Luo , Fang Zhao , Jingze Yu , Yupeng Jia , Juan Wang , Xuepeng Ma

In nighttime circumstances, it is challenging for individuals and machines to perceive their surroundings. While prevailing image restoration methods adeptly handle singular forms of degradation, they falter when confronted with intricate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yifan Chen , Fei Yin , Chunle Guo , Chongyi Li , Yujiu Yang

Recent works have shown exciting results in unsupervised image de-rendering -- learning to decompose 3D shape, appearance, and lighting from single-image collections without explicit supervision. However, many of these assume simplistic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Shangzhe Wu , Ameesh Makadia , Jiajun Wu , Noah Snavely , Richard Tucker , Angjoo Kanazawa

We introduce light diffusion, a novel method to improve lighting in portraits, softening harsh shadows and specular highlights while preserving overall scene illumination. Inspired by professional photographers' diffusers and scrims, our…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 David Futschik , Kelvin Ritland , James Vecore , Sean Fanello , Sergio Orts-Escolano , Brian Curless , Daniel Sýkora , Rohit Pandey

We introduce a deep appearance model for rendering the human face. Inspired by Active Appearance Models, we develop a data-driven rendering pipeline that learns a joint representation of facial geometry and appearance from a multiview…

Graphics · Computer Science 2018-08-02 Stephen Lombardi , Jason Saragih , Tomas Simon , Yaser Sheikh

Recent work on the intrinsic image of humans starts to consider the visibility of incident illumination and encodes the light transfer function by spherical harmonics. In this paper, we show that such a light transfer function can be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-10 Fuzhi Zhong , Rui Wang , Yuchi Huo , Hujun Bao

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Image generating neural networks are mostly viewed as black boxes, where any change in the input can have a number of globally effective changes on the output. In this work, we propose a method for learning disentangled representations to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Maren Awiszus , Hanno Ackermann , Bodo Rosenhahn

Neural reconstruction and rendering strategies have demonstrated state-of-the-art performances due, in part, to their ability to preserve high level shape details. Existing approaches, however, either represent objects as implicit surface…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Angtian Wang , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Edmond Boyer , Alan Yuille , Tony Tung

Recovering the 3D shape of transparent objects using a small number of unconstrained natural images is an ill-posed problem. Complex light paths induced by refraction and reflection have prevented both traditional and deep multiview stereo…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Zhengqin Li , Yu-Ying Yeh , Manmohan Chandraker

In the beginning stage, face verification is done using easy method of geometric algorithm models, but the verification route has now developed into a scientific progress of complicated geometric representation and identical procedure. In…

Computer Vision and Pattern Recognition · Computer Science 2014-03-24 V. Karthikeyan , K. Vijayalakshmi , P. Jeyakumar

This paper addresses the task of estimating the light arriving from all directions to a 3D point observed at a selected pixel in an RGB image. This task is challenging because it requires predicting a mapping from a partial scene…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Shuran Song , Thomas Funkhouser

Recovering surface albedos from photogrammetric images for realistic rendering and synthetic environments can greatly facilitate its downstream applications in VR/AR/MR and digital twins. The textured 3D models from standard photogrammetric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Shuang Song , Rongjun Qin

While current monocular 3D face reconstruction methods can recover fine geometric details, they suffer several limitations. Some methods produce faces that cannot be realistically animated because they do not model how wrinkles vary with…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Yao Feng , Haiwen Feng , Michael J. Black , Timo Bolkart

The reconstruction of dense 3D models of face geometry and appearance from a single image is highly challenging and ill-posed. To constrain the problem, many approaches rely on strong priors, such as parametric face models learned from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Ayush Tewari , Michael Zollhöfer , Pablo Garrido , Florian Bernard , Hyeongwoo Kim , Patrick Pérez , Christian Theobalt