English
Related papers

Related papers: Relightable 3D Head Portraits from a Smartphone Vi…

200 papers

Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene. Existing harmonization techniques often only focus on adjusting the global color and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mengwei Ren , Wei Xiong , Jae Shin Yoon , Zhixin Shu , Jianming Zhang , HyunJoon Jung , Guido Gerig , He Zhang

Previous face inverse rendering methods often require synthetic data with ground truth and/or professional equipment like a lighting stage. However, a model trained on synthetic data or using pre-defined lighting priors is typically unable…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Meng Wang , Xiaojie Guo , Wenjing Dai , Jiawan Zhang

This work presents a flexible system to reconstruct 3D models of objects captured with an RGB-D sensor. A major advantage of the method is that our reconstruction pipeline allows the user to acquire a full 3D model of the object. This is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-22 Aitor Aldoma , Johann Prankl , Alexander Svejda , Markus Vincze

We introduce a neural relighting algorithm for captured indoors scenes, that allows interactive free-viewpoint navigation. Our method allows illumination to be changed synthetically, while coherently rendering cast shadows and complex…

Graphics · Computer Science 2021-06-28 Julien Philip , Sébastien Morgenthaler , Michaël Gharbi , George Drettakis

The light stage has been widely used in computer graphics for the past two decades, primarily to enable the relighting of human faces. By capturing the appearance of the human subject under different light sources, one obtains the light…

Recent years have witnessed great progress in creating vivid audio-driven portraits from monocular videos. However, how to seamlessly adapt the created video avatars to other scenarios with different backgrounds and lighting conditions…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Haonan Qiu , Zhaoxi Chen , Yuming Jiang , Hang Zhou , Xiangyu Fan , Lei Yang , Wayne Wu , Ziwei Liu

In this paper, we present a learning-based approach for recovering the 3D geometry of human head from a single portrait image. Our method is learned in an unsupervised manner without any ground-truth 3D data. We represent the head geometry…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Sicheng Xu , Jiaolong Yang , Dong Chen , Fang Wen , Yu Deng , Yunde Jia , Xin Tong

Reconstructing 3D assets from images has long required separate pipelines for geometry reconstruction, material estimation, and illumination recovery, each with distinct limitations and computational overhead. We present ReLi3D, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Jan-Niklas Dihlmann , Mark Boss , Simon Donne , Andreas Engelhardt , Hendrik P. A. Lensch , Varun Jampani

In contrast to the traditional avatar creation pipeline which is a costly process, contemporary generative approaches directly learn the data distribution from photographs. While plenty of works extend unconditional generative models and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Junshu Tang , Bo Zhang , Binxin Yang , Ting Zhang , Dong Chen , Lizhuang Ma , Fang Wen

3D face reconstruction from Internet photos has recently produced exciting results. A person's face, e.g., Tom Hanks, can be modeled and animated in 3D from a completely uncalibrated photo collection. Most methods, however, focus solely on…

Computer Vision and Pattern Recognition · Computer Science 2018-09-14 Shu Liang , Linda G. Shapiro , Ira Kemelmacher-Shlizerman

A portrait is a painting, drawing, photograph, or engraving of a person, especially one depicting only the face or head and shoulders. In the digital world the portrait of a person is captured by having the person as a subject in the image…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Sumedh Vilas Datar and , Jesus Gonzales Bernal

Photographers routinely compose multiple manipulated photos of the same scene (layers) into a single image, which is better than any individual photo could be alone. Similarly, 3D artists set up rendering systems to produce layered images…

Graphics · Computer Science 2017-02-03 Carlo Innamorati , Tobias Ritschel , Tim Weyrich , Niloy J. Mitra

Video portraits relighting is critical in user-facing human photography, especially for immersive VR/AR experience. Recent advances still fail to recover consistent relit result under dynamic illuminations from monocular RGB stream,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Longwen Zhang , Qixuan Zhang , Minye Wu , Jingyi Yu , Lan Xu

Reconstructing the geometry and appearance of objects from photographs taken in different environments is difficult as the illumination and therefore the object appearance vary across captured images. This is particularly challenging for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Hadi Alzayer , Philipp Henzler , Jonathan T. Barron , Jia-Bin Huang , Pratul P. Srinivasan , Dor Verbin

We present a 3D-aware one-shot head reenactment method based on a fully volumetric neural disentanglement framework for source appearance and driver expressions. Our method is real-time and produces high-fidelity and view-consistent output,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Phong Tran , Egor Zakharov , Long-Nhat Ho , Anh Tuan Tran , Liwen Hu , Hao Li

Detailed 3D reconstruction and photo-realistic relighting of digital humans are essential for various applications. To this end, we propose a novel sparse-view 3d human reconstruction framework that closely incorporates the occupancy field…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Ruichen Zheng , Peng Li , Haoqian Wang , Tao Yu

The accurate characterisation of the 3D deformations of slender fibres and thin sheets in flow, is a key experimental challenge in the study of particle-laden flows. We propose a high-resolution, single-camera method to visualise…

Fluid Dynamics · Physics 2026-03-18 Tymoteusz Miara , Draga Pihler-Puzović , Matthias Heil , Anne Juel

We present Dynamic Neural Portraits, a novel approach to the problem of full-head reenactment. Our method generates photo-realistic video portraits by explicitly controlling head pose, facial expressions and eye gaze. Our proposed…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Michail Christos Doukas , Stylianos Ploumpis , Stefanos Zafeiriou

We present GroomLight, a novel method for relightable hair appearance modeling from multi-view images. Existing hair capture methods struggle to balance photorealistic rendering with relighting capabilities. Analytical material models,…

Recovering the 3D geometric structure of a face from a single input image is a challenging active research area in computer vision. In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s)…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Oussema Bouafif , Bogdan Khomutenko , Mohamed Daoudi