English
Related papers

Related papers: Learning Illumination from Diverse Portraits

200 papers

High Dynamic Range (HDR) imaging aims to reproduce the wide range of brightness levels present in natural scenes, which the human visual system can perceive but conventional digital cameras often fail to capture due to their limited dynamic…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Kumbha Nagaswetha

Recent High Dynamic Range (HDR) techniques extend the capabilities of current cameras where scenes with a wide range of illumination can not be accurately captured with a single low-dynamic-range (LDR) image. This is generally accomplished…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Michal Nazarczuk , Sibi Catley-Chandar , Ales Leonardis , Eduardo Pérez-Pellitero

We introduce SynthLight, a diffusion model for portrait relighting. Our approach frames image relighting as a re-rendering problem, where pixels are transformed in response to changes in environmental lighting conditions. Using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Sumit Chaturvedi , Mengwei Ren , Yannick Hold-Geoffroy , Jingyuan Liu , Julie Dorsey , Zhixin Shu

High dynamic range (HDR) rendering has the ability to faithfully reproduce the wide luminance ranges in natural scenes, but how to accurately assess the rendering quality is relatively underexplored. Existing quality models are mostly…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Peibei Cao , Rafal K. Mantiuk , Kede Ma

We present a method to estimate lighting from a single image of an indoor scene. Previous work has used an environment map representation that does not account for the localized nature of indoor lighting. Instead, we represent lighting as a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Marc-André Gardner , Yannick Hold-Geoffroy , Kalyan Sunkavalli , Christian Gagné , Jean-François Lalonde

Despite recent breakthroughs in deep learning methods for image lighting enhancement, they are inferior when applied to portraits because 3D facial information is ignored in their models. To address this, we present a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Fangzhou Han , Can Wang , Hao Du , Jing Liao

In this paper we present a deep learning method to estimate the illuminant of an image. Our model is not trained with illuminant annotations, but with the objective of improving performance on an auxiliary task such as object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Marco Buzzelli , Joost van de Weijer , Raimondo Schettini

High dynamic range (HDR) imaging is an indispensable technique in modern photography. Traditional methods focus on HDR reconstruction from multiple images, solving the core problems of image alignment, fusion, and tone mapping, yet having a…

Image and Video Processing · Electrical Eng. & Systems 2022-10-31 Phuoc-Hieu Le , Quynh Le , Rang Nguyen , Binh-Son Hua

Recent advances in implicit neural representations and differentiable rendering make it possible to simultaneously recover the geometry and materials of an object from multi-view RGB images captured under unknown static illumination.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Yuanqing Zhang , Jiaming Sun , Xingyi He , Huan Fu , Rongfei Jia , Xiaowei Zhou

Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene. Existing harmonization techniques often only focus on adjusting the global color and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mengwei Ren , Wei Xiong , Jae Shin Yoon , Zhixin Shu , Jianming Zhang , HyunJoon Jung , Guido Gerig , He Zhang

We present a method to edit complex indoor lighting from a single image with its predicted depth and light source segmentation masks. This is an extremely challenging problem that requires modeling complex light transport, and disentangling…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zhengqin Li , Jia Shi , Sai Bi , Rui Zhu , Kalyan Sunkavalli , Miloš Hašan , Zexiang Xu , Ravi Ramamoorthi , Manmohan Chandraker

Relighting of human images has various applications in image synthesis. For relighting, we must infer albedo, shape, and illumination from a human portrait. Previous techniques rely on human faces for this inference, based on spherical…

Graphics · Computer Science 2019-08-12 Yoshihiro Kanamori , Yuki Endo

Digital imaging aims to replicate realistic scenes, but Low Dynamic Range (LDR) cameras cannot represent the wide dynamic range of real scenes, resulting in under-/overexposed images. This paper presents a deep learning-based approach for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Dwip Dalal , Gautam Vashishtha , Prajwal Singh , Shanmuganathan Raman

This paper addresses the task of estimating the light arriving from all directions to a 3D point observed at a selected pixel in an RGB image. This task is challenging because it requires predicting a mapping from a partial scene…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Shuran Song , Thomas Funkhouser

We propose a data-driven learned sky model, which we use for outdoor lighting estimation from a single image. As no large-scale dataset of images and their corresponding ground truth illumination is readily available, we use complementary…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Yannick Hold-Geoffroy , Akshaya Athawale , Jean-François Lalonde

In this work, we propose a step towards a more accurate prediction of the environment light given a single picture of a known object. To achieve this, we developed a deep learning method that is able to encode the latent space of indoor…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Henrique Weber , Donald Prévost , Jean-François Lalonde

We present a CNN-based technique to estimate high-dynamic range outdoor illumination from a single low dynamic range image. To train the CNN, we leverage a large dataset of outdoor panoramas. We fit a low-dimensional physically-based…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Yannick Hold-Geoffroy , Kalyan Sunkavalli , Sunil Hadap , Emiliano Gambaretto , Jean-François Lalonde

Achieving photorealistic 3D view synthesis and relighting of human portraits is pivotal for advancing AR/VR applications. Existing methodologies in portrait relighting demonstrate substantial limitations in terms of generalization and 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Pramod Rao , Gereon Fox , Abhimitra Meka , Mallikarjun B R , Fangneng Zhan , Tim Weyrich , Bernd Bickel , Hanspeter Pfister , Wojciech Matusik , Mohamed Elgharib , Christian Theobalt

Due to limited camera capacities, digital images usually have a narrower dynamic illumination range than real-world scene radiance. To resolve this problem, High Dynamic Range (HDR) reconstruction is proposed to recover the dynamic range to…

Image and Video Processing · Electrical Eng. & Systems 2023-12-14 Jiaqi Tang , Xiaogang Xu , Sixing Hu , Ying-Cong Chen

In this paper, we propose a novel deep neural network model that reconstructs a high dynamic range (HDR) image from a single low dynamic range (LDR) image. The proposed model is based on a convolutional neural network composed of dilated…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Siyeong Lee , Gwon Hwan An , Suk-Ju Kang