English
Related papers

Related papers: Scene relighting with illumination estimation in t…

200 papers

We present a learning-based method for estimating 4D reflectance field of a person given video footage illuminated under a flat-lit environment of the same subject. For training data, we use one light at a time to illuminate the subject and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Loc Huynh , Bipin Kishore , Paul Debevec

In this paper we present a deep learning method to estimate the illuminant of an image. Our model is not trained with illuminant annotations, but with the objective of improving performance on an auxiliary task such as object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Marco Buzzelli , Joost van de Weijer , Raimondo Schettini

We present a method for relighting 3D reconstructions of large room-scale environments. Existing solutions for 3D scene relighting often require solving under-determined or ill-conditioned inverse rendering problems, and are as such unable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Xiaoyan Xing , Philipp Henzler , Junhwa Hur , Runze Li , Jonathan T. Barron , Pratul P. Srinivasan , Dor Verbin

Recent neural rendering methods have demonstrated accurate view interpolation by predicting volumetric density and color with a neural network. Although such volumetric representations can be supervised on static and dynamic scenes,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Julian Knodt , Joe Bartusek , Seung-Hwan Baek , Felix Heide

Illuminant estimation aims to infer scene illumination from image measurements despite intrinsic ambiguities between surface reflectance and lighting. Most existing methods operate on trichromatic RGB images and are therefore fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 G. Dofri Vidarsson , Liying Lu , Sabine Süsstrunk

We present a method to separate a single image captured under two illuminants, with different spectra, into the two images corresponding to the appearance of the scene under each individual illuminant. We do this by training a deep neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Zhuo Hui , Ayan Chakrabarti , Kalyan Sunkavalli , Aswin C. Sankaranarayanan

Inverse rendering, the process of inferring scene properties from images, is a challenging inverse problem. The task is ill-posed, as many different scene configurations can give rise to the same image. Most existing solutions incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Linjie Lyu , Ayush Tewari , Marc Habermann , Shunsuke Saito , Michael Zollhöfer , Thomas Leimkühler , Christian Theobalt

We propose an automatic method to infer high dynamic range illumination from a single, limited field-of-view, low dynamic range photograph of an indoor scene. In contrast to previous work that relies on specialized image capture, user…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Marc-André Gardner , Kalyan Sunkavalli , Ersin Yumer , Xiaohui Shen , Emiliano Gambaretto , Christian Gagné , Jean-François Lalonde

Deep learning-based methods have made impressive progress in enhancing extremely low-light images - the image quality of the reconstructed images has generally improved. However, we found out that most of these methods could not…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Pohao Hsu , Che-Tsung Lin , Chun Chet Ng , Jie-Long Kew , Mei Yih Tan , Shang-Hong Lai , Chee Seng Chan , Christopher Zach

We review the AIM 2020 challenge on virtual image relighting and illumination estimation. This paper presents the novel VIDIT dataset used in the challenge and the different proposed solutions and final evaluation results over the 3…

Despite significant advances in algorithms and hardware, global illumination continues to be a challenge in the real-time domain. Time constraints often force developers to either compromise on the quality of global illumination or…

Graphics · Computer Science 2024-06-13 Alexandr Kuznetsov , Stavros Diolatzis , Anton Sochenov , Anton Kaplanyan

We show how to relight a scene, depicted in a single image, such that (a) the overall shading has changed and (b) the resulting image looks like a natural image of that scene. Applications for such a procedure include generating training…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 D. A. Forsyth , Anand Bhattad , Pranav Asthana , Yuanyi Zhong , Yuxiong Wang

We study human pose estimation in extremely low-light images. This task is challenging due to the difficulty of collecting real low-light images with accurate labels, and severely corrupted inputs that degrade prediction quality…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sohyun Lee , Jaesung Rim , Boseung Jeong , Geonu Kim , Byungju Woo , Haechan Lee , Sunghyun Cho , Suha Kwak

Images taken under low-light conditions tend to suffer from poor visibility, which can decrease image quality and even reduce the performance of the downstream tasks. It is hard for a CNN-based method to learn generalized features that can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yi Huang , Xiaoguang Tu , Gui Fu , Tingting Liu , Bokai Liu , Ming Yang , Ziliang Feng

The aim of colour constancy is to discount the effect of the scene illumination from the image colours and restore the colours of the objects as captured under a 'white' illuminant. For the majority of colour constancy methods, the first…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Ghalia Hemrit , Joseph Meehan

This work addresses on the following problem: given a set of unsynchronized history observations of two scenes that are correlative on their dynamic changes, the purpose is to learn a cross-scene predictor, so that with the observation of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Shaochi Hu , Donghao Xu , Huijing Zhao

Computational color constancy refers to the problem of computing the illuminant color so that the images of a scene under varying illumination can be normalized to an image under the canonical illumination. In this paper, we adopt a deep…

Computer Vision and Pattern Recognition · Computer Science 2016-08-30 Seoung Wug Oh , Seon Joo Kim

We introduce SynthLight, a diffusion model for portrait relighting. Our approach frames image relighting as a re-rendering problem, where pixels are transformed in response to changes in environmental lighting conditions. Using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Sumit Chaturvedi , Mengwei Ren , Yannick Hold-Geoffroy , Jingyuan Liu , Julie Dorsey , Zhixin Shu

We present a self-supervised approach to in-the-wild image relighting that enables fully controllable, physically based illumination editing. We achieve this by combining the physical accuracy of traditional rendering with the…

Graphics · Computer Science 2025-08-08 Chris Careaga , Yağız Aksoy

It is suggested that low-light image enhancement realizes one-to-many mapping since we have different definitions of NORMAL-light given application scenarios or users' aesthetic. However, most existing methods ignore subjectivity of the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Ya'nan Wang , Zhuqing Jiang , Chang Liu , Kai Li , Aidong Men , Haiying Wang