English
Related papers

Related papers: Relighting from a Single Image: Datasets and Deep …

200 papers

We show how to relight a scene, depicted in a single image, such that (a) the overall shading has changed and (b) the resulting image looks like a natural image of that scene. Applications for such a procedure include generating training…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 D. A. Forsyth , Anand Bhattad , Pranav Asthana , Yuanyi Zhong , Yuxiong Wang

At the heart of the success of deep learning is the quality of the data. Through data augmentation, one can train models with better generalization capabilities and thus achieve greater results in their field of interest. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 George Chogovadze , Rémi Pautrat , Marc Pollefeys

Volumetric video relighting is essential for bringing captured performances into virtual worlds, but current approaches struggle to deliver temporally stable, production-ready results. Diffusion-based intrinsic decomposition methods show…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Elisabeth Jüttner , Janelle Pfeifer , Leona Krath , Stefan Korfhage , Hannah Dröge , Matthias B. Hullin , Markus Plack

Image-based relighting of indoor rooms creates an immersive virtual understanding of the space, which is useful for interior design, virtual staging, and real estate. Relighting indoor rooms from a single image is especially challenging due…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jun Myeong Choi , Annie Wang , Pieter Peers , Anand Bhattad , Roni Sengupta

Intrinsic image decomposition, which is an essential task in computer vision, aims to infer the reflectance and shading of the scene. It is challenging since it needs to separate one image into two components. To tackle this, conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

We present SyncLight, a method to enable consistent, parametric control over light sources across multiple uncalibrated views of a static scene conditioned on a single view. While single-view relighting has advanced significantly, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 David Serrano-Lozano , Anand Bhattad , Luis Herranz , Jean-François Lalonde , Javier Vazquez-Corral

Synthesizing a densely sampled light field from a single image is highly beneficial for many applications. Moreover, jointly solving both angular and spatial super-resolution problem also introduces new possibilities in light field imaging.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-30 Andre Ivan , Williem , In Kyu Park

Estimation of intrinsic images still remains a challenging task due to weaknesses of ground-truth datasets, which either are too small or present non-realistic issues. On the other hand, end-to-end deep learning architectures start to…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Hassan Sial , Ramon Baldrich , Maria Vanrell

The modern supervised approaches for human image relighting rely on training data generated from 3D human models. However, such datasets are often small (e.g., Light Stage data with a small number of individuals) or limited to diffuse…

Graphics · Computer Science 2021-10-18 Daichi Tajima , Yoshihiro Kanamori , Yuki Endo

This paper presents a method for image relighting that enables precise and continuous control over multiple illumination attributes in a photograph. We formulate relighting as a conditional image generation task and introduce attribute…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sumit Chaturvedi , Yannick Hold-Geoffroy , Mengwei Ren , Jingyuan Liu , He Zhang , Yiqun Mei , Julie Dorsey , Zhixin Shu

A concept of light-fields computed from multiple view images on regular grids has proven its benefit for scene representations, and supported realistic renderings of novel views and photographic effects such as refocusing and shallow depth…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Hyunjun Jung , Hae-Gon Jeon

The task of recalibrating the illumination settings in an image to a target configuration is known as relighting. Relighting techniques have potential applications in digital photography, gaming industry and in augmented reality. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Densen Puthussery , Hrishikesh P. S. , Melvin Kuriakose , Jiji C.

Recent advances have shown that large-scale video diffusion models can be repurposed as neural renderers by first decomposing videos into intrinsic scene representations and then performing forward rendering under novel illumination. While…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Weiqing Xiao , Hong Li , Xiuyu Yang , Houyuan Chen , Wenyi Li , Tianqi Liu , Shaocong Xu , Chongjie Ye , Hao Zhao , Beibei Wang

We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Zhang Chen , Anpei Chen , Guli Zhang , Chengyuan Wang , Yu Ji , Kiriakos N. Kutulakos , Jingyi Yu

Neural rendering techniques promise efficient photo-realistic image synthesis while at the same time providing rich control over scene parameters by learning the physical image formation process. While several supervised methods have been…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hassan Abu Alhaija , Siva Karthik Mustikovela , Justus Thies , Varun Jampani , Matthias Nießner , Andreas Geiger , Carsten Rother

Automatic document content processing is affected by artifacts caused by the shape of the paper, non-uniform and diverse color of lighting conditions. Fully-supervised methods on real data are impossible due to the large amount of data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Sagnik Das , Hassan Ahmed Sial , Ke Ma , Ramon Baldrich , Maria Vanrell , Dimitris Samaras

We present a learning-based approach to relight a single image of Lambertian and low-frequency specular objects. Our method enables inserting objects from photographs into new scenes and relighting them under the new environment lighting,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Renjiao Yi , Chenyang Zhu , Kai Xu

Custom and natural lighting conditions can be emulated in images of the scene during post-editing. Extraordinary capabilities of the deep learning framework can be utilized for such purpose. Deep image relighting allows automatic photo…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Sourya Dipta Das , Nisarg A. Shah , Saikat Dutta , Himanshu Kumar

This paper aims to recover the intrinsic reflectance layer and shading layer given a single image. Though this intrinsic image decomposition problem has been studied for decades, it remains a significant challenge in cases of complex…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Xiaodong Wang , Zijun He , Xin Yuan

The extremes of lighting (e.g. too much or too little light) usually cause many troubles for machine and human vision. Many recent works have mainly focused on under-exposure cases where images are often captured in low-light conditions…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Hue Nguyen , Diep Tran , Khoi Nguyen , Rang Nguyen