English
Related papers

Related papers: Single Reference Image based Scene Relighting via …

200 papers

Depth guided any-to-any image relighting aims to generate a relit image from the original image and corresponding depth maps to match the illumination setting of the given guided image and its depth map. To the best of our knowledge, this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Hao-Hsiang Yang , Wei-Ting Chen , and Sy-Yen Kuo

We introduce a model named DreamLight for universal image relighting in this work, which can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone. The background can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yong Liu , Wenpeng Xiao , Qianqian Wang , Junlin Chen , Shiyin Wang , Yitong Wang , Xinglong Wu , Yansong Tang

We propose a self-supervised method for image relighting of single view images in the wild. The method is based on an auto-encoder which deconstructs an image into two separate encodings, relating to the scene illumination and content,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Yang Liu , Alexandros Neophytou , Sunando Sengupta , Eric Sommerlade

We introduce a neural relighting algorithm for captured indoors scenes, that allows interactive free-viewpoint navigation. Our method allows illumination to be changed synthetically, while coherently rendering cast shadows and complex…

Graphics · Computer Science 2021-06-28 Julien Philip , Sébastien Morgenthaler , Michaël Gharbi , George Drettakis

Deep image relighting allows photo enhancement by illumination-specific retouching without human effort and so it is getting much interest lately. Most of the existing popular methods available for relighting are run-time intensive and…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Sourya Dipta Das , Nisarg A. Shah , Saikat Dutta

We present PIXLRelight, a feed-forward approach for physically controllable single-image relighting. Existing methods either provide limited lighting control (e.g. through text or environment maps), accumulate errors when chaining inverse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Miguel Farinha , Ronald Clark

We present a self-supervised approach to in-the-wild image relighting that enables fully controllable, physically based illumination editing. We achieve this by combining the physical accuracy of traditional rendering with the…

Graphics · Computer Science 2025-08-08 Chris Careaga , Yağız Aksoy

We propose a novel method, StyLitGAN, for relighting and resurfacing generated images in the absence of labeled data. Our approach generates images with realistic lighting effects, including cast shadows, soft shadows, inter-reflections,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Anand Bhattad , D. A. Forsyth

We present a lighting-aware image editing pipeline that, given a portrait image and a text prompt, performs single image relighting. Our model modifies the lighting and color of both the foreground and background to align with the provided…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Junuk Cha , Mengwei Ren , Krishna Kumar Singh , He Zhang , Yannick Hold-Geoffroy , Seunghyun Yoon , HyunJoon Jung , Jae Shin Yoon , Seungryul Baek

Intrinsic decomposition from a single image is a highly challenging task, due to its inherent ambiguity and the scarcity of training data. In contrast to traditional fully supervised learning approaches, in this paper we propose learning…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Michael Janner , Jiajun Wu , Tejas D. Kulkarni , Ilker Yildirim , Joshua B. Tenenbaum

Reconstructing an object from photos and placing it virtually in a new environment goes beyond the standard novel view synthesis task as the appearance of the object has to not only adapt to the novel viewpoint but also to the new lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Benjamin Ummenhofer , Sanskar Agrawal , Rene Sepulveda , Yixing Lao , Kai Zhang , Tianhang Cheng , Stephan Richter , Shenlong Wang , German Ros

We propose an automatic method to infer high dynamic range illumination from a single, limited field-of-view, low dynamic range photograph of an indoor scene. In contrast to previous work that relies on specialized image capture, user…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Marc-André Gardner , Kalyan Sunkavalli , Ersin Yumer , Xiaohui Shen , Emiliano Gambaretto , Christian Gagné , Jean-François Lalonde

This paper presents a method for image relighting that enables precise and continuous control over multiple illumination attributes in a photograph. We formulate relighting as a conditional image generation task and introduce attribute…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sumit Chaturvedi , Yannick Hold-Geoffroy , Mengwei Ren , Jingyuan Liu , He Zhang , Yiqun Mei , Julie Dorsey , Zhixin Shu

Given a set of images of a scene, the re-rendering of this scene from novel views and lighting conditions is an important and challenging problem in Computer Vision and Graphics. On the one hand, most existing works in Computer Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Linjie Lyu , Ayush Tewari , Thomas Leimkuehler , Marc Habermann , Christian Theobalt

Relighting is an essential step in realistically transferring objects from a captured image into another environment. For example, authentic telepresence in Augmented Reality requires faces to be displayed and relit consistent with the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Thomas Nestmeyer , Jean-François Lalonde , Iain Matthews , Andreas M. Lehrmann

Recent work has shown that diffusion models can serve as powerful neural rendering engines that can be leveraged for inserting virtual objects into images. However, unlike typical physics-based renderers, these neural rendering engines are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Frédéric Fortier-Chouinard , Zitian Zhang , Louis-Etienne Messier , Mathieu Garon , Anand Bhattad , Jean-François Lalonde

We present a method that tackles the challenge of predicting color and depth behind the visible content of an image. Our approach aims at building up a Layered Depth Image (LDI) from a single RGB input, which is an efficient representation…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Helisa Dhamo , Nassir Navab , Federico Tombari

The modern supervised approaches for human image relighting rely on training data generated from 3D human models. However, such datasets are often small (e.g., Light Stage data with a small number of individuals) or limited to diffuse…

Graphics · Computer Science 2021-10-18 Daichi Tajima , Yoshihiro Kanamori , Yuki Endo

Low-light image enhancement (LLIE) aims to improve the illuminance of images due to insufficient light exposure. Recently, various lightweight learning-based LLIE methods have been proposed to handle the challenges of unfavorable prevailing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Yuantong Zhang , Baoxin Teng , Daiqin Yang , Zhenzhong Chen , Haichuan Ma , Gang Li , Wenpeng Ding

Image-based relighting of indoor rooms creates an immersive virtual understanding of the space, which is useful for interior design, virtual staging, and real estate. Relighting indoor rooms from a single image is especially challenging due…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jun Myeong Choi , Annie Wang , Pieter Peers , Anand Bhattad , Roni Sengupta