English
Related papers

Related papers: Self-supervised Outdoor Scene Relighting

200 papers

Most face relighting methods are able to handle diffuse shadows, but struggle to handle hard shadows, such as those cast by the nose. Methods that propose techniques for handling hard shadows often do not produce geometrically consistent…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Andrew Hou , Michel Sarkis , Ning Bi , Yiying Tong , Xiaoming Liu

We present a learning-based approach to relight a single image of Lambertian and low-frequency specular objects. Our method enables inserting objects from photographs into new scenes and relighting them under the new environment lighting,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Renjiao Yi , Chenyang Zhu , Kai Xu

Real-world low-light images captured by imaging devices suffer from poor visibility and require a domain-specific enhancement to produce artifact-free outputs that reveal details. In this paper, we propose an unpaired low-light image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Aupendu Kar , Sobhan K. Dhara , Debashis Sen , Prabir K. Biswas

We introduce a novel approach to single-view face relighting in the wild, addressing challenges such as global illumination and cast shadows. A common scheme in recent methods involves intrinsically decomposing an input image into 3D shape,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Puntawat Ponglertnapakorn , Nontawat Tritrong , Supasorn Suwajanakorn

Understanding the 3D world without supervision is currently a major challenge in computer vision as the annotations required to supervise deep networks for tasks in this domain are expensive to obtain on a large scale. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Octave Mariotti , Oisin Mac Aodha , Hakan Bilen

We present a framework for automatically reconfiguring images of street scenes by populating, depopulating, or repopulating them with objects such as pedestrians or vehicles. Applications of this method include anonymizing images to enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Yifan Wang , Andrew Liu , Richard Tucker , Jiajun Wu , Brian L. Curless , Steven M. Seitz , Noah Snavely

Photographers routinely compose multiple manipulated photos of the same scene (layers) into a single image, which is better than any individual photo could be alone. Similarly, 3D artists set up rendering systems to produce layered images…

Graphics · Computer Science 2017-02-03 Carlo Innamorati , Tobias Ritschel , Tim Weyrich , Niloy J. Mitra

We present a method for estimating detailed scene illumination using human faces in a single image. In contrast to previous works that estimate lighting in terms of low-order basis functions or distant point lights, our technique estimates…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Renjiao Yi , Chenyang Zhu , Ping Tan , Stephen Lin

We present a single-image data-driven method to automatically relight images with full-body humans in them. Our framework is based on a realistic scene decomposition leveraging precomputed radiance transfer (PRT) and spherical harmonics…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Manuel Lagunas , Xin Sun , Jimei Yang , Ruben Villegas , Jianming Zhang , Zhixin Shu , Belen Masia , Diego Gutierrez

We present an object relighting system that allows an artist to select an object from an image and insert it into a target scene. Through simple interactions, the system can adjust illumination on the inserted object so that it appears…

Computer Vision and Pattern Recognition · Computer Science 2018-04-23 Zicheng Liao , Kevin Karsch , Hongyi Zhang , David Forsyth

We present a neural-based model for relighting a half-body portrait image by simply referring to another portrait image with the desired lighting condition. Rather than following classical inverse rendering methodology that involves…

Graphics · Computer Science 2021-06-28 Guoxian Song , Tat-Jen Cham , Jianfei Cai , Jianmin Zheng

This paper presents a method for image relighting that enables precise and continuous control over multiple illumination attributes in a photograph. We formulate relighting as a conditional image generation task and introduce attribute…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Sumit Chaturvedi , Yannick Hold-Geoffroy , Mengwei Ren , Jingyuan Liu , He Zhang , Yiqun Mei , Julie Dorsey , Zhixin Shu

Self-supervised learning is crucial for super-resolution because ground-truth images are usually unavailable for real-world settings. Existing methods derive self-supervision from low-resolution images by creating pseudo-pairs or by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Yuehan Zhang , Angela Yao

Night images suffer not only from low light, but also from uneven distributions of light. Most existing night visibility enhancement methods focus mainly on enhancing low-light regions. This inevitably leads to over enhancement and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Yeying Jin , Wenhan Yang , Robby T. Tan

Inverse rendering aims to estimate physical attributes of a scene, e.g., reflectance, geometry, and lighting, from image(s). Inverse rendering has been studied primarily for single objects or with methods that solve for only one of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Soumyadip Sengupta , Jinwei Gu , Kihwan Kim , Guilin Liu , David W. Jacobs , Jan Kautz

Shadows can originate from occlusions in both direct and indirect illumination. Although most current shadow removal research focuses on shadows caused by direct illumination, shadows from indirect illumination are often just as pervasive,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Jiamin Xu , Zelong Li , Yuxin Zheng , Chenyu Huang , Renshu Gu , Weiwei Xu , Gang Xu

This paper introduces Comprehensive Relighting, the first all-in-one approach that can both control and harmonize the lighting from an image or video of humans with arbitrary body parts from any scene. Building such a generalizable model is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Junying Wang , Jingyuan Liu , Xin Sun , Krishna Kumar Singh , Zhixin Shu , He Zhang , Jimei Yang , Nanxuan Zhao , Tuanfeng Y. Wang , Simon S. Chen , Ulrich Neumann , Jae Shin Yoon

The task of recalibrating the illumination settings in an image to a target configuration is known as relighting. Relighting techniques have potential applications in digital photography, gaming industry and in augmented reality. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Densen Puthussery , Hrishikesh P. S. , Melvin Kuriakose , Jiji C.

Drastic variations in illumination across surveillance cameras make the person re-identification problem extremely challenging. Current large scale re-identification datasets have a significant number of training subjects, but lack…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Slawomir Bak , Peter Carr , Jean-Francois Lalonde

Shadow removal aims at restoring the image content within shadow regions, pursuing a uniform distribution of illumination that is consistent between shadow and non-shadow regions. {Comparing to other image restoration tasks, there are two…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Laniqng Guo , Chong Wang , Yufei Wang , Yi Yu , Siyu Huang , Wenhan Yang , Alex C. Kot , Bihan Wen