English
Related papers

Related papers: Relighting Images in the Wild with a Self-Supervis…

200 papers

Automatic Perceptual Image Quality Assessment is a challenging problem that impacts billions of internet, and social media users daily. To advance research in this field, we propose a Mixture of Experts approach to train two separate…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Avinab Saha , Sandeep Mishra , Alan C. Bovik

We show how to relight a scene, depicted in a single image, such that (a) the overall shading has changed and (b) the resulting image looks like a natural image of that scene. Applications for such a procedure include generating training…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 D. A. Forsyth , Anand Bhattad , Pranav Asthana , Yuanyi Zhong , Yuxiong Wang

Image restoration is a low-level visual task, and most CNN methods are designed as black boxes, lacking transparency and intrinsic aesthetics. Many unsupervised approaches ignore the degradation of visible information in low-light scenes,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Qihan Zhao , Xiaofeng Zhang , Hao Tang , Chaochen Gu , Shanying Zhu

Single image scene relighting aims to generate a realistic new version of an input image so that it appears to be illuminated by a new target light condition. Although existing works have explored this problem from various perspectives,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Yixiong Yang , Hassan Ahmed Sial , Ramon Baldrich , Maria Vanrell

Inverse problems in image reconstruction are fundamentally complicated by unknown noise properties. Classical iterative deconvolution approaches amplify noise and require careful parameter selection for an optimal trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Mikhail Papkov , Kaupo Palo , Leopold Parts

As vision based perception methods are usually built on the normal light assumption, there will be a serious safety issue when deploying them into low light environments. Recently, deep learning based methods have been proposed to enhance…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Junjie Hu , Xiyue Guo , Junfeng Chen , Guanqi Liang , Fuqin Deng , Tin lun Lam

Enhancing low-light images while maintaining natural colors is a challenging problem due to camera processing variations and limited access to photos with ground-truth lighting conditions. The latter is a crucial factor for supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Wojciech Kozłowski , Michał Szachniewicz , Michał Stypułkowski , Maciej Zięba

Single-view intrinsic image decomposition is a highly ill-posed problem, and so a promising approach is to learn from large amounts of data. However, it is difficult to collect ground truth training data at scale for intrinsic images. In…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Zhengqi Li , Noah Snavely

Previous image based relighting methods require capturing multiple images to acquire high frequency lighting effect under different lighting conditions, which needs nontrivial effort and may be unrealistic in certain practical use…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Di Qiu , Jin Zeng , Zhanghan Ke , Wenxiu Sun , Chengxi Yang

We present Decomposer, a semi-supervised reconstruction model that decomposes distorted image sequences into their fundamental building blocks - the original image and the applied augmentations, i.e., shadow, light, and occlusions. To solve…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Boris Meinardus , Mariusz Trzeciakiewicz , Tim Herzig , Monika Kwiatkowski , Simon Matern , Olaf Hellwich

Deep learning-based methods have made impressive progress in enhancing extremely low-light images - the image quality of the reconstructed images has generally improved. However, we found out that most of these methods could not…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Pohao Hsu , Che-Tsung Lin , Chun Chet Ng , Jie-Long Kew , Mei Yih Tan , Shang-Hong Lai , Chee Seng Chan , Christopher Zach

We show how to train a fully convolutional neural network to perform inverse rendering from a single, uncontrolled image. The network takes an RGB image as input, regresses albedo and normal maps from which we compute lighting coefficients.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Ye Yu , William A. P. Smith

Automatic document content processing is affected by artifacts caused by the shape of the paper, non-uniform and diverse color of lighting conditions. Fully-supervised methods on real data are impossible due to the large amount of data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Sagnik Das , Hassan Ahmed Sial , Ke Ma , Ramon Baldrich , Maria Vanrell , Dimitris Samaras

Many microscopy applications are limited by the total amount of usable light and are consequently challenged by the resulting levels of noise in the acquired images. This problem is often addressed via (supervised) deep learning based…

Image and Video Processing · Electrical Eng. & Systems 2020-08-20 Anna S. Goncharova , Alf Honigmann , Florian Jug , Alexander Krull

We introduce a model named DreamLight for universal image relighting in this work, which can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone. The background can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yong Liu , Wenpeng Xiao , Qianqian Wang , Junlin Chen , Shiyin Wang , Yitong Wang , Xinglong Wu , Yansong Tang

At the heart of the success of deep learning is the quality of the data. Through data augmentation, one can train models with better generalization capabilities and thus achieve greater results in their field of interest. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 George Chogovadze , Rémi Pautrat , Marc Pollefeys

Self-supervised monocular depth estimation serves as a key task in the development of endoscopic navigation systems. However, performance degradation persists due to uneven illumination inherent in endoscopic images, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Mingyang Ou , Haojin Li , Yifeng Zhang , Ke Niu , Zhongxi Qiu , Heng Li , Jiang Liu

We introduce a neural relighting algorithm for captured indoors scenes, that allows interactive free-viewpoint navigation. Our method allows illumination to be changed synthetically, while coherently rendering cast shadows and complex…

Graphics · Computer Science 2021-06-28 Julien Philip , Sébastien Morgenthaler , Michaël Gharbi , George Drettakis

When capturing images in low-light conditions, the images often suffer from low visibility, which not only degrades the visual aesthetics of images, but also significantly degenerates the performance of many computer vision algorithms. In…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Lijun Zhang , Xiao Liu , Erik Learned-Miller , Hui Guan

Relighting of human images enables post-photography editing of lighting effects in portraits. The current mainstream approach uses neural networks to approximate lighting effects without explicitly accounting for the principle of physical…

Graphics · Computer Science 2024-11-04 Daichi Tajima , Yoshihiro Kanamori , Yuki Endo