English
Related papers

Related papers: IllumiNet: Transferring Illumination from Planar S…

200 papers

We present a efficient multi-view inverse rendering method for large-scale real-world indoor scenes that reconstructs global illumination and physically-reasonable SVBRDFs. Unlike previous representations, where the global illumination of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Zhen Li , Lingli Wang , Mofang Cheng , Cihui Pan , Jiaqi Yang

We introduce a neural relighting algorithm for captured indoors scenes, that allows interactive free-viewpoint navigation. Our method allows illumination to be changed synthetically, while coherently rendering cast shadows and complex…

Graphics · Computer Science 2021-06-28 Julien Philip , Sébastien Morgenthaler , Michaël Gharbi , George Drettakis

Neural rendering provides a fundamentally new way to render photorealistic images. Similar to traditional light-baking methods, neural rendering utilizes neural networks to bake representations of scenes, materials, and lights into latent…

Graphics · Computer Science 2024-05-30 Ziyang Zhang , Edgar Simo-Serra

Global illumination (GI) is essential for realistic rendering but remains computationally expensive due to the complexity of simulating indirect light transport. Recent neural methods have mainly relied on per-scene optimization, sometimes…

Graphics · Computer Science 2025-10-22 Bing Xu , Mukund Varma T , Cheng Wang , Tzumao Li , Lifan Wu , Bartlomiej Wronski , Ravi Ramamoorthi , Marco Salvi

We propose a new technique for estimating spatially varying parametric materials from a single image of an object with unknown shape in unknown illumination. Our method uses a low-order parametric reflectance model, and incorporates strong…

Graphics · Computer Science 2019-12-30 Kevin Karsch , David Forsyth

When one captures images in low-light conditions, the images often suffer from low visibility. This poor quality may significantly degrade the performance of many computer vision and multimedia algorithms that are primarily designed for…

Computer Vision and Pattern Recognition · Computer Science 2016-07-26 Xiaojie Guo

Illumination estimation from a single image is critical in 3D rendering and it has been investigated extensively in the computer vision and computer graphic research community. On the other hand, existing works estimate illumination by…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Fangneng Zhan , Changgong Zhang , Yingchen Yu , Yuan Chang , Shijian Lu , Feiying Ma , Xuansong Xie

A fundamental problem in computer vision is that of inferring the intrinsic, 3D structure of the world from flat, 2D images of that world. Traditional methods for recovering scene properties such as shape, reflectance, or illumination rely…

Computer Vision and Pattern Recognition · Computer Science 2020-10-09 Jonathan T. Barron , Jitendra Malik

We present a deep learning-based method for propagating spatially-varying visual material attributes (e.g. texture maps or image stylizations) to larger samples of the same or similar materials. For training, we leverage images of the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Carlos Rodriguez-Pardo , Elena Garces

Creating realistic virtual assets is a time-consuming process: it usually involves an artist designing the object, then spending a lot of effort on tweaking its appearance. Intricate details and certain effects, such as subsurface…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Aljaž Božič , Denis Gladkov , Luke Doukakis , Christoph Lassner

Illumination of scenes is usually generated in computer graphics using polygonal meshes. In this paper, we present a geometric method using projections. Starting from an implicit polynomial equation of a surface in 3-D or a curve in 2-D, we…

Computational Geometry · Computer Science 2026-04-03 Michal Zamboj , Jakub Řada

The 3D localisation of an object and the estimation of its properties, such as shape and dimensions, are challenging under varying degrees of transparency and lighting conditions. In this paper, we propose a method for jointly localising…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Alessio Xompero , Ricardo Sanchez-Matilla , Apostolos Modas , Pascal Frossard , Andrea Cavallaro

All existing image enhancement methods, such as HDR tone mapping, cannot recover A/D quantization losses due to insufficient or excessive lighting, (underflow and overflow problems). The loss of image details due to A/D quantization is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-22 Chang Liu , Xiaolin Wu , Xiao Shu

We present a simple yet effective technique to estimate lighting in a single input image. Current techniques rely heavily on HDR panorama datasets to train neural networks to regress an input with limited field-of-view to a full environment…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Pakkapon Phongthawee , Worameth Chinchuthakun , Nontaphat Sinsunthithet , Amit Raj , Varun Jampani , Pramook Khungurn , Supasorn Suwajanakorn

We previously investigated color constancy in photorealistic virtual reality (VR) and developed a Deep Neural Network (DNN) that predicts reflectance from rendered images. Here, we combine both approaches to compare and study a model and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hamed Heidari-Gorji , Raquel Gil Rodriguez , Karl R. Gegenfurtner

We propose a data-driven learned sky model, which we use for outdoor lighting estimation from a single image. As no large-scale dataset of images and their corresponding ground truth illumination is readily available, we use complementary…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Yannick Hold-Geoffroy , Akshaya Athawale , Jean-François Lalonde

We propose a physically-motivated deep learning framework to solve a general version of the challenging indoor lighting estimation problem. Given a single LDR image with a depth map, our method predicts spatially consistent lighting at any…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zhengqin Li , Li Yu , Mikhail Okunev , Manmohan Chandraker , Zhao Dong

Illuminating a scene with artificial light is a prerequisite for seeing in dark environments. However, nonuniform and dynamic illumination can deteriorate or even break computer vision approaches, for instance when operating a robot with…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Yifan Song , Furkan Elibol , Mengkun She , David Nakath , Kevin Köser

We present a self-supervised approach to in-the-wild image relighting that enables fully controllable, physically based illumination editing. We achieve this by combining the physical accuracy of traditional rendering with the…

Graphics · Computer Science 2025-08-08 Chris Careaga , Yağız Aksoy

Inferring the scene illumination from a single image is an essential yet challenging task in computer vision and computer graphics. Existing works estimate lighting by regressing representative illumination parameters or generating…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Fangneng Zhan , Yingchen Yu , Changgong Zhang , Rongliang Wu , Wenbo Hu , Shijian Lu , Feiying Ma , Xuansong Xie , Ling Shao