English
Related papers

Related papers: Weakly-supervised Single-view Image Relighting

200 papers

Single-image relighting is a challenging task that involves reasoning about the complex interplay between geometry, materials, and lighting. Many prior methods either support only specific categories of images, such as portraits, or require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Haian Jin , Yuan Li , Fujun Luan , Yuanbo Xiangli , Sai Bi , Kai Zhang , Zexiang Xu , Jin Sun , Noah Snavely

Images taken under low-light conditions tend to suffer from poor visibility, which can decrease image quality and even reduce the performance of the downstream tasks. It is hard for a CNN-based method to learn generalized features that can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yi Huang , Xiaoguang Tu , Gui Fu , Tingting Liu , Bokai Liu , Ming Yang , Ziliang Feng

We propose a learning-based method to recover normals, specularity, and roughness from a single diffuse image of a material, using microgeometry appearance as our primary cue. Previous methods that work on single images tend to produce…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Carlos Rodriguez-Pardo , Henar Dominguez-Elvira , David Pascual-Hernandez , Elena Garces

Image relighting has emerged as a problem of significant research interest inspired by augmented reality applications. Physics-based traditional methods, as well as black box deep learning models, have been developed. The existing deep…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Amirsaeed Yazdani , Tiantong Guo , Vishal Monga

We present a simple, yet effective diffusion-based method for fine-grained, parametric control over light sources in an image. Existing relighting methods either rely on multiple input views to perform inverse rendering at inference time,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Nadav Magar , Amir Hertz , Eric Tabellion , Yael Pritch , Alex Rav-Acha , Ariel Shamir , Yedid Hoshen

In this paper we show how to perform scene-level inverse rendering to recover shape, reflectance and lighting from a single, uncontrolled image using a fully convolutional neural network. The network takes an RGB image as input, regresses…

Computer Vision and Pattern Recognition · Computer Science 2021-02-15 Ye Yu , William A. P. Smith

At the heart of the success of deep learning is the quality of the data. Through data augmentation, one can train models with better generalization capabilities and thus achieve greater results in their field of interest. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 George Chogovadze , Rémi Pautrat , Marc Pollefeys

Imaging in low light is challenging due to low photon count and low SNR. Short-exposure images suffer from noise, while long exposure can induce blur and is often impractical. A variety of denoising, deblurring, and enhancement techniques…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Chen Chen , Qifeng Chen , Jia Xu , Vladlen Koltun

Enhancing low-light images while maintaining natural colors is a challenging problem due to camera processing variations and limited access to photos with ground-truth lighting conditions. The latter is a crucial factor for supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Wojciech Kozłowski , Michał Szachniewicz , Michał Stypułkowski , Maciej Zięba

Low-light images, i.e. the images captured in low-light conditions, suffer from very poor visibility caused by low contrast, color distortion and significant measurement noise. Low-light image enhancement is about improving the visibility…

Image and Video Processing · Electrical Eng. & Systems 2020-07-08 Jinxiu Liang , Yong Xu , Yuhui Quan , Jingwen Wang , Haibin Ling , Hui Ji

We propose RelitLRM, a Large Reconstruction Model (LRM) for generating high-quality Gaussian splatting representations of 3D objects under novel illuminations from sparse (4-8) posed images captured under unknown static lighting. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Tianyuan Zhang , Zhengfei Kuang , Haian Jin , Zexiang Xu , Sai Bi , Hao Tan , He Zhang , Yiwei Hu , Milos Hasan , William T. Freeman , Kai Zhang , Fujun Luan

Given a portrait image of a person and an environment map of the target lighting, portrait relighting aims to re-illuminate the person in the image as if the person appeared in an environment with the target lighting. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yu-Ying Yeh , Koki Nagano , Sameh Khamis , Jan Kautz , Ming-Yu Liu , Ting-Chun Wang

Inverse rendering aims to decompose a scene into its geometry, material properties and light conditions under a certain rendering model. It has wide applications like view synthesis, relighting, and scene editing. In recent years, inverse…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Geng Lin , Matthias Zwicker

We introduce a model named DreamLight for universal image relighting in this work, which can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone. The background can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yong Liu , Wenpeng Xiao , Qianqian Wang , Junlin Chen , Shiyin Wang , Yitong Wang , Xinglong Wu , Yansong Tang

Relighting is an essential step in realistically transferring objects from a captured image into another environment. For example, authentic telepresence in Augmented Reality requires faces to be displayed and relit consistent with the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Thomas Nestmeyer , Jean-François Lalonde , Iain Matthews , Andreas M. Lehrmann

Weakly-supervised object detection attempts to limit the amount of supervision by dispensing the need for bounding boxes, but still assumes image-level labels on the entire training set. In this work, we study the problem of training an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Zhaohui Yang , Miaojing Shi , Chao Xu , Vittorio Ferrari , Yannis Avrithis

Relighting of human images has various applications in image synthesis. For relighting, we must infer albedo, shape, and illumination from a human portrait. Previous techniques rely on human faces for this inference, based on spherical…

Graphics · Computer Science 2019-08-12 Yoshihiro Kanamori , Yuki Endo

Recent advances in neural rendering have shown great potential for reconstructing scenes from multiview images. However, accurately representing objects with glossy surfaces remains a challenge for existing methods. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ruofan Liang , Huiting Chen , Chunlin Li , Fan Chen , Selvakumar Panneer , Nandita Vijaykumar

Motion blurry images challenge many computer vision algorithms, e.g, feature detection, motion estimation, or object recognition. Deep convolutional neural networks are state-of-the-art for image deblurring. However, obtaining training data…

Computer Vision and Pattern Recognition · Computer Science 2020-02-13 Peidong Liu , Joel Janai , Marc Pollefeys , Torsten Sattler , Andreas Geiger

The image relighting task of transferring illumination conditions between two images offers an interesting and difficult challenge with potential applications in photography, cinematography and computer graphics. In this report we present…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Alexandre Pierre Dherse , Martin Nicolas Everaert , Jakub Jan Gwizdała