English
Related papers

Related papers: All-frequency Full-body Human Image Relighting

200 papers

The task of extracting intrinsic components, such as reflectance and shading, from neural radiance fields is of growing interest. However, current methods largely focus on synthetic scenes and isolated objects, overlooking the complexities…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yixiong Yang , Shilin Hu , Haoyu Wu , Ramon Baldrich , Dimitris Samaras , Maria Vanrell

Manipulating the light source of given images is an interesting task and useful in various applications, including photography and cinematography. Existing methods usually require additional information like the geometric structure of the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Li-Wen Wang , Wan-Chi Siu , Zhi-Song Liu , Chu-Tak Li , Daniel P. K. Lun

This paper introduces Comprehensive Relighting, the first all-in-one approach that can both control and harmonize the lighting from an image or video of humans with arbitrary body parts from any scene. Building such a generalizable model is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Junying Wang , Jingyuan Liu , Xin Sun , Krishna Kumar Singh , Zhixin Shu , He Zhang , Jimei Yang , Nanxuan Zhao , Tuanfeng Y. Wang , Simon S. Chen , Ulrich Neumann , Jae Shin Yoon

Single-image relighting is a challenging task that involves reasoning about the complex interplay between geometry, materials, and lighting. Many prior methods either support only specific categories of images, such as portraits, or require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Haian Jin , Yuan Li , Fujun Luan , Yuanbo Xiangli , Sai Bi , Kai Zhang , Zexiang Xu , Jin Sun , Noah Snavely

We propose an automatic method to infer high dynamic range illumination from a single, limited field-of-view, low dynamic range photograph of an indoor scene. In contrast to previous work that relies on specialized image capture, user…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Marc-André Gardner , Kalyan Sunkavalli , Ersin Yumer , Xiaohui Shen , Emiliano Gambaretto , Christian Gagné , Jean-François Lalonde

Most face relighting methods are able to handle diffuse shadows, but struggle to handle hard shadows, such as those cast by the nose. Methods that propose techniques for handling hard shadows often do not produce geometrically consistent…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Andrew Hou , Michel Sarkis , Ning Bi , Yiying Tong , Xiaoming Liu

Despite significant advancements in network-based image harmonization techniques, there still exists a domain disparity between typical training pairs and real-world composites encountered during inference. Most existing methods are trained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Chris Careaga , S. Mahdi H. Miangoleh , Yağız Aksoy

Removing shadows requires an understanding of both lighting conditions and object textures in a scene. Existing methods typically learn pixel-level color mappings between shadow and non-shadow images, in which the joint modeling of lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yuhao Liu , Zhanghan Ke , Ke Xu , Fang Liu , Zhenwei Wang , Rynson W. H. Lau

As critical visual details become obscured, the low visibility and high ISO noise in extremely low-light images pose a significant challenge to human pose estimation. Current methods fail to provide high-quality representations due to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Feng Zhang , Ze Li , Xiatian Zhu , Lei Chen

Image-based lighting is a widely used technique to reproduce shading under real-world lighting conditions, especially in real-time rendering applications. A particularly challenging scenario involves materials exhibiting a sparkling or…

Graphics · Computer Science 2025-07-04 Tom Kneiphof , Reinhard Klein

We introduce SynthLight, a diffusion model for portrait relighting. Our approach frames image relighting as a re-rendering problem, where pixels are transformed in response to changes in environmental lighting conditions. Using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Sumit Chaturvedi , Mengwei Ren , Yannick Hold-Geoffroy , Jingyuan Liu , Julie Dorsey , Zhixin Shu

We introduce light diffusion, a novel method to improve lighting in portraits, softening harsh shadows and specular highlights while preserving overall scene illumination. Inspired by professional photographers' diffusers and scrims, our…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 David Futschik , Kelvin Ritland , James Vecore , Sean Fanello , Sergio Orts-Escolano , Brian Curless , Daniel Sýkora , Rohit Pandey

We introduce a model named DreamLight for universal image relighting in this work, which can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone. The background can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yong Liu , Wenpeng Xiao , Qianqian Wang , Junlin Chen , Shiyin Wang , Yitong Wang , Xinglong Wu , Yansong Tang

Image relighting is the task of showing what a scene from a source image would look like if illuminated differently. Inverse graphics schemes recover an explicit representation of geometry and a set of chosen intrinsics, then relight with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xiao Zhang , William Gao , Seemandhar Jain , Michael Maire , David A. Forsyth , Anand Bhattad

Given a set of images of a scene, the re-rendering of this scene from novel views and lighting conditions is an important and challenging problem in Computer Vision and Graphics. On the one hand, most existing works in Computer Vision…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Linjie Lyu , Ayush Tewari , Thomas Leimkuehler , Marc Habermann , Christian Theobalt

Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene. Existing harmonization techniques often only focus on adjusting the global color and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mengwei Ren , Wei Xiong , Jae Shin Yoon , Zhixin Shu , Jianming Zhang , HyunJoon Jung , Guido Gerig , He Zhang

We present a single-image data-driven method to automatically relight images with full-body humans in them. Our framework is based on a realistic scene decomposition leveraging precomputed radiance transfer (PRT) and spherical harmonics…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Manuel Lagunas , Xin Sun , Jimei Yang , Ruben Villegas , Jianming Zhang , Zhixin Shu , Belen Masia , Diego Gutierrez

This paper presents a novel neural implicit radiance representation for free viewpoint relighting from a small set of unstructured photographs of an object lit by a moving point light source different from the view position. We express the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Chong Zeng , Guojun Chen , Yue Dong , Pieter Peers , Hongzhi Wu , Xin Tong

We present a learning-based technique for estimating high dynamic range (HDR), omnidirectional illumination from a single low dynamic range (LDR) portrait image captured under arbitrary indoor or outdoor lighting conditions. We train our…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Chloe LeGendre , Wan-Chun Ma , Rohit Pandey , Sean Fanello , Christoph Rhemann , Jason Dourgarian , Jay Busch , Paul Debevec

Deep image relighting allows photo enhancement by illumination-specific retouching without human effort and so it is getting much interest lately. Most of the existing popular methods available for relighting are run-time intensive and…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Sourya Dipta Das , Nisarg A. Shah , Saikat Dutta