English
Related papers

Related papers: Light Stage Super-Resolution: Continuous High-Freq…

200 papers

Many lighting methods used in computer graphics such as indirect illumination can have very high computational costs and need to be approximated for real-time applications. These costs can be reduced by means of upsampling techniques which…

Graphics · Computer Science 2019-06-12 Simon Besenthal , Sebastian Maisch , Timo Ropinski

We introduce SynthLight, a diffusion model for portrait relighting. Our approach frames image relighting as a re-rendering problem, where pixels are transformed in response to changes in environmental lighting conditions. Using a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Sumit Chaturvedi , Mengwei Ren , Yannick Hold-Geoffroy , Jingyuan Liu , Julie Dorsey , Zhixin Shu

Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene. Existing harmonization techniques often only focus on adjusting the global color and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mengwei Ren , Wei Xiong , Jae Shin Yoon , Zhixin Shu , Jianming Zhang , HyunJoon Jung , Guido Gerig , He Zhang

This paper introduces Comprehensive Relighting, the first all-in-one approach that can both control and harmonize the lighting from an image or video of humans with arbitrary body parts from any scene. Building such a generalizable model is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Junying Wang , Jingyuan Liu , Xin Sun , Krishna Kumar Singh , Zhixin Shu , He Zhang , Jimei Yang , Nanxuan Zhao , Tuanfeng Y. Wang , Simon S. Chen , Ulrich Neumann , Jae Shin Yoon

Synthesizing a densely sampled light field from a single image is highly beneficial for many applications. Moreover, jointly solving both angular and spatial super-resolution problem also introduces new possibilities in light field imaging.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-30 Andre Ivan , Williem , In Kyu Park

Single-image human relighting aims to relight a target human under new lighting conditions by decomposing the input image into albedo, shape and lighting. Although plausible relighting results can be achieved, previous methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Chaonan Ji , Tao Yu , Kaiwen Guo , Jingxin Liu , Yebin Liu

We present a learning-based technique for estimating high dynamic range (HDR), omnidirectional illumination from a single low dynamic range (LDR) portrait image captured under arbitrary indoor or outdoor lighting conditions. We train our…

Computer Vision and Pattern Recognition · Computer Science 2020-08-07 Chloe LeGendre , Wan-Chun Ma , Rohit Pandey , Sean Fanello , Christoph Rhemann , Jason Dourgarian , Jay Busch , Paul Debevec

We introduce a model named DreamLight for universal image relighting in this work, which can seamlessly composite subjects into a new background while maintaining aesthetic uniformity in terms of lighting and color tone. The background can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Yong Liu , Wenpeng Xiao , Qianqian Wang , Junlin Chen , Shiyin Wang , Yitong Wang , Xinglong Wu , Yansong Tang

Mixed Reality scene relighting, where virtual changes to lighting conditions realistically interact with physical objects, producing authentic illumination and shadows, can be used in a variety of applications. One such application in real…

Graphics · Computer Science 2025-08-22 Hanwen Zhao , John Akers , Baback Elmieh , Ira Kemelmacher-Shlizerman

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

Lighting plays a central role in conveying the essence and depth of the subject in a portrait photograph. Professional photographers will carefully control the lighting in their studio to manipulate the appearance of their subject, while…

Recent work has shown that diffusion models can serve as powerful neural rendering engines that can be leveraged for inserting virtual objects into images. However, unlike typical physics-based renderers, these neural rendering engines are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Frédéric Fortier-Chouinard , Zitian Zhang , Louis-Etienne Messier , Mathieu Garon , Anand Bhattad , Jean-François Lalonde

The acquisition of light field images with high angular resolution is costly. Although many methods have been proposed to improve the angular resolution of a sparsely-sampled light field, they always focus on the light field with a small…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Jing Jin , Junhui Hou , Hui Yuan , Sam Kwong

Neural Radiance Fields (NeRF) are able to reconstruct scenes with unprecedented fidelity, and various recent works have extended NeRF to handle dynamic scenes. A common approach to reconstruct such non-rigid scenes is through the use of a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Keunhong Park , Utkarsh Sinha , Peter Hedman , Jonathan T. Barron , Sofien Bouaziz , Dan B Goldman , Ricardo Martin-Brualla , Steven M. Seitz

We present a method for estimating detailed scene illumination using human faces in a single image. In contrast to previous works that estimate lighting in terms of low-order basis functions or distant point lights, our technique estimates…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Renjiao Yi , Chenyang Zhu , Ping Tan , Stephen Lin

Video portraits relighting is critical in user-facing human photography, especially for immersive VR/AR experience. Recent advances still fail to recover consistent relit result under dynamic illuminations from monocular RGB stream,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Longwen Zhang , Qixuan Zhang , Minye Wu , Jingyi Yu , Lan Xu

This paper explores the problem of reconstructing high-resolution light field (LF) images from hybrid lenses, including a high-resolution camera surrounded by multiple low-resolution cameras. To tackle this challenge, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Jing Jin , Junhui Hou , Jie Chen , Sam Kwong , Jingyi Yu

Photo-realistic video portrait reenactment benefits virtual production and numerous VR/AR experiences. The task remains challenging as the reenacted expression should match the source while the lighting should be adjustable to new…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Youjia Wang , Taotao Zhou , Minzhang Li , Teng Xu , Minye Wu , Lan Xu , Jingyi Yu

In the beginning stage, face verification is done using easy method of geometric algorithm models, but the verification route has now developed into a scientific progress of complicated geometric representation and identical procedure. In…

Computer Vision and Pattern Recognition · Computer Science 2014-03-24 V. Karthikeyan , K. Vijayalakshmi , P. Jeyakumar

Existing research has made impressive strides in reconstructing human facial shapes and textures from images with well-illuminated faces and minimal external occlusions. Nevertheless, it remains challenging to recover accurate facial…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Tianxin Huang , Zhenyu Zhang , Ying Tai , Gim Hee Lee