English
Related papers

Related papers: RelightMaster: Precise Video Relighting with Multi…

200 papers

Video portraits relighting is critical in user-facing human photography, especially for immersive VR/AR experience. Recent advances still fail to recover consistent relit result under dynamic illuminations from monocular RGB stream,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Longwen Zhang , Qixuan Zhang , Minye Wu , Jingyi Yu , Lan Xu

In this paper, we develop a personalized video relighting algorithm that produces high-quality and temporally consistent relit videos under any pose, expression, and lighting condition in real-time. Existing relighting algorithms typically…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Jun Myeong Choi , Max Christman , Roni Sengupta

Achieving photorealistic 3D view synthesis and relighting of human portraits is pivotal for advancing AR/VR applications. Existing methodologies in portrait relighting demonstrate substantial limitations in terms of generalization and 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Pramod Rao , Gereon Fox , Abhimitra Meka , Mallikarjun B R , Fangneng Zhan , Tim Weyrich , Bernd Bickel , Hanspeter Pfister , Wojciech Matusik , Mohamed Elgharib , Christian Theobalt

We introduce LumiNet, a novel architecture that leverages generative models and latent intrinsic representations for effective lighting transfer. Given a source image and a target lighting image, LumiNet synthesizes a relit version of the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Xiaoyan Xing , Konrad Groh , Sezer Karaoglu , Theo Gevers , Anand Bhattad

We present SyncLight, a method to enable consistent, parametric control over light sources across multiple uncalibrated views of a static scene conditioned on a single view. While single-view relighting has advanced significantly, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 David Serrano-Lozano , Anand Bhattad , Luis Herranz , Jean-François Lalonde , Javier Vazquez-Corral

Despite recent advances, diffusion-based text-to-image models still struggle with accurate text rendering. Several studies have proposed fine-tuning or training-free refinement methods for accurate text rendering. However, the critical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Kanghyun Baek , Sangyub Lee , Jin Young Choi , Jaewoo Song , Daemin Park , Jooyoung Choi , Chaehun Shin , Bohyung Han , Sungroh Yoon

Text-to-video generation has made remarkable advancements through diffusion models. However, Multi-Concept Video Customization (MCVC) remains a significant challenge. We identify two key challenges for this task: 1) the identity decoupling…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Yuzhou Huang , Ziyang Yuan , Quande Liu , Qiulin Wang , Xintao Wang , Ruimao Zhang , Pengfei Wan , Di Zhang , Kun Gai

Estimating scene lighting from a single image or video remains a longstanding challenge in computer vision and graphics. Learning-based approaches are constrained by the scarcity of ground-truth HDR environment maps, which are expensive to…

Graphics · Computer Science 2025-09-05 Ruofan Liang , Kai He , Zan Gojcic , Igor Gilitschenski , Sanja Fidler , Nandita Vijaykumar , Zian Wang

Low-light image enhancement is challenging due to complex degradations, including amplified noise, artifacts, and color distortion. While Retinex-based deep learning methods have achieved promising results, they primarily rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Youssef Aboelwafa , Hicham G. Elmongui , Marwan Torki

Text-to-image diffusion models have recently received increasing interest for their astonishing ability to produce high-fidelity images from solely text inputs. Subsequent research efforts aim to exploit and apply their capabilities to real…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Manuel Brack , Felix Friedrich , Katharina Kornmeier , Linoy Tsaban , Patrick Schramowski , Kristian Kersting , Apolinário Passos

Instruction-based video editing requires transforming a source video according to a natural-language instruction while preserving irrelevant content and remaining temporally coherent. We argue that existing Diffusion Transformer (DiT)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yan Li , Lin Liu , Xiaopeng Zhang , Qi Tian

With the growing demand for real-time video enhancement in live applications, existing methods often struggle to balance speed and effective exposure control, particularly under uneven lighting. We introduce RRNet (Rendering Relighting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Wenlong Yang , Canran Jin , Weihang Yuan , Chao Wang , Lifeng Sun

Most existing illumination-editing approaches fail to simultaneously provide customized control of light effects and preserve content integrity. This makes them less effective for practical lighting stylization requirements, especially in…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Zongming Li , Lianghui Zhu , Haocheng Shen , Longjin Ran , Wenyu Liu , Xinggang Wang

Although natural language instructions offer an intuitive way to guide automated image editing, deep-learning models often struggle to achieve high-quality results, largely due to the difficulty of creating large, high-quality training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Sherry X. Chen , Misha Sra , Pradeep Sen

Relighting a person from a single photo is an attractive but ill-posed task, as a 2D image ambiguously entangles 3D geometry, intrinsic appearance, and illumination. Current methods either use sequential pipelines that suffer from error…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Yuxuan Xue , Ruofan Liang , Egor Zakharov , Timur Bagautdinov , Chen Cao , Giljoo Nam , Shunsuke Saito , Gerard Pons-Moll , Javier Romero

Existing deep learning-based low-light enhancement methods are typically trained on limited datasets with single enhancement targets, which restricts their generalization ability and controllability in real-world applications. To overcome…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yufeng Yang , Jianzhuang Liu , Jisheng Chu , Yuqi Peng , Xianfang Zeng , Jiancheng Huang , Shifeng Chen

Recent advances in illumination control extend image-based methods to video, yet still facing a trade-off between lighting fidelity and temporal consistency. Moving beyond relighting, a key step toward generative modeling of real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Tianqi Liu , Zhaoxi Chen , Zihao Huang , Shaocong Xu , Saining Zhang , Chongjie Ye , Bohan Li , Zhiguo Cao , Wei Li , Hao Zhao , Ziwei Liu

We propose a generative model that, given a coarsely edited image, synthesizes a photorealistic output that follows the prescribed layout. Our method transfers fine details from the original image and preserve the identity of its parts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Hadi Alzayer , Zhihao Xia , Xuaner Zhang , Eli Shechtman , Jia-Bin Huang , Michael Gharbi

We present a self-supervised approach to in-the-wild image relighting that enables fully controllable, physically based illumination editing. We achieve this by combining the physical accuracy of traditional rendering with the…

Graphics · Computer Science 2025-08-08 Chris Careaga , Yağız Aksoy

We present PIXLRelight, a feed-forward approach for physically controllable single-image relighting. Existing methods either provide limited lighting control (e.g. through text or environment maps), accumulate errors when chaining inverse…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Miguel Farinha , Ronald Clark