English

LightCtrl: Training-free Controllable Video Relighting

Computer Vision and Pattern Recognition 2026-03-31 v1

Abstract

Recent diffusion models have achieved remarkable success in image relighting, and this success has quickly been extended to video relighting. However, existing methods offer limited explicit control over illumination in the relighted output. We present LightCtrl, the first controllable video relighting method that enables explicit control of video illumination through a user-supplied light trajectory in a training-free manner. Our approach combines pre-trained diffusion models: an image relighting model processes each frame individually, followed by a video diffusion prior to enhance temporal consistency. To achieve explicit control over dynamically varying lighting, we introduce two key components. First, a Light Map Injection module samples light trajectory-specific noise and injects it into the latent representation of the source video, improving illumination coherence with the conditional light trajectory. Second, a Geometry-Aware Relighting module dynamically combines RGB and normal map latents in the frequency domain to suppress the influence of the original lighting, further enhancing adherence to the input light trajectory. Experiments show that LightCtrl produces high-quality videos with diverse illumination changes that closely follow the specified light trajectory, demonstrating improved controllability over baseline methods. Code is available at: https://github.com/GVCLab/LightCtrl.

Keywords

Cite

@article{arxiv.2603.27083,
  title  = {LightCtrl: Training-free Controllable Video Relighting},
  author = {Yizuo Peng and Xuelin Chen and Kai Zhang and Xiaodong Cun},
  journal= {arXiv preprint arXiv:2603.27083},
  year   = {2026}
}

Comments

Accepted at ICLR 2026

R2 v1 2026-07-01T11:42:00.545Z