English
Related papers

Related papers: Controllable Light Diffusion for Portraits

200 papers

Lighting plays a central role in conveying the essence and depth of the subject in a portrait photograph. Professional photographers will carefully control the lighting in their studio to manipulate the appearance of their subject, while…

Existing portrait relighting methods struggle with precise control over facial shadows, particularly when faced with challenges such as handling hard shadows from directional light sources or adjusting shadows while remaining in harmony…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Andrew Hou , Zhixin Shu , Xuaner Zhang , He Zhang , Yannick Hold-Geoffroy , Jae Shin Yoon , Xiaoming Liu

Controlling illumination in images is essential for photography and visual content creation. While closed-source models have demonstrated impressive illumination control, open-source alternatives either require heavy control inputs like…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Nishit Anand , Manan Suri , Christopher Metzler , Dinesh Manocha , Ramani Duraiswami

Recent advances in large-scale text-to-image models have revolutionized creative fields by generating visually captivating outputs from textual prompts; however, while traditional photography offers precise control over camera settings to…

Graphics · Computer Science 2025-06-17 Armando Fortes , Tianyi Wei , Shangchen Zhou , Xingang Pan

We introduce a novel approach to single-view face relighting in the wild, addressing challenges such as global illumination and cast shadows. A common scheme in recent methods involves intrinsically decomposing an input image into 3D shape,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Puntawat Ponglertnapakorn , Nontawat Tritrong , Supasorn Suwajanakorn

Large-scale generative models have achieved remarkable advancements in various visual tasks, yet their application to shadow removal in images remains challenging. These models often generate diverse, realistic details without adequate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Xinjie Li , Yang Zhao , Dong Wang , Yuan Chen , Li Cao , Xiaoping Liu

Image composition targets at synthesizing a realistic composite image from a pair of foreground and background images. Recently, generative composition methods are built on large pretrained diffusion models to generate composite images,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Bo Zhang , Yuxuan Duan , Jun Lan , Yan Hong , Huijia Zhu , Weiqiang Wang , Li Niu

Relighting of human images enables post-photography editing of lighting effects in portraits. The current mainstream approach uses neural networks to approximate lighting effects without explicitly accounting for the principle of physical…

Graphics · Computer Science 2024-11-04 Daichi Tajima , Yoshihiro Kanamori , Yuki Endo

Light control in generated images is a difficult task, posing specific challenges, spanning over the entire image and frequency spectrum. Most approaches tackle this problem by training on extensive yet domain-specific datasets, limiting…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Yotam Erel , Rishabh Dabral , Vladislav Golyanik , Amit H. Bermano , Christian Theobalt

Single-image relighting is a challenging task that involves reasoning about the complex interplay between geometry, materials, and lighting. Many prior methods either support only specific categories of images, such as portraits, or require…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Haian Jin , Yuan Li , Fujun Luan , Yuanbo Xiangli , Sai Bi , Kai Zhang , Zexiang Xu , Jin Sun , Noah Snavely

Given a portrait image of a person and an environment map of the target lighting, portrait relighting aims to re-illuminate the person in the image as if the person appeared in an environment with the target lighting. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Yu-Ying Yeh , Koki Nagano , Sameh Khamis , Jan Kautz , Ming-Yu Liu , Ting-Chun Wang

Face stylization refers to the transformation of a face into a specific portrait style. However, current methods require the use of example-based adaptation approaches to fine-tune pre-trained generative models so that they demand lots of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jin Liu , Huaibo Huang , Chao Jin , Ran He

Capturing images is a key part of automation for high-level tasks such as scene text recognition. Low-light conditions pose a challenge for high-level perception stacks, which are often optimized on well-lit, artifact-free images.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-01 Cindy M. Nguyen , Eric R. Chan , Alexander W. Bergman , Gordon Wetzstein

Outdoor scene relighting is a challenging problem that requires good understanding of the scene geometry, illumination and albedo. Current techniques are completely supervised, requiring high quality synthetic renderings to train a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Ye Yu , Abhimitra Meka , Mohamed Elgharib , Hans-Peter Seidel , Christian Theobalt , William A. P. Smith

State-of-the-art diffusion models can generate highly realistic images based on various conditioning like text, segmentation, and depth. However, an essential aspect often overlooked is the specific camera geometry used during image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Andrey Voynov , Amir Hertz , Moab Arar , Shlomi Fruchter , Daniel Cohen-Or

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zakaria Patel , Kirill Serkh

Existing face relighting methods often struggle with two problems: maintaining the local facial details of the subject and accurately removing and synthesizing shadows in the relit image, especially hard shadows. We propose a novel deep…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Andrew Hou , Ze Zhang , Michel Sarkis , Ning Bi , Yiying Tong , Xiaoming Liu

Low-light image enhancement aims to improve the visibility of degraded images to better align with human visual perception. While diffusion-based methods have shown promising performance due to their strong generative capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jinhong He , Minglong Xue , Zhipu Liu , Mingliang Zhou , Aoxiang Ning , Palaiahnakote Shivakumara

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jay Whang , Mauricio Delbracio , Hossein Talebi , Chitwan Saharia , Alexandros G. Dimakis , Peyman Milanfar

2D face analysis techniques, such as face landmarking, face recognition and face verification, are reasonably dependent on illumination conditions which are usually uncontrolled and unpredictable in the real world. An illumination robust…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Wuming Zhang , Xi Zhao , Jean-Marie Morvan , Liming Chen