English
Related papers

Related papers: Structure-Guided Diffusion Models for High-Fidelit…

200 papers

Exploiting pre-trained diffusion models for restoration has recently become a favored alternative to the traditional task-specific training approach. Previous works have achieved noteworthy success by limiting the solution space using…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Peiqing Yang , Shangchen Zhou , Qingyi Tao , Chen Change Loy

Casually-taken portrait photographs often suffer from unflattering lighting and shadowing because of suboptimal conditions in the environment. Aesthetic qualities such as the position and softness of shadows and the lighting ratio between…

Computer Vision and Pattern Recognition · Computer Science 2020-05-21 Xuaner Cecilia Zhang , Jonathan T. Barron , Yun-Ta Tsai , Rohit Pandey , Xiuming Zhang , Ren Ng , David E. Jacobs

Denoising diffusion probabilistic models for image inpainting aim to add the noise to the texture of image during the forward process and recover masked regions with unmasked ones of the texture via the reverse denoising process. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Haipeng Liu , Yang Wang , Biao Qian , Meng Wang , Yong Rui

Following the remarkable success of diffusion models on image generation, recent works have also demonstrated their impressive ability to address a number of inverse problems in an unsupervised way, by properly constraining the sampling…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Foivos Paraperas Papantoniou , Alexandros Lattas , Stylianos Moschoglou , Stefanos Zafeiriou

Restoring real-world degraded images, such as old photographs or low-resolution images, presents a significant challenge due to the complex, mixed degradations they exhibit, such as scratches, color fading, and noise. Recent data-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Peng Xiao , Hongbo Zhao , Yijun Wang , Jianxin Lin

Achieving high-quality shadow removal with strong generalizability is challenging in scenes with complex global illumination. Due to the limited diversity in shadow removal datasets, current methods are prone to overfitting training data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jiamin Xu , Yuxin Zheng , Zelong Li , Chi Wang , Renshu Gu , Weiwei Xu , Gang Xu

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtong Tan , Feng Zhao

Curating datasets for object segmentation is a difficult task. With the advent of large-scale pre-trained generative models, conditional image generation has been given a significant boost in result quality and ease of use. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mischa Dombrowski , Hadrien Reynaud , Matthew Baugh , Bernhard Kainz

Image completion techniques have made significant progress in filling missing regions (i.e., holes) in images. However, large-hole completion remains challenging due to limited structural information. In this paper, we address this problem…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Daichi Horita , Jiaolong Yang , Dong Chen , Yuki Koyama , Kiyoharu Aizawa , Nicu Sebe

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

Recent advancements in deep learning have yielded promising results for the image shadow removal task. However, most existing methods rely on binary pre-generated shadow masks. The binary nature of such masks could potentially lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Xinrui Wang , Lanqing Guo , Xiyu Wang , Siyu Huang , Bihan Wen

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A…

Image and Video Processing · Electrical Eng. & Systems 2022-05-17 Tobias Alt , Pascal Peter , Joachim Weickert

Diffusion models have recently shown strong progress in generative tasks, offering a more stable alternative to GAN-based approaches for makeup transfer. Existing methods often suffer from limited datasets, poor disentanglement between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qihe Pan , Yiming Wu , Xing Zhao , Liang Xie , Guodao Sun , Ronghua Liang

We propose a novel deep learning method for shadow removal. Inspired by physical models of shadow formation, we use a linear illumination transformation to model the shadow effects in the image that allows the shadow image to be expressed…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Hieu Le , Dimitris Samaras

Diffusion models are powerful tools for sampling from high-dimensional distributions by progressively transforming pure noise into structured data through a denoising process. When equipped with a guidance mechanism, these models can also…

Machine Learning · Computer Science 2026-05-04 Saeed Mohseni-Sehdeh , Walid Saad , Kei Sakaguchi , Tao Yu

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv

While deep learning-based methods for blind face restoration have achieved unprecedented success, they still suffer from two major limitations. First, most of them deteriorate when facing complex degradations out of their training data.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zongsheng Yue , Chen Change Loy

Existing unsupervised methods have addressed the challenges of inconsistent paired data and tedious acquisition of ground-truth labels in shadow removal tasks. However, GAN-based training often faces issues such as mode collapse and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Ziqi Zeng , Chen Zhao , Weiling Cai , Chenyu Dong

Sketch-guided image editing aims to achieve local fine-tuning of the image based on the sketch information provided by the user, while maintaining the original status of the unedited areas. Due to the high cost of acquiring human sketches,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Weihang Mao , Bo Han , Zihao Wang

The requirement for paired shadow and shadow-free images limits the size and diversity of shadow removal datasets and hinders the possibility of training large-scale, robust shadow removal algorithms. We propose a shadow removal method that…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Hieu Le , Dimitris Samaras