English
Related papers

Related papers: Structure-Guided Diffusion Models for High-Fidelit…

200 papers

Despite promising progress in face swapping task, realistic swapped images remain elusive, often marred by artifacts, particularly in scenarios involving high pose variation, color differences, and occlusion. To address these issues, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Sanoojan Baliah , Qinliang Lin , Shengcai Liao , Xiaodan Liang , Muhammad Haris Khan

Diffusion-based approaches have recently achieved strong results in face swapping, offering improved visual quality over traditional GAN-based methods. However, even state-of-the-art models often suffer from fine-grained artifacts and poor…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Weston Bondurant , Arkaprava Sinha , Hieu Le , Srijan Das , Stephanie Schuckers

Realistic image restoration is a crucial task in computer vision, and diffusion-based models for image restoration have garnered significant attention due to their ability to produce realistic results. Restoration can be seen as a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Yuhong Zhang , Hengsheng Zhang , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Robust invisible watermarking schemes aim to embed hidden information into images such that the watermark survives common manipulations. However, powerful diffusion-based image generation and editing techniques now pose a new threat to…

Cryptography and Security · Computer Science 2026-02-25 Fan Guo , Jiyu Kang , Qi Ming , Emily Davis , Finn Carter

We study the problem of extracting biometric information of individuals by looking at shadows of objects cast on diffuse surfaces. We show that the biometric information leakage from shadows can be sufficient for reliable identity inference…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Safa C. Medin , Amir Weiss , Frédo Durand , William T. Freeman , Gregory W. Wornell

Diffusion models are now the undisputed state-of-the-art for image generation and image restoration. However, they require large amounts of computational power for training and inference. In this paper, we propose lightweight diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Nicolas Cherel , Andrés Almansa , Yann Gousseau , Alasdair Newson

In portraits, eyeglasses may occlude facial regions and generate cast shadows on faces, which degrades the performance of many techniques like face verification and expression recognition. Portrait eyeglasses removal is critical in handling…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Junfeng Lyu , Zhibo Wang , Feng Xu

Recent deep learning based approaches have shown promising results for the challenging task of inpainting large missing regions in an image. These methods can generate visually plausible image structures and textures, but often create…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Jiahui Yu , Zhe Lin , Jimei Yang , Xiaohui Shen , Xin Lu , Thomas S. Huang

In the ever-evolving adversarial machine learning landscape, developing effective defenses against patch attacks has become a critical challenge, necessitating reliable solutions to safeguard real-world AI systems. Although diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Jia Fu , Xiao Zhang , Sepideh Pashami , Fatemeh Rahimian , Anders Holst

Existing portrait relighting methods struggle with precise control over facial shadows, particularly when faced with challenges such as handling hard shadows from directional light sources or adjusting shadows while remaining in harmony…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Andrew Hou , Zhixin Shu , Xuaner Zhang , He Zhang , Yannick Hold-Geoffroy , Jae Shin Yoon , Xiaoming Liu

Although diffusion models have demonstrated remarkable generative capabilities, existing style transfer techniques often struggle to maintain identity while achieving high-quality stylization. This limitation becomes particularly critical…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mohammad Ali Rezaei , Helia Hajikazem , Saeed Khanehgir , Mahdi Javanmardi

Despite recent breakthroughs in deep learning methods for image lighting enhancement, they are inferior when applied to portraits because 3D facial information is ignored in their models. To address this, we present a novel deep learning…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Fangzhou Han , Can Wang , Hao Du , Jing Liao

Image deblurring is an ill-posed problem with multiple plausible solutions for a given input image. However, most existing methods produce a deterministic estimate of the clean image and are trained to minimize pixel-level distortion. These…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Jay Whang , Mauricio Delbracio , Hossein Talebi , Chitwan Saharia , Alexandros G. Dimakis , Peyman Milanfar

Raindrop removal is a challenging task in image processing. Removing raindrops while relying solely on a single image further increases the difficulty of the task. Common approaches include the detection of raindrop regions in the image,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Lhuqita Fazry , Valentino Vito

We present a simple but effective training-free approach for text-driven image-to-image translation based on a pretrained text-to-image diffusion model. Our goal is to generate an image that aligns with the target task while preserving the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Hyunsoo Lee , Minsoo Kang , Bohyung Han

Removing shadows requires an understanding of both lighting conditions and object textures in a scene. Existing methods typically learn pixel-level color mappings between shadow and non-shadow images, in which the joint modeling of lighting…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Yuhao Liu , Zhanghan Ke , Ke Xu , Fang Liu , Zhenwei Wang , Rynson W. H. Lau

Boundary detection of irregular and translucent objects is an important problem with applications in medical imaging, environmental monitoring and manufacturing, where many of these applications are plagued with scarce labeled data and low…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Fei Yu Guan , Ian Keefe , Sophie Wilkinson , Daniel D. B. Perrakis , Steven Waslander

Text-guided diffusion models have achieved remarkable success in object inpainting by providing high-level semantic guidance through text prompts. However, they often lack precise pixel-level spatial control, especially in scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yongle Zhang , Yimin Liu , Yan Huang , Qiang Wu

This paper presents a new method for shadow removal using unpaired data, enabling us to avoid tedious annotations and obtain more diverse training samples. However, directly employing adversarial learning and cycle-consistency constraints…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Xiaowei Hu , Yitong Jiang , Chi-Wing Fu , Pheng-Ann Heng

Image restoration tasks like deblurring, denoising, and dehazing usually need distinct models for each degradation type, restricting their generalization in real-world scenarios with mixed or unknown degradations. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Wenyang Luo , Haina Qin , Zewen Chen , Libin Wang , Dandan Zheng , Yuming Li , Yufan Liu , Bing Li , Weiming Hu