English
Related papers

Related papers: Face inpainting with Identity Preserving Latent Di…

200 papers

Existing diffusion models show great potential for identity-preserving generation. However, personalized portrait generation remains challenging due to the diversity in user profiles, including variations in appearance and lighting…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Han Yang , Enis Simsar , Sotiris Anagnostidis , Yanlong Zang , Thomas Hofmann , Ziwei Liu

In latest years plethora of identity-preserving adapters for a personalized generation with diffusion models have been released. Their main disadvantage is that they are dominantly trained jointly with base diffusion models, which suffer…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sergey Karpukhin , Vadim Titov , Andrey Kuznetsov , Aibek Alanov

Face swapping aims to optimize realistic facial image generation by leveraging the identity of a source face onto a target face while preserving pose, expression, and context. However, existing methods, especially GAN-based methods, often…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Md Shohel Rana , Tanoy Debnath

Generic image inpainting aims to complete a corrupted image by borrowing surrounding information, which barely generates novel content. By contrast, multi-modal inpainting provides more flexible and useful controls on the inpainted content,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shaoan Xie , Zhifei Zhang , Zhe Lin , Tobias Hinz , Kun Zhang

The rapid progress of Deepfake technology has made face swapping highly realistic, raising concerns about the malicious use of fabricated facial content. Existing methods often struggle to generalize to unseen domains due to the diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ke Sun , Shen Chen , Taiping Yao , Hong Liu , Xiaoshuai Sun , Shouhong Ding , Rongrong Ji

Self-supervised representation learning has gained increasing attention for strong generalization ability without relying on paired datasets. However, it has not been explored sufficiently for facial representation. Self-supervised facial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Ruian He , Zhen Xing , Weimin Tan , Bo Yan

An authentic face restoration system is becoming increasingly demanding in many computer vision applications, e.g., image enhancement, video communication, and taking portrait. Most of the advanced face restoration models can recover…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yang Zhao , Tingbo Hou , Yu-Chuan Su , Xuhui Jia. Yandong Li , Matthias Grundmann

Blind face restoration is a highly ill-posed problem due to the lack of necessary context. Although existing methods produce high-quality outputs, they often fail to faithfully preserve the individual's identity. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Siyu Liu , Zheng-Peng Duan , Jia OuYang , Jiayi Fu , Hyunhee Park , Zikun Liu , Chun-Le Guo , Chongyi Li

Suspect face generation remains a technical challenge in crime investigations. Traditional sketch-drawing workflows suffer from low efficiency and quality, while diffusion-based approaches still face intrinsic limitations on conditional…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Weichen Liu , Yixin Yang , Changsheng Chen , Alex Kot

Human-centric generative models designed for AI-driven storytelling must bring together two core capabilities: identity consistency and precise control over human performance. While recent diffusion-based approaches have made significant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Foivos Paraperas Papantoniou , Stefanos Zafeiriou

Diffusion models have recently shown strong progress in generative tasks, offering a more stable alternative to GAN-based approaches for makeup transfer. Existing methods often suffer from limited datasets, poor disentanglement between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qihe Pan , Yiming Wu , Xing Zhao , Liang Xie , Guodao Sun , Ronghua Liang

We present a novel approach to face aging that addresses the limitations of current methods which treat aging as a global, homogeneous process. Existing techniques using GANs and diffusion models often condition generation on a reference…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Lais Isabelle Alves dos Santos , Julien Despois , Thibaut Chauffier , Sileye O. Ba , Giovanni Palma

The performance of automated face recognition systems is inevitably impacted by the facial aging process. However, high quality datasets of individuals collected over several years are typically small in scale. In this work, we propose,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Sudipta Banerjee , Govind Mittal , Ameya Joshi , Chinmay Hegde , Nasir Memon

In this paper, we introduce DreamID, a diffusion-based face swapping model that achieves high levels of ID similarity, attribute preservation, image fidelity, and fast inference speed. Unlike the typical face swapping training process,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Fulong Ye , Miao Hua , Pengze Zhang , Xinghui Li , Qichao Sun , Songtao Zhao , Qian He , Xinglong Wu

We propose MegaPortrait. It's an innovative system for creating personalized portrait images in computer vision. It has three modules: Identity Net, Shading Net, and Harmonization Net. Identity Net generates learned identity using a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Han Yang , Sotiris Anagnostidis , Enis Simsar , Thomas Hofmann

Portrait animation aims to generate photo-realistic videos from a single source image by reenacting the expression and pose from a driving video. While early methods relied on 3D morphable models or feature warping techniques, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Mallikarjun B. R. , Fei Yin , Vikram Voleti , Nikita Drobyshev , Maksim Lapin , Aaryaman Vasishta , Varun Jampani

As artificial intelligence advances rapidly, particularly with the advent of GANs and diffusion models, the accuracy of Image Inpainting Localization (IIL) has become increasingly challenging. Current IIL methods face two main challenges: a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Kai Wang , Shaozhang Niu , Qixian Hao , Jiwei Zhang

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

Preserving face identity is a critical yet persistent challenge in diffusion-based image restoration. While reference faces offer a path forward, existing reference-based methods often fail to fully exploit their potential. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Mo Zhou , Keren Ye , Viraj Shah , Kangfu Mei , Mauricio Delbracio , Peyman Milanfar , Vishal M. Patel , Hossein Talebi

We present a novel deep learning approach to synthesize complete face images in the presence of large ocular region occlusions. This is motivated by recent surge of VR/AR displays that hinder face-to-face communications. Different from the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Yajie Zhao , Weikai Chen , Jun Xing , Xiaoming Li , Zach Bessinger , Fuchang Liu , Wangmeng Zuo , Ruigang Yang