English
Related papers

Related papers: Face Adapter for Pre-Trained Diffusion Models with…

200 papers

Watermarking is crucial for protecting the copyright of AI-generated images. We propose WMAdapter, a diffusion model watermark plugin that takes user-specified watermark information and allows for seamless watermark imprinting during the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Hai Ci , Yiren Song , Pei Yang , Jinheng Xie , Mike Zheng Shou

The task of face reenactment is to transfer the head motion and facial expressions from a driving video to the appearance of a source image, which may be of a different person (cross-reenactment). Most existing methods are CNN-based and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Andre Rochow , Max Schwarz , Sven Behnke

Recently, diffusion transformers have gained wide attention with its excellent performance in text-to-image and text-to-vidoe models, emphasizing the need for transformers as backbone for diffusion models. Transformer-based models have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M. Patel

In the big data era, the computer vision field benefits from large-scale datasets such as LAION-2B, LAION-400M, and ImageNet-21K, Kinetics, on which popular models like the ViT and ConvNeXt series have been pre-trained, acquiring…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qiankun Li , Feng He , Huabao Chen , Xin Ning , Kun Wang , Zengfu Wang

Face swapping aims to transfer the identity of a source face onto a target face while preserving target-specific attributes such as pose, expression, lighting, skin tone, and makeup. However, since real ground truth for face swapping is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiwon Kang , Yeji Choi , JoungBin Lee , Wooseok Jang , Jinhyeok Choi , Taekeun Kang , Yongjae Park , Myungin Kim , Seungryong Kim

We present a new multi-modal face image generation method that converts a text prompt and a visual input, such as a semantic mask or scribble map, into a photo-realistic face image. To do this, we combine the strengths of Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Jihyun Kim , Changjae Oh , Hoseok Do , Soohyun Kim , Kwanghoon Sohn

This paper presents a Deep convolutional network model for Identity-Aware Transfer (DIAT) of facial attributes. Given the source input image and the reference attribute, DIAT aims to generate a facial image that owns the reference attribute…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Mu Li , Wangmeng Zuo , David Zhang

Recent advances in diffusion models have significantly improved text-to-face generation, but achieving fine-grained control over facial features remains a challenge. Existing methods often require training additional modules to handle…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Liang Shi , Yun Fu

In this paper, we present an Attention-based Identity Preserving Generative Adversarial Network (AIP-GAN) to overcome the identity leakage problem from a source image to a generated face image, an issue that is encountered in a…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Kamran Ali , Charles E. Hughes

RGBA images, with the additional alpha channel, are crucial for any application that needs blending, masking, or transparency effects, making them more versatile than standard RGB images. Nevertheless, existing image inpainting methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yuekun Dai , Haitian Li , Shangchen Zhou , Chen Change Loy

The goal of face attribute editing is altering a facial image according to given target attributes such as hair color, mustache, gender, etc. It belongs to the image-to-image domain transfer problem with a set of attributes considered as a…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Jeong-gi Kwak , David K. Han , Hanseok Ko

Adapting large-scale pre-trained generative models in a parameter-efficient manner is gaining traction. Traditional methods like low rank adaptation achieve parameter efficiency by imposing constraints but may not be optimal for tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Xinxi Zhang , Song Wen , Ligong Han , Felix Juefei-Xu , Akash Srivastava , Junzhou Huang , Hao Wang , Molei Tao , Dimitris N. Metaxas

Recent advances in diffusion-based text-to-video models, particularly those built on the diffusion transformer architecture, have achieved remarkable progress in generating high-quality and temporally coherent videos. However, transferring…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Zhexin Zhang , Yangyang Xu , Yifeng Zhu , Long Chen , Yong Du , Shengfeng He , Jun Yu

Face swapping technology has gained significant attention in both academic research and commercial applications. This paper presents our implementation and enhancement of SimSwap, an efficient framework for high fidelity face swapping. We…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Om Patil , Jinesh Modi , Suryabha Mukhopadhyay , Meghaditya Giri , Chhavi Malhotra

Facial attribute editing aims to manipulate attributes on the human face, e.g., adding a mustache or changing the hair color. Existing approaches suffer from a serious compromise between correct attribute generation and preservation of the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Zhenliang He , Meina Kan , Jichao Zhang , Shiguang Shan

The rapid progress of Deepfake technology has made face swapping highly realistic, raising concerns about the malicious use of fabricated facial content. Existing methods often struggle to generalize to unseen domains due to the diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ke Sun , Shen Chen , Taiping Yao , Hong Liu , Xiaoshuai Sun , Shouhong Ding , Rongrong Ji

We present 3DiFACE, a novel method for personalized speech-driven 3D facial animation and editing. While existing methods deterministically predict facial animations from speech, they overlook the inherent one-to-many relationship between…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Balamurugan Thambiraja , Sadegh Aliakbarian , Darren Cosker , Justus Thies

Generative models such as StyleGAN2 and Stable Diffusion have achieved state-of-the-art performance in computer vision tasks such as image synthesis, inpainting, and de-noising. However, current generative models for face inpainting often…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Saman Motamed , Jianjin Xu , Chen Henry Wu , Fernando De la Torre

Blind face restoration has made great progress in producing high-quality and lifelike images. Yet it remains challenging to preserve the ID information especially when the degradation is heavy. Current reference-guided face restoration…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Jiacheng Ying , Mushui Liu , Zhe Wu , Runming Zhang , Zhu Yu , Siming Fu , Si-Yuan Cao , Chao Wu , Yunlong Yu , Hui-Liang Shen

Face reenactment aims to generate realistic talking head videos by transferring motion from a driving video to a static source image while preserving the source identity. Although existing methods based on either implicit or explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Mingtao Guo , Guanyu Xing , Yanci Zhang , Yanli Liu