English
Related papers

Related papers: Face Adapter for Pre-Trained Diffusion Models with…

200 papers

Facial expression transfer and reenactment has been an important research problem given its applications in face editing, image manipulation, and fabricated videos generation. We present a novel method for image-based facial expression…

Computer Vision and Pattern Recognition · Computer Science 2019-12-16 Chao Yang , Ser-Nam Lim

Face animation has achieved much progress in computer vision. However, prevailing GAN-based methods suffer from unnatural distortions and artifacts due to sophisticated motion deformation. In this paper, we propose a Face Animation…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Bohan Zeng , Xuhui Liu , Sicheng Gao , Boyu Liu , Hong Li , Jianzhuang Liu , Baochang Zhang

Face attribute editing aims to generate faces with one or multiple desired face attributes manipulated while other details are preserved. Unlike prior works such as GAN inversion, which has an expensive reverse mapping process, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Zhiliang Xu , Xiyu Yu , Zhibin Hong , Zhen Zhu , Junyu Han , Jingtuo Liu , Errui Ding , Xiang Bai

Different forms of customized 2D avatars are widely used in gaming applications, virtual communication, education, and content creation. However, existing approaches often fail to capture fine-grained facial expressions and struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Hao Yu , Rupayan Mallick , Margrit Betke , Sarah Adel Bargal

This technical report presents a diffusion model based framework for face swapping between two portrait images. The basic framework consists of three components, i.e., IP-Adapter, ControlNet, and Stable Diffusion's inpainting pipeline, for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Feifei Wang

With the rapid advancement of diffusion models, talking face generation has made remarkable progress. However, existing diffusion-based methods still require task-specific fine-tuning and large-scale audiovisual datasets, resulting in high…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Hao Wu , Xiangyang Luo , Hao Wang , Jiawei Zhang , Yi Zhang , Jinwei Wang

Multi-view image diffusion models have significantly advanced open-domain 3D object generation. However, most existing models rely on 2D network architectures that lack inherent 3D biases, resulting in compromised geometric consistency. To…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Hansheng Chen , Bokui Shen , Yulin Liu , Ruoxi Shi , Linqi Zhou , Connor Z. Lin , Jiayuan Gu , Hao Su , Gordon Wetzstein , Leonidas Guibas

In this work, we present a new single-stage method for subject agnostic face swapping and identity transfer, named FaceDancer. We have two major contributions: Adaptive Feature Fusion Attention (AFFA) and Interpreted Feature Similarity…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Felix Rosberg , Eren Erdal Aksoy , Fernando Alonso-Fernandez , Cristofer Englund

Image-to-image translation (I2I), and particularly its subfield of appearance transfer, which seeks to alter the visual appearance between images while maintaining structural coherence, presents formidable challenges. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yuteng Ye , Guanwen Li , Hang Zhou , Cai Jiale , Junqing Yu , Yawei Luo , Zikai Song , Qilong Xing , Youjia Zhang , Wei Yang

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

In the field of human-centric personalized image generation, the adapter-based method obtains the ability to customize and generate portraits by text-to-image training on facial data. This allows for identity-preserved personalization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Cheng Yu , Haoyu Xie , Lei Shang , Yang Liu , Jun Dan , Liefeng Bo , Baigui Sun

In this paper, we study the problem of generalizable synthetic image detection, aiming to detect forgery images from diverse generative methods, e.g., GANs and diffusion models. Cutting-edge solutions start to explore the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Huan Liu , Zichang Tan , Chuangchuang Tan , Yunchao Wei , Yao Zhao , Jingdong Wang

Face personalization aims to insert specific faces, taken from images, into pretrained text-to-image diffusion models. However, it is still challenging for previous methods to preserve both the identity similarity and editability due to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Kaede Shiohara , Toshihiko Yamasaki

Recent generative-prior-based methods have shown promising blind face restoration performance. They usually project the degraded images to the latent space and then decode high-quality faces either by single-stage latent optimization or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Maitreya Suin , Rama Chellappa

Recently, we have seen a surge of personalization methods for text-to-image (T2I) diffusion models to learn a concept using a few images. Existing approaches, when used for face personalization, suffer to achieve convincing inversion with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Rishubh Parihar , Sachidanand VS , Sabariswaran Mani , Tejan Karmali , R. Venkatesh Babu

Facial Beauty Prediction (FBP) is a challenging computer vision task due to its subjective nature and the subtle, holistic features that influence human perception. Prevailing methods, often based on deep convolutional networks or standard…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Djamel Eddine Boukhari , Ali chemsa

Recently, text-to-image generation models have achieved remarkable advancements, particularly with diffusion models facilitating high-quality image synthesis from textual descriptions. However, these models often struggle with achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Lunhao Duan , Shanshan Zhao , Wenjun Yan , Yinglun Li , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Mingming Gong , Gui-Song Xia

We introduce the BIR-Adapter, a parameter-efficient diffusion adapter for blind image restoration. Diffusion-based restoration methods have demonstrated promising performance in addressing this fundamental problem in computer vision,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Cem Eteke , Alexander Griessel , Wolfgang Kellerer , Eckehard Steinbach

Taking full advantage of the excellent performance of StyleGAN, style transfer-based face swapping methods have been extensively investigated recently. However, these studies require separate face segmentation and blending modules for…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Chenhao Lin , Pengbin Hu , Chao Shen , Qian Li

In this paper, we introduce DreamID, a diffusion-based face swapping model that achieves high levels of ID similarity, attribute preservation, image fidelity, and fast inference speed. Unlike the typical face swapping training process,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Fulong Ye , Miao Hua , Pengze Zhang , Xinghui Li , Qichao Sun , Songtao Zhao , Qian He , Xinglong Wu