English

FastFace: Tuning Identity Preservation in Distilled Diffusion via Guidance and Attention

Computer Vision and Pattern Recognition 2025-05-30 v2

Abstract

In latest years plethora of identity-preserving adapters for a personalized generation with diffusion models have been released. Their main disadvantage is that they are dominantly trained jointly with base diffusion models, which suffer from slow multi-step inference. This work aims to tackle the challenge of training-free adaptation of pretrained ID-adapters to diffusion models accelerated via distillation - through careful re-design of classifier-free guidance for few-step stylistic generation and attention manipulation mechanisms in decoupled blocks to improve identity similarity and fidelity, we propose universal FastFace framework. Additionally, we develop a disentangled public evaluation protocol for id-preserving adapters.

Keywords

Cite

@article{arxiv.2505.21144,
  title  = {FastFace: Tuning Identity Preservation in Distilled Diffusion via Guidance and Attention},
  author = {Sergey Karpukhin and Vadim Titov and Andrey Kuznetsov and Aibek Alanov},
  journal= {arXiv preprint arXiv:2505.21144},
  year   = {2025}
}

Comments

code available at https://github.com/ControlGenAI/FastFace