In latest years plethora of identity-preserving adapters for a personalized generation with diffusion models have been released. Their main disadvantage is that they are dominantly trained jointly with base diffusion models, which suffer from slow multi-step inference. This work aims to tackle the challenge of training-free adaptation of pretrained ID-adapters to diffusion models accelerated via distillation - through careful re-design of classifier-free guidance for few-step stylistic generation and attention manipulation mechanisms in decoupled blocks to improve identity similarity and fidelity, we propose universal FastFace framework. Additionally, we develop a disentangled public evaluation protocol for id-preserving adapters.
@article{arxiv.2505.21144,
title = {FastFace: Tuning Identity Preservation in Distilled Diffusion via Guidance and Attention},
author = {Sergey Karpukhin and Vadim Titov and Andrey Kuznetsov and Aibek Alanov},
journal= {arXiv preprint arXiv:2505.21144},
year = {2025}
}
Comments
code available at https://github.com/ControlGenAI/FastFace