English

Mitigating Exposure Bias in Discriminator Guided Diffusion Models

Computer Vision and Pattern Recognition 2023-11-21 v1 Artificial Intelligence Machine Learning

Abstract

Diffusion Models have demonstrated remarkable performance in image generation. However, their demanding computational requirements for training have prompted ongoing efforts to enhance the quality of generated images through modifications in the sampling process. A recent approach, known as Discriminator Guidance, seeks to bridge the gap between the model score and the data score by incorporating an auxiliary term, derived from a discriminator network. We show that despite significantly improving sample quality, this technique has not resolved the persistent issue of Exposure Bias and we propose SEDM-G++, which incorporates a modified sampling approach, combining Discriminator Guidance and Epsilon Scaling. Our proposed approach outperforms the current state-of-the-art, by achieving an FID score of 1.73 on the unconditional CIFAR-10 dataset.

Keywords

Cite

@article{arxiv.2311.11164,
  title  = {Mitigating Exposure Bias in Discriminator Guided Diffusion Models},
  author = {Eleftherios Tsonis and Paraskevi Tzouveli and Athanasios Voulodimos},
  journal= {arXiv preprint arXiv:2311.11164},
  year   = {2023}
}
R2 v1 2026-06-28T13:25:10.868Z