English
Related papers

Related papers: Reviewing FID and SID Metrics on Generative Advers…

200 papers

Generative Adversarial Networks (GANs) have made great progress in synthesizing realistic images in recent years. However, they are often trained on image datasets with either too few samples or too many classes belonging to different data…

Machine Learning · Computer Science 2020-10-16 Shichang Tang

Conditional Generative Adversarial Networks (cGANs) are finding increasingly widespread use in many application domains. Despite outstanding progress, quantitative evaluation of such models often involves multiple distinct metrics to assess…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Terrance DeVries , Adriana Romero , Luis Pineda , Graham W. Taylor , Michal Drozdzal

Generative Adversarial Networks (GANs) produce high-quality images but are challenging to train. They need careful regularization, vast amounts of compute, and expensive hyper-parameter sweeps. We make significant headway on these issues by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Axel Sauer , Kashyap Chitta , Jens Müller , Andreas Geiger

Modern metrics for generative learning like Fr\'echet Inception Distance (FID) and DINOv2-Fr\'echet Distance (FD-DINOv2) demonstrate impressive performance. However, they suffer from various shortcomings, like a bias towards specific…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lokesh Veeramacheneni , Moritz Wolter , Hildegard Kuehne , Juergen Gall

Evaluating image generation models such as generative adversarial networks (GANs) is a challenging problem. A common approach is to compare the distributions of the set of ground truth images and the set of generated test images. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Junghyuk Lee , Jong-Seok Lee

Recently, Generative Adversarial Networks (GANs) have been successfully scaled to billion-scale large text-to-image datasets. However, training such models entails a high training cost, limiting some applications and research usage. To…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yuya Kobayashi , Yuhta Takida , Takashi Shibuya , Yuki Mitsufuji

We propose the Monge Inception Distance (MIND), a metric for evaluating generative models that addresses key limitations of the widely adopted Fr\'echet Inception Distance (FID). The MIND metric leverages the sliced Wasserstein distance to…

Machine Learning · Computer Science 2026-05-11 Quentin Berthet , Yu-Han Wu , Clement Crepy , Romuald Elie , Klaus Greff , Michael Eli Sander

Perceptual metrics, like the Fr\'echet Inception Distance (FID), are widely used to assess the similarity between synthetically generated and ground truth (real) images. The key idea behind these metrics is to compute errors in a deep…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Krish Kabra , Guha Balakrishnan

Despite recent progress in generative image modeling, successfully generating high-resolution, diverse samples from complex datasets such as ImageNet remains an elusive goal. To this end, we train Generative Adversarial Networks at the…

Machine Learning · Computer Science 2019-02-27 Andrew Brock , Jeff Donahue , Karen Simonyan

In this paper, we propose the Self-Attention Generative Adversarial Network (SAGAN) which allows attention-driven, long-range dependency modeling for image generation tasks. Traditional convolutional GANs generate high-resolution details as…

Machine Learning · Statistics 2019-06-18 Han Zhang , Ian Goodfellow , Dimitris Metaxas , Augustus Odena

We propose a Generative Adversarial Network (GAN) that introduces an evaluator module using pre-trained networks. The proposed model, called score-guided GAN (ScoreGAN), is trained with an evaluation metric for GANs, i.e., the Inception…

Machine Learning · Computer Science 2020-05-28 Minhyeok Lee , Junhee Seok

Devising indicative evaluation metrics for the image generation task remains an open problem. The most widely used metric for measuring the similarity between real and generated images has been the Fr\'echet Inception Distance (FID) score.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Muhammad Ferjad Naeem , Seong Joon Oh , Youngjung Uh , Yunjey Choi , Jaejun Yoo

This paper shows that two commonly used evaluation metrics for generative models, the Fr\'echet Inception Distance (FID) and the Inception Score (IS), are biased -- the expected value of the score computed for a finite sample set is not the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Min Jin Chong , David Forsyth

Feature embeddings acquired from pretrained models are widely used in medical applications of deep learning to assess the characteristics of datasets; e.g. to determine the quality of synthetic, generated medical images. The Fr\'{e}chet…

Machine Learning · Computer Science 2026-01-30 Ciaran Bench , Vivek Desai , Carlijn Roozemond , Ruben van Engen , Spencer A. Thomas

Recent advances in generative modeling have led to an increased interest in the study of statistical divergences as means of model comparison. Commonly used evaluation methods, such as the Frechet Inception Distance (FID), correlate well…

Machine Learning · Statistics 2018-10-30 Mehdi S. M. Sajjadi , Olivier Bachem , Mario Lucic , Olivier Bousquet , Sylvain Gelly

Fr\'echet Inception Distance (FID) is widely used to evaluate image generators, yet lower FID does not always correspond to better sample quality. We show that this mismatch depends in part on the geometry of the reference dataset. In a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yunghee Lee , Byeonghyun Pak

Generating realistic biometric images has been an interesting and, at the same time, challenging problem. Classical statistical models fail to generate realistic-looking fingerprint images, as they are not powerful enough to capture the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Shervin Minaee , Amirali Abdolrashidi

Generative Adversarial Networks (GANs) have shown impressive performance in generating photo-realistic images. They fit generative models by minimizing certain distance measure between the real image distribution and the generated data…

Machine Learning · Computer Science 2017-09-29 Jianbo Guo , Guangxiang Zhu , Jian Li

Generative Adversarial Networks (GANs) can accurately model complex multi-dimensional data and generate realistic samples. However, due to their implicit estimation of data distributions, their evaluation is a challenging task. The majority…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Amirsina Torfi , Mohammadreza Beyki , Edward A. Fox

Training generative adversarial networks requires balancing of delicate adversarial dynamics. Even with careful tuning, training may diverge or end up in a bad equilibrium with dropped modes. In this work, we improve CS-GAN with natural…

Machine Learning · Computer Science 2020-07-02 Yan Wu , Jeff Donahue , David Balduzzi , Karen Simonyan , Timothy Lillicrap