English
Related papers

Related papers: Evaluating generative networks using Gaussian mixt…

200 papers

Gaussian Graphical Models (GGM) are popularly used in neuroimaging studies based on fMRI, EEG or MEG to estimate functional connectivity, or relationships between remote brain regions. In multi-subject studies, scientists seek to identify…

Methodology · Statistics 2017-05-01 Manjari Narayan , Genevera I. Allen , Steffie Tomson

The evaluation of deep generative models has been extensively studied in the centralized setting, where the reference data are drawn from a single probability distribution. On the other hand, several applications of generative models…

Machine Learning · Computer Science 2024-06-12 Zixiao Wang , Farzan Farnia , Zhenghao Lin , Yunheng Shen , Bei Yu

Fr\'echet Inception Distance (FID) is a widely used metric for assessing synthetic image quality. It relies on an ImageNet-based feature extractor, making its applicability to medical imaging unclear. A recent trend is to adapt FID to…

Devising indicative evaluation metrics for the image generation task remains an open problem. The most widely used metric for measuring the similarity between real and generated images has been the Fr\'echet Inception Distance (FID) score.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Muhammad Ferjad Naeem , Seong Joon Oh , Youngjung Uh , Yunjey Choi , Jaejun Yoo

Fr\'echet Inception Distance (FID) is widely used to evaluate image generators, yet lower FID does not always correspond to better sample quality. We show that this mismatch depends in part on the geometry of the reference dataset. In a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yunghee Lee , Byeonghyun Pak

Generative Adversarial Networks (GANs) have been shown to produce realistically looking synthetic images with remarkable success, yet their performance seems less impressive when the training set is highly diverse. In order to provide a…

Machine Learning · Computer Science 2018-08-31 Matan Ben-Yosef , Daphna Weinshall

The Fr\'echet Inception Distance (FID) has been used to evaluate hundreds of generative models. We introduce FastFID, which can efficiently train generative models with FID as a loss function. Using FID as an additional loss for Generative…

Machine Learning · Computer Science 2021-04-15 Alexander Mathiasen , Frederik Hvilshøj

Generative models are typically evaluated by direct inspection of their generated samples, e.g., by visual inspection in the case of images. Further evaluation metrics like the Fr\'echet inception distance or maximum mean discrepancy are…

Information Theory · Computer Science 2024-08-02 Michael Baur , Nurettin Turan , Simon Wallner , Wolfgang Utschick

Metrics for evaluating generative models aim to measure the discrepancy between real and generated images. The often-used Frechet Inception Distance (FID) metric, for example, extracts "high-level" features using a deep network from the two…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Gaurav Parmar , Richard Zhang , Jun-Yan Zhu

Implicit Generative Models (IGMs) such as GANs have emerged as effective data-driven models for generating samples, particularly images. In this paper, we formulate the problem of learning an IGM as minimizing the expected distance between…

Machine Learning · Computer Science 2020-06-18 Abdul Fatir Ansari , Jonathan Scarlett , Harold Soh

Distance measures between graphs are important primitives for a variety of learning tasks. In this work, we describe an unsupervised, optimal transport based approach to define a distance between graphs. Our idea is to derive…

Computational Engineering, Finance, and Science · Computer Science 2024-04-11 Michael Scholkemper , Damin Kühn , Gerion Nabbefeld , Simon Musall , Björn Kampa , Michael T. Schaub

This paper shows that two commonly used evaluation metrics for generative models, the Fr\'echet Inception Distance (FID) and the Inception Score (IS), are biased -- the expected value of the score computed for a finite sample set is not the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Min Jin Chong , David Forsyth

Generative models have made immense progress in recent years, particularly in their ability to generate high quality images. However, that quality has been difficult to evaluate rigorously, with evaluation dominated by heuristic approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Y. Alex Kolchinski , Sharon Zhou , Shengjia Zhao , Mitchell Gordon , Stefano Ermon

The success of deep learning-based generative models in producing realistic images, videos, and audios has led to a crucial consideration: how to effectively assess the quality of synthetic samples. While the Fr\'{e}chet Inception Distance…

Machine Learning · Computer Science 2024-03-12 Yang Chen , Dustin J. Kempton , Rafal A. Angryk

Generative Adversarial Networks (GANs) face a significant challenge of striking an optimal balance between high-quality image generation and training stability. Recent techniques, such as DCGAN, BigGAN, and StyleGAN, improve visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Ahmed A. Hashim , Ali Al-Shuwaili , Asraa Saeed , Ali Al-Bayaty

Evaluating image generation models such as generative adversarial networks (GANs) is a challenging problem. A common approach is to compare the distributions of the set of ground truth images and the set of generated test images. The…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Junghyuk Lee , Jong-Seok Lee

Modern metrics for generative learning like Fr\'echet Inception Distance (FID) and DINOv2-Fr\'echet Distance (FD-DINOv2) demonstrate impressive performance. However, they suffer from various shortcomings, like a bias towards specific…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Lokesh Veeramacheneni , Moritz Wolter , Hildegard Kuehne , Juergen Gall

We present a simple method for assessing the quality of generated images in Generative Adversarial Networks (GANs). The method can be applied in any kind of GAN without interfering with the learning procedure or affecting the learning…

Machine Learning · Computer Science 2017-11-15 Hamid Eghbal-zadeh , Gerhard Widmer

Evaluating the realism of generated images remains a fundamental challenge in generative modeling. Existing distributional metrics such as the Frechet Inception Distance (FID) and CLIP-MMD (CMMD) compare feature distributions at a semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Joé Napolitano , Pascal Nguyen

Gaussian mixture models (GMMs) are widely used in machine learning for tasks such as clustering, classification, image reconstruction, and generative modeling. A key challenge in working with GMMs is defining a computationally efficient and…

Machine Learning · Computer Science 2025-08-05 Moritz Piening , Robert Beinert