English
Related papers

Related papers: A Pragmatic Note on Evaluating Generative Models w…

200 papers

Diabetic Retinopathy (DR) is a leading cause of preventable blindness. Early detection at the DR1 stage is critical but is hindered by a scarcity of high-quality fundus images. This study uses StyleGAN3 to generate synthetic DR1 images…

Image and Video Processing · Electrical Eng. & Systems 2025-01-03 Sagarnil Das , Pradeep Walia

Implicit Generative Models (IGMs) such as GANs have emerged as effective data-driven models for generating samples, particularly images. In this paper, we formulate the problem of learning an IGM as minimizing the expected distance between…

Machine Learning · Computer Science 2020-06-18 Abdul Fatir Ansari , Jonathan Scarlett , Harold Soh

With the recent success of generative models in image and text, the evaluation of generative models has gained a lot of attention. Whereas most generative models are compared in terms of scalar values such as Frechet Inception Distance…

Machine Learning · Computer Science 2024-05-06 Benjamin Sykes , Loic Simon , Julien Rabin

Generative models have made immense progress in recent years, particularly in their ability to generate high quality images. However, that quality has been difficult to evaluate rigorously, with evaluation dominated by heuristic approaches…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Y. Alex Kolchinski , Sharon Zhou , Shengjia Zhao , Mitchell Gordon , Stefano Ermon

Stochastic-sampling-based Generative Neural Networks, such as Restricted Boltzmann Machines and Generative Adversarial Networks, are now used for applications such as denoising, image occlusion removal, pattern completion, and motion…

Machine Learning · Computer Science 2019-10-29 Alexander Potapov , Ian Colbert , Ken Kreutz-Delgado , Alexander Cloninger , Srinjoy Das

Conditional Generative Adversarial Networks (cGANs) are finding increasingly widespread use in many application domains. Despite outstanding progress, quantitative evaluation of such models often involves multiple distinct metrics to assess…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Terrance DeVries , Adriana Romero , Luis Pineda , Graham W. Taylor , Michal Drozdzal

Although generative adversarial networks (GANs) have shown promise in medical imaging, they have four main limitations that impeded their utility: computational cost, data requirements, reliable evaluation measures, and training complexity.…

Deep learning applications for assessing medical images are limited because the datasets are often small and imbalanced. The use of synthetic data has been proposed in the literature, but neither a robust comparison of the different methods…

Image and Video Processing · Electrical Eng. & Systems 2024-04-05 Guilherme C. Oliveira , Gustavo H. Rosa , Daniel C. G. Pedronette , João P. Papa , Himeesh Kumar , Leandro A. Passos , Dinesh Kumar

Age-Related Macular Degeneration (AMD) is an asymptomatic retinal disease which may result in loss of vision. There is limited access to high-quality relevant retinal images and poor understanding of the features defining sub-classes of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Yi-Chieh Liu , Hao-Hsiang Yang , Chao-Han Huck Yang , Jia-Hong Huang , Meng Tian , Hiromasa Morikawa , Yi-Chang James Tsai , Jesper Tegner

Novel view synthesis from a single input image is a challenging task, where the goal is to generate a new view of a scene from a desired camera pose that may be separated by a large motion. The highly uncertain nature of this synthesis task…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Jason J. Yu , Fereshteh Forghani , Konstantinos G. Derpanis , Marcus A. Brubaker

State-of-the-art text-to-image models produce high-quality images, but inference remains expensive as generation requires several sequential ODE or denoising steps. Native one-step models aim to reduce this cost by mapping noise to an image…

Although being widely adopted for evaluating generated audio signals, the Fr\'echet Audio Distance (FAD) suffers from significant limitations, including reliance on Gaussian assumptions, sensitivity to sample size, and high computational…

Sound · Computer Science 2025-03-11 Yoonjin Chung , Pilsun Eu , Junwon Lee , Keunwoo Choi , Juhan Nam , Ben Sangbae Chon

Generative models have revolutionized multiple domains, yet their application to tabular data remains underexplored. Evaluating generative models for tabular data presents unique challenges due to structural complexity, large-scale…

Machine Learning · Computer Science 2025-04-30 Dayananda Herurkar , Ahmad Ali , Andreas Dengel

Most evaluations of generative models rely on feature-distribution metrics such as FID, which operate on continuous recognition features that are explicitly trained to be invariant to appearance variations, and thus discard cues critical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Zexi Jia , Pengcheng Luo , Yijia Zhong , Jinchao Zhang , Jie Zhou

We systematically study a wide variety of generative models spanning semantically-diverse image datasets to understand and improve the feature extractors and metrics used to evaluate them. Using best practices in psychophysics, we measure…

Improving the diversity of generated results while maintaining high visual quality remains a significant challenge in image generation tasks. Fractal Generative Models (FGMs) are efficient in generating high-quality images, but their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Haowei Zhang , Yuanpei Zhao , Ji-Zhe Zhou , Mao Li

Evaluating generative models for synthetic medical imaging is crucial yet challenging, especially given the high standards of fidelity, anatomical accuracy, and safety required for clinical applications. Standard evaluation of generated…

Image and Video Processing · Electrical Eng. & Systems 2025-05-13 Yash Deo , Yan Jia , Toni Lassila , William A. P. Smith , Tom Lawton , Siyuan Kang , Alejandro F. Frangi , Ibrahim Habli

Evaluating the realism of generated images remains a fundamental challenge in generative modeling. Existing distributional metrics such as the Frechet Inception Distance (FID) and CLIP-MMD (CMMD) compare feature distributions at a semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Joé Napolitano , Pascal Nguyen

Deep generative models are becoming increasingly powerful, now generating diverse high fidelity photo-realistic samples given text prompts. Have they reached the point where models of natural images can be used for generative data…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shekoofeh Azizi , Simon Kornblith , Chitwan Saharia , Mohammad Norouzi , David J. Fleet

A retinal trait, or phenotype, summarises a specific aspect of a retinal image in a single number. This can then be used for further analyses, e.g. with statistical methods. However, reducing an aspect of a complex image to a single,…

Quantitative Methods · Quantitative Biology 2022-07-14 Justin Engelmann , Ana Villaplana-Velasco , Amos Storkey , Miguel O. Bernabeu