English
Related papers

Related papers: Enhanced Generative Model Evaluation with Clipped …

200 papers

Collecting and annotating datasets for pixel-level semantic segmentation tasks are highly labor-intensive. Data augmentation provides a viable solution by enhancing model generalization without additional real-world data collection.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Huy Che , Dinh-Duy Phan , Duc-Khai Lam

Recent work on interpretability has focused on concept-based explanations, where deep learning models are explained in terms of high-level units of information, referred to as concepts. Concept learning models, however, have been shown to…

Machine Learning · Computer Science 2023-10-02 Mateo Espinosa Zarlenga , Pietro Barbiero , Zohreh Shams , Dmitry Kazhdan , Umang Bhatt , Adrian Weller , Mateja Jamnik

Deep generative models have achieved great success in producing high-quality samples, making them a central tool across machine learning applications. Beyond sample quality, an important yet less systematically studied question is whether…

Machine Learning · Computer Science 2026-02-17 Farzan Farnia , Mohammad Jalali , Azim Ospanov

Despite the unprecedented progress in the field of 3D generation, current systems still often fail to produce high-quality 3D assets that are visually appealing and geometrically and semantically consistent across multiple viewpoints. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shivam Duggal , Yushi Hu , Oscar Michel , Aniruddha Kembhavi , William T. Freeman , Noah A. Smith , Ranjay Krishna , Antonio Torralba , Ali Farhadi , Wei-Chiu Ma

Despite remarkable progress, image generation is far from solved. The dominant metric, FID, conflates sample fidelity with mode coverage and is close to being saturated. Yet a model can still exhibit mode collapse while achieving a low FID,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Mehdi Esmaeilzadeh , Alexia Jolicoeur-Martineau , Chirag Vashist , Ke Li

Denoising Probabilistic Models (DPMs) represent an emerging domain of generative models that excel in generating diverse and high-quality images. However, most current training methods for DPMs often neglect the correlation between…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Viet Nguyen , Giang Vu , Tung Nguyen Thanh , Khoat Than , Toan Tran

We propose a likelihood-free method for comparing two distributions given samples from each, with the goal of assessing the quality of generative models. The proposed approach, PQMass, provides a statistically rigorous method for assessing…

In this work, we present some recommendations on the evaluation of state-of-the-art generative models for constrained generation tasks. The progress on generative models has been rapid in recent years. These large-scale models have had…

Human-Computer Interaction · Computer Science 2022-12-02 Vikas Raunak , Matt Post , Arul Menezes

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

How should we evaluate the quality of generative models? Many existing metrics focus on a model's producibility, i.e. the quality and breadth of outputs it can generate. However, the actual value from using a generative model stems not just…

Machine Learning · Computer Science 2025-11-13 Keyon Vafa , Sarah Bentley , Jon Kleinberg , Sendhil Mullainathan

Generative methods now produce outputs nearly indistinguishable from real data but often fail to fully capture the data distribution. Unlike quality issues, diversity limitations in generative models are hard to detect visually, requiring…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Mischa Dombrowski , Weitong Zhang , Sarah Cechnicka , Hadrien Reynaud , Bernhard Kainz

Deep generative models have made much progress in improving training stability and quality of generated data. Recently there has been increased interest in the fairness of deep-generated data. Fairness is important in many applications,…

Machine Learning · Computer Science 2021-07-19 Christopher T. H Teo , Ngai-Man Cheung

Citation granularity - whether to cite individual sentences, paragraphs, or documents - is a critical design choice in attributed generation. While fine-grained citations are often preferred for precise human verification, their impact on…

Computation and Language · Computer Science 2026-04-06 Hexuan Wang , Jingyu Zhang , Benjamin Van Durme , Daniel Khashabi

Recently, several methods have leveraged deep generative modeling to produce example-based explanations of image classifiers. Despite producing visually stunning results, these methods are largely disconnected from classical explainability…

Machine Learning · Computer Science 2025-09-11 Philipp Vaeth , Alexander M. Fruehwald , Benjamin Paassen , Magda Gregorova

Several interesting generative learning algorithms involve a complex probability distribution over many random variables, involving intractable normalization constants or latent variable normalization. Some of them may even not have an…

Machine Learning · Computer Science 2014-05-13 Yoshua Bengio , Li Yao , Kyunghyun Cho

Fairness has become an essential problem in many domains of Machine Learning (ML), such as classification, natural language processing, and Generative Adversarial Networks (GANs). In this research effort, we study the unfairness of GANs. We…

Machine Learning · Computer Science 2022-07-22 Patrik Joslin Kenfack , Kamil Sabbagh , Adín Ramírez Rivera , Adil Khan

Generative models have been found effective for data synthesis due to their ability to capture complex underlying data distributions. The quality of generated data from these models is commonly evaluated by visual inspection for image…

Machine Learning · Computer Science 2022-10-18 Emily Muller , Xu Zheng , Jer Hayes

Recent advances in text-to-image (T2I) generation have achieved remarkable visual outcomes through large-scale rectified flow models. However, how these models behave under long prompts remains underexplored. Long prompts encode rich…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Bo-Kai Ruan , Teng-Fang Hsiao , Ling Lo , Yi-Lun Wu , Hong-Han Shuai

Diffusion models have recently driven significant breakthroughs in generative modeling. While state-of-the-art models produce high-quality samples on average, individual samples can still be low quality. Detecting such samples without human…

Machine Learning · Computer Science 2025-06-13 Metod Jazbec , Eliot Wong-Toi , Guoxuan Xia , Dan Zhang , Eric Nalisnick , Stephan Mandt

Generative models, in particular generative adversarial networks (GANs), have received significant attention recently. A number of GAN variants have been proposed and have been utilized in many applications. Despite large strides in terms…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Ali Borji