English
Related papers

Related papers: A Good Score Does not Lead to A Good Generative Mo…

200 papers

Score-based generative models (SGMs) aim at estimating a target data distribution by learning score functions using only noise-perturbed samples from the target.Recent literature has focused extensively on assessing the error between the…

Statistics Theory · Mathematics 2025-01-28 Stanislas Strasman , Antonio Ocello , Claire Boyer , Sylvain Le Corff , Vincent Lemaire

Most existing generative models are limited to learning a single probability distribution from the training data and cannot generalize to novel distributions for unseen data. An architecture that can generate samples from both trained…

Machine Learning · Computer Science 2024-10-16 Xinyu Liao , Aoyang Qin , Jacob Seidman , Junqi Wang , Wei Wang , Paris Perdikaris

Score-based graph generative models (SGGMs) have proven effective in critical applications such as drug discovery and protein synthesis. However, their theoretical behavior, particularly regarding convergence, remains underexplored. Unlike…

Machine Learning · Computer Science 2025-08-21 Junwei Su , Chuan Wu

A longstanding problem in machine learning is to find unsupervised methods that can learn the statistical structure of high dimensional signals. In recent years, GANs have gained much attention as a possible solution to the problem, and in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Eitan Richardson , Yair Weiss

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

In practical compressed sensing (CS), the obtained measurements typically necessitate quantization to a limited number of bits prior to transmission or storage. This nonlinear quantization process poses significant recovery challenges,…

Signal Processing · Electrical Eng. & Systems 2024-01-09 Xiangming Meng , Yoshiyuki Kabashima

Deep generative models have shown tremendous capability in data density estimation and data generation from finite samples. While these models have shown impressive performance by learning correlations among features in the data, some…

Machine Learning · Computer Science 2024-05-24 Aneesh Komanduri , Xintao Wu , Yongkai Wu , Feng Chen

We establish minimax convergence rates for score-based generative models (SGMs) under the $1$-Wasserstein distance. Assuming the target density $p^\star$ lies in a nonparametric $\beta$-smooth H\"older class with either compact support or…

Statistics Theory · Mathematics 2025-07-08 Arthur Stéphanovitch , Eddie Aamari , Clément Levrard

Generative diffusion models synthesize new samples by reversing a diffusive process that converts a given data set to generic noise. This is accomplished by training a neural network to match the gradient of the log of the probability…

Machine Learning · Computer Science 2023-10-11 Akhil Premkumar

Deep generative models are powerful tools that have produced impressive results in recent years. These advances have been for the most part empirically driven, making it essential that we use high quality evaluation metrics. In this paper,…

Machine Learning · Statistics 2018-06-22 Shane Barratt , Rishi Sharma

Score-based diffusion modeling is a generative machine learning algorithm that can be used to sample from complex distributions. They achieve this by learning a score function, i.e., the gradient of the log-probability density of the data,…

Machine Learning · Computer Science 2025-12-17 Dibyajyoti Chakraborty , Haiwen Guan , Jason Stock , Troy Arcomano , Guido Cervone , Romit Maulik

While score based generative models, or diffusion models, have found success in image synthesis, they are often coupled with text data or image label to be able to manipulate and conditionally generate images. Even though manipulation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Sandesh Ghimire , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

In image generation, generative models can be evaluated naturally by visually inspecting model outputs. However, this is not always the case for graph generative models (GGMs), making their evaluation challenging. Currently, the standard…

Machine Learning · Computer Science 2022-04-29 Rylee Thompson , Boris Knyazev , Elahe Ghalebi , Jungtaek Kim , Graham W. Taylor

Implicit generative modeling (IGM) aims to produce samples of synthetic data matching the characteristics of a target data distribution. Recent work (e.g. score-matching networks, diffusion models) has approached the IGM problem from the…

Machine Learning · Computer Science 2026-05-21 Romann M. Weber

Generative models are invaluable in many fields of science because of their ability to capture high-dimensional and complicated distributions, such as photo-realistic images, protein structures, and connectomes. How do we evaluate the…

Diffusion models generate high-quality synthetic data. They operate by defining a continuous-time forward process which gradually adds Gaussian noise to data until fully corrupted. The corresponding reverse process progressively "denoises"…

Generative models are typically trained on grid-like data such as images. As a result, the size of these models usually scales directly with the underlying grid resolution. In this paper, we abandon discretized grids and instead…

Machine Learning · Computer Science 2022-02-18 Emilien Dupont , Yee Whye Teh , Arnaud Doucet

Score-based models generate samples by mapping noise to data (and vice versa) via a high-dimensional diffusion process. We question whether it is necessary to run this entire process at high dimensionality and incur all the inconveniences…

Machine Learning · Computer Science 2023-02-28 Bowen Jing , Gabriele Corso , Renato Berlinghieri , Tommi Jaakkola

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their sampling process is slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hengyuan Ma , Xiatian Zhu , Jianfeng Feng , Li Zhang

Diffusion models now generate high-quality, diverse samples, with an increasing focus on more powerful models. Although ensembling is a well-known way to improve supervised models, its application to unconditional score-based diffusion…

Machine Learning · Computer Science 2026-01-22 Raphaël Razafindralambo , Rémy Sun , Frédéric Precioso , Damien Garreau , Pierre-Alexandre Mattei