English
Related papers

Related papers: Statistical guarantees for generative models witho…

200 papers

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

Statistics Theory · Mathematics 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

By linking conceptual theories with observed data, generative models can support reasoning in complex situations. They have come to play a central role both within and beyond statistics, providing the basis for power analysis in molecular…

Methodology · Statistics 2022-08-15 Kris Sankaran , Susan P. Holmes

Many data-driven decision problems are formulated using a nominal distribution estimated from historical data, while performance is ultimately determined by a deployment distribution that may be shifted, context-dependent, partially…

Machine Learning · Computer Science 2026-04-07 Xiuyuan Cheng , Yunqin Zhu , Yao Xie

Generative modeling is typically framed as learning mapping rules, but from an observer's perspective without access to these rules, the task becomes disentangling the geometric support from the probability distribution. We propose that…

Machine Learning · Statistics 2025-12-04 Rui Tong

Quantum generative modeling is a growing area of interest for industry-relevant applications. With the field still in its infancy, there are many competing techniques. This work is an attempt to systematically compare a broad range of these…

In recent years fully-parametric fast simulation methods based on generative models have been proposed for a variety of high-energy physics detectors. By their nature, the quality of data-driven models degrades in the regions of the phase…

Machine Learning · Computer Science 2023-03-03 Lucio Anderlini , Constantine Chimpoesh , Nikita Kazeev , Agata Shishigina

We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high-dimensional linear models, where the dimension $p$ can grow exponentially fast with the sample size $n$. Our method combines the…

Machine Learning · Statistics 2015-03-19 Tianqi Zhao , Mladen Kolar , Han Liu

This work presents the first statistical performance guarantees for group-invariant generative models. Many real data, such as images and molecules, are invariant to certain group symmetries, which can be taken advantage of to learn more…

Machine Learning · Statistics 2025-03-12 Ziyu Chen , Markos A. Katsoulakis , Luc Rey-Bellet , Wei Zhu

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Generative AI has achieved remarkable empirical success, but from the perspective of statistics it often remains opaque: its predictions may be accurate, yet the underlying mechanism is difficult to interpret, analyze, and trust. This book…

Machine Learning · Statistics 2026-03-11 Shinto Eguchi

The goal of generative machine learning is to model the probability distribution underlying a given data set. This probability distribution helps to characterize the generation process of the data samples. While classical generative machine…

Quantum Physics · Physics 2021-11-29 Christa Zoufal

Generative methods (Gen-AI) are reviewed with a particular goal of solving tasks in machine learning and Bayesian inference. Generative models require one to simulate a large training dataset and to use deep neural networks to solve a…

Computation · Statistics 2025-05-20 Maria Nareklishvili , Nick Polson , Vadim Sokolov

Generative models based on diffusion have become the state of the art in the last few years, notably for image generation. Here, we analyse them in the high-dimensional limit, where data are formed by a very large number of variables. We…

Disordered Systems and Neural Networks · Physics 2023-10-31 Giulio Biroli , Marc Mézard

Despite achieving impressive performance, state-of-the-art classifiers remain highly vulnerable to small, imperceptible, adversarial perturbations. This vulnerability has proven empirically to be very intricate to address. In this paper, we…

Machine Learning · Computer Science 2018-12-03 Alhussein Fawzi , Hamza Fawzi , Omar Fawzi

This paper is concerned with the sample efficiency of reinforcement learning, assuming access to a generative model (or simulator). We first consider $\gamma$-discounted infinite-horizon Markov decision processes (MDPs) with state space…

Machine Learning · Computer Science 2025-03-18 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

Diffusion models have recently driven significant breakthroughs in generative modeling. While state-of-the-art models produce high-quality samples on average, individual samples can still be low quality. Detecting such samples without human…

Machine Learning · Computer Science 2025-06-13 Metod Jazbec , Eliot Wong-Toi , Guoxuan Xia , Dan Zhang , Eric Nalisnick , Stephan Mandt

Generative models learn the distribution of data from a sample dataset and can then generate new data instances. Recent advances in deep learning has brought forth improvements in generative model architectures, and some state-of-the-art…

Cryptography and Security · Computer Science 2021-07-30 Luke A. Bauer , Vincent Bindschaedler

We propose a new probabilistic framework that allows mobile robots to autonomously learn deep, generative models of their environments that span multiple levels of abstraction. Unlike traditional approaches that combine engineered models…

Robotics · Computer Science 2018-01-01 Andrzej Pronobis , Rajesh P. N. Rao

Measurements of quantum systems can be used to generate classical data that is truly unpredictable for every observer. However, this true randomness needs to be discriminated from randomness due to ignorance or lack of control of the…

Quantum Physics · Physics 2017-06-14 Felix Bischof , Hermann Kampermann , Dagmar Bruß

The spectacular success of deep generative models calls for quantitative tools to measure their statistical performance. Divergence frontiers have recently been proposed as an evaluation framework for generative models, due to their ability…

Machine Learning · Statistics 2021-12-14 Lang Liu , Krishna Pillutla , Sean Welleck , Sewoong Oh , Yejin Choi , Zaid Harchaoui