English
Related papers

Related papers: Neural Generative Distributional Regression

200 papers

We study how well generative adversarial networks (GAN) learn probability distributions from finite samples by analyzing the convergence rates of these models. Our analysis is based on a new oracle inequality that decomposes the estimation…

Machine Learning · Computer Science 2022-05-26 Yunfei Yang

We link conditional generative modelling to quantile regression. We propose a suitable loss function and derive minimax convergence rates for the associated risk under smoothness assumptions imposed on the conditional distribution. To…

Statistics Theory · Mathematics 2024-09-09 Johannes Schmidt-Hieber , Petr Zamolodtchikov

Generative adversial network (GAN) is a type of generative model that maps a high-dimensional noise to samples in target distribution. However, the dimension of noise required in GAN is not well understood. Previous approaches view GAN as a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Ziran Zhu , Tongda Xu , Ling Li , Yan Wang

Generative adversarial networks (GANs) have given us a great tool to fit implicit generative models to data. Implicit distributions are ones we can sample from easily, and take derivatives of samples with respect to model parameters. These…

Machine Learning · Statistics 2017-02-28 Ferenc Huszár

Recent advances in neural variational inference have spawned a renaissance in deep latent variable models. In this paper we introduce a generic variational inference framework for generative and conditional models of text. While traditional…

Computation and Language · Computer Science 2016-06-07 Yishu Miao , Lei Yu , Phil Blunsom

Neural network-based methods for (un)conditional density estimation have recently gained substantial attention, as various neural density estimators have outperformed classical approaches in real-data experiments. Despite these empirical…

Machine Learning · Statistics 2025-10-02 Dehao Dai , Jianqing Fan , Yihong Gu , Debarghya Mukherjee

Density regression provides a flexible strategy for modeling the distribution of a response variable $Y$ given predictors $\mathbf{X}=(X_1,\ldots,X_p)$ by letting that the conditional density of $Y$ given $\mathbf{X}$ as a completely…

Statistics Theory · Mathematics 2016-01-07 Weining Shen , Subhashis Ghosal

In this paper, we propose to equip Generative Adversarial Networks with the ability to produce direct energy estimates for samples.Specifically, we propose a flexible adversarial training framework, and prove this framework not only ensures…

Machine Learning · Computer Science 2017-02-27 Zihang Dai , Amjad Almahairi , Philip Bachman , Eduard Hovy , Aaron Courville

Copulas are a powerful tool for modeling multivariate distributions as they allow to separately estimate the univariate marginal distributions and the joint dependency structure. However, known parametric copulas offer limited flexibility…

Machine Learning · Statistics 2021-11-11 Tim Janke , Mohamed Ghanmi , Florian Steinke

Diffusion models have shown remarkable performance on many generative tasks. Despite recent success, most diffusion models are restricted in that they only allow linear transformation of the data distribution. In contrast, broader family of…

Machine Learning · Computer Science 2024-06-04 Grigory Bartosh , Dmitry Vetrov , Christian A. Naesseth

The perspective of developing trustworthy AI for critical applications in science and engineering requires machine learning techniques that are capable of estimating their own uncertainty. In the context of regression, instead of estimating…

Machine Learning · Computer Science 2026-05-14 Quentin Duchemin , Guillaume Obozinski

This paper studies how well generative adversarial networks (GANs) learn probability distributions from finite samples. Our main results establish the convergence rates of GANs under a collection of integral probability metrics defined…

Machine Learning · Computer Science 2022-06-10 Jian Huang , Yuling Jiao , Zhen Li , Shiao Liu , Yang Wang , Yunfei Yang

Many engineering problems require the prediction of realization-to-realization variability or a refined description of modeled quantities. In that case, it is necessary to sample elements from unknown high-dimensional spaces with possibly…

Machine Learning · Statistics 2022-01-05 Malik Hassanaly , Andrew Glaws , Karen Stengel , Ryan N. King

We present a novel method and analysis to train generative adversarial networks (GAN) in a stable manner. As shown in recent analysis, training is often undermined by the probability distribution of the data being zero on neighborhoods of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Simon Jenni , Paolo Favaro

We propose flexible Gaussian representations for conditional cumulative distribution functions and give a concave likelihood criterion for their estimation. Optimal representations satisfy the monotonicity property of conditional cumulative…

Econometrics · Economics 2025-04-22 Richard Spady , Sami Stouli

We introduce a new generative model where samples are produced via Langevin dynamics using gradients of the data distribution estimated with score matching. Because gradients can be ill-defined and hard to estimate when the data resides on…

Machine Learning · Computer Science 2020-10-13 Yang Song , Stefano Ermon

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

Statistics Theory · Mathematics 2025-06-10 Rong Tang , Yun Yang

Flow-based generative models have recently shown impressive performance for conditional generation tasks, such as text-to-image generation. However, current methods transform a general unimodal noise distribution to a specific mode of the…

Machine Learning · Computer Science 2025-02-14 Noam Issachar , Mohammad Salama , Raanan Fattal , Sagie Benaim

Generative adversarial networks (GANs), a class of distribution-learning methods based on a two-player game between a generator and a discriminator, can generally be formulated as a minmax problem based on the variational representation of…

Machine Learning · Computer Science 2022-06-20 Jeremiah Birrell , Markos A. Katsoulakis , Luc Rey-Bellet , Wei Zhu

Regression models for supervised learning problems with a continuous target are commonly understood as models for the conditional mean of the target given predictors. This notion is simple and therefore appealing for interpretation and…

Methodology · Statistics 2018-01-09 Torsten Hothorn , Achim Zeileis