English
Related papers

Related papers: On the Statistical Capacity of Deep Generative Mod…

200 papers

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

In this work, we explore the theoretical properties of conditional deep generative models under the statistical framework of distribution regression where the response variable lies in a high-dimensional ambient space but concentrates…

Statistics Theory · Mathematics 2026-02-02 Shivam Kumar , Yun Yang , Lizhen Lin

Modern deep artificial neural networks have achieved great success in the domain of computer vision and beyond. However, their application to many real-world tasks is undermined by certain limitations, such as overconfident uncertainty…

Machine Learning · Computer Science 2022-05-05 Adrián Csiszárik , Beatrix Benkő , Dániel Varga

The generation of discontinuous distributions is a difficult task for most known frameworks such as generative autoencoders and generative adversarial networks. Generative non-invertible models are unable to accurately generate such…

Machine Learning · Computer Science 2021-12-20 Mariia Drozdova , Vitaliy Kinakh , Guillaume Quétant , Tobias Golling , Slava Voloshynovskiy

The presence of non-Gaussian tails is a prevalent characteristic in many financial modeling scenarios, necessitating the use of complex non-Gaussian distributions such as the generalized beta of the second kind (GB2) and the skewed…

Applications · Statistics 2025-12-10 Xing Yan , Yue Zhao , Qi Wu , Wenxuan Ma

Generative neural networks learn how to produce highly realistic images from a large, but finite number of examples - or do they simply memorise their training set? To settle this question, Kadkhodaie, Guth, Simoncelli and Mallat (ICLR '24)…

Machine Learning · Statistics 2026-05-21 Antoine Maillard , Sebastian Goldt

Diffusion-based generative models have demonstrated a capacity for perceptually impressive synthesis, but can they also be great likelihood-based models? We answer this in the affirmative, and introduce a family of diffusion-based…

Machine Learning · Computer Science 2023-04-17 Diederik P. Kingma , Tim Salimans , Ben Poole , Jonathan Ho

The goal of this paper is to deal with a data scarcity scenario where deep learning techniques use to fail. We compare the use of two well established techniques, Restricted Boltzmann Machines and Variational Auto-encoders, as generative…

Machine Learning · Computer Science 2020-03-02 Juan Maroñas , Roberto Paredes , Daniel Ramos

Heavy-tailed distributions naturally occur in many real life problems. Unfortunately, it is typically not possible to compute inference in closed-form in graphical models which involve such heavy-tailed distributions. In this work, we…

Machine Learning · Computer Science 2011-03-22 Danny Bickson , Carlos Guestrin

With the recent development of new geometric and angular-radial frameworks for multivariate extremes, reliably simulating from angular variables in moderate-to-high dimensions is of increasing importance. Empirical approaches have the…

Machine Learning · Statistics 2026-01-01 Jakob Benjamin Wessel , Callum J. R. Murphy-Barltrop , Emma S. Simpson

Visualizing high-dimensional datasets through a generalized embedding has been a challenge for a long time. Several methods have shown up for the same, but still, they have not been able to generate a generalized embedding, which not only…

Machine Learning · Computer Science 2024-10-21 Chayan Maitra , Rajat K. De

Generative models in deep learning allow for sampling probability distributions that approximate data distributions. We propose using generative models for making approximate statistical predictions in the string theory landscape. For vacua…

High Energy Physics - Theory · Physics 2020-06-24 James Halverson , Cody Long

Understanding the impact of data structure on the computational tractability of learning is a key challenge for the theory of neural networks. Many theoretical works do not explicitly model training data, or assume that inputs are drawn…

Machine Learning · Statistics 2022-05-23 Sebastian Goldt , Bruno Loureiro , Galen Reeves , Florent Krzakala , Marc Mézard , Lenka Zdeborová

Weighted graphs are ubiquitous throughout biology, chemistry, and the social sciences, motivating the development of generative models for abstract weighted graph data using deep neural networks. However, most current deep generative models…

Machine Learning · Computer Science 2025-08-01 Richard Williams , Eric Nalisnick , Andrew Holbrook

Deep generative models are universal tools for learning data distributions on high dimensional data spaces via a mapping to lower dimensional latent spaces. We provide a study of latent space geometries and extend and build upon previous…

Machine Learning · Computer Science 2019-02-07 Max F. Frenzel , Bogdan Teleaga , Asahi Ushio

Deep generative models are proficient in generating realistic data but struggle with producing rare samples in low density regions due to their scarcity of training datasets and the mode collapse problem. While recent methods aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Subeen Lee , Jiyeon Han , Soyeon Kim , Jaesik Choi

This study presents a novel generative modeling approach to rainfall-runoff modeling, focusing on the synthesis of realistic daily catchment runoff time series in response to catchment-averaged climate forcing. Unlike traditional…

Geophysics · Physics 2024-09-11 Yang Yang , Ting Fong May Chui

The diffusion probabilistic generative models are widely used to generate high-quality data. Though they can synthetic data that does not exist in the training set, the rationale behind such generalization is still unexplored. In this…

Machine Learning · Computer Science 2023-05-25 Mingyang Yi , Jiacheng Sun , Zhenguo Li

We introduce generative models for accelerating simulations of complex systems through learning and evolving their effective dynamics. In the proposed Generative Learning of Effective Dynamics (G-LED), instances of high dimensional data are…

Machine Learning · Computer Science 2024-02-28 Han Gao , Sebastian Kaltenbach , Petros Koumoutsakos

Decision Trees and Random Forests are among the most widely used machine learning models, and often achieve state-of-the-art performance in tabular, domain-agnostic datasets. Nonetheless, being primarily discriminative models they lack…

Machine Learning · Statistics 2020-07-14 Alvaro H. C. Correia , Robert Peharz , Cassio de Campos