English
Related papers

Related papers: On the Statistical Capacity of Deep Generative Mod…

200 papers

Generating realistic vehicle speed trajectories is a crucial component in evaluating vehicle fuel economy and in predictive control of self-driving cars. Traditional generative models rely on Markov chain methods and can produce accurate…

Machine Learning · Computer Science 2021-12-17 Farnaz Behnia , Dominik Karbowski , Vadim Sokolov

Beyond their origin in modeling many-body quantum systems, tensor networks have emerged as a promising class of models for solving machine learning problems, notably in unsupervised generative learning. While possessing many desirable…

Machine Learning · Computer Science 2024-07-26 Alex Meiburg , Jing Chen , Jacob Miller , Raphaëlle Tihon , Guillaume Rabusseau , Alejandro Perdomo-Ortiz

Generative networks have shown remarkable success in learning complex data distributions, particularly in generating high-dimensional data from lower-dimensional inputs. While this capability is well-documented empirically, its theoretical…

Machine Learning · Computer Science 2025-04-02 Kevin Wang , Hongqian Niu , Yixin Wang , Didong Li

Many generative models synthesize data by transforming a standard Gaussian random variable using a deterministic neural network. Among these models are the Variational Autoencoders and the Generative Adversarial Networks. In this work, we…

Machine Learning · Statistics 2022-10-13 Antoine Salmona , Valentin de Bortoli , Julie Delon , Agnès Desolneux

Training generative models that capture rich semantics of the data and interpreting the latent representations encoded by such models are very important problems in un-/self-supervised learning. In this work, we provide a simple algorithm…

Machine Learning · Computer Science 2024-09-02 Samuel C. Hoffman , Payel Das , Karthikeyan Shanmugam , Kahini Wadhawan , Prasanna Sattigeri

While deep generative models~(DGMs) have demonstrated remarkable success in capturing complex data distributions, they consistently fail to learn constraints that encode domain knowledge and thus require constraint integration. Existing…

Machine Learning · Computer Science 2025-02-13 Ruoyan Li , Dipti Ranjan Sahu , Guy Van den Broeck , Zhe Zeng

We introduce a new generative model where samples are produced via Langevin dynamics using gradients of the data distribution estimated with score matching. Because gradients can be ill-defined and hard to estimate when the data resides on…

Machine Learning · Computer Science 2020-10-13 Yang Song , Stefano Ermon

Sampling tasks have been successful in establishing quantum advantages both in theory and experiments. This has fueled the use of quantum computers for generative modeling to create samples following the probability distribution underlying…

Quantum Physics · Physics 2026-01-01 Sabrina Herbst , Ivona Brandić , Adrián Pérez-Salinas

Recent research has shown that generative models with highly disentangled representations fail to generalise to unseen combination of generative factor values. These findings contradict earlier research which showed improved performance in…

Machine Learning · Computer Science 2024-06-17 Milton L. Montero , Jeffrey S. Bowers , Rui Ponte Costa , Casimir J. H. Ludwig , Gaurav Malhotra

Generative models aim to learn the distribution of observed data by generating new instances. With the advent of neural networks, deep generative models, including variational autoencoders (VAEs), generative adversarial networks (GANs), and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zifan Shi , Sida Peng , Yinghao Xu , Andreas Geiger , Yiyi Liao , Yujun Shen

Training energy-based probabilistic models is confronted with apparently intractable sums, whose Monte Carlo estimation requires sampling from the estimated probability distribution in the inner loop of training. This can be approximately…

Machine Learning · Computer Science 2016-06-13 Taesup Kim , Yoshua Bengio

Humans excel at discovering regular structures from limited samples and applying inferred rules to novel settings. We investigate whether modern generative models can similarly learn underlying rules from finite samples and perform…

Machine Learning · Computer Science 2024-11-13 Binxu Wang , Jiaqi Shang , Haim Sompolinsky

Latent representations are the essence of deep generative models and determine their usefulness and power. For latent representations to be useful as generative concept representations, their latent space must support latent space…

Machine Learning · Computer Science 2019-01-01 Daniel T. Chang

Generative models using neural network have opened a door to large-scale studies for various application domains, especially for studies that suffer from lack of real samples to obtain statistically robust inference. Typically, these…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Seong Jae Hwang , Zirui Tao , Won Hwa Kim , Vikas Singh

Unsupervised learning of generative models has seen tremendous progress over recent years, in particular due to generative adversarial networks (GANs), variational autoencoders, and flow-based models. GANs have dramatically improved sample…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Thomas Lucas , Konstantin Shmelkov , Karteek Alahari , Cordelia Schmid , Jakob Verbeek

Deep Generative Models (DGMs) have been shown to be powerful tools for generating tabular data, as they have been increasingly able to capture the complex distributions that characterize them. However, to generate realistic synthetic data,…

Machine Learning · Computer Science 2024-02-08 Mihaela Cătălina Stoian , Salijona Dyrmishi , Maxime Cordy , Thomas Lukasiewicz , Eleonora Giunchiglia

Implicit generative models have the capability to learn arbitrary complex data distributions. On the downside, training requires telling apart real data from artificially-generated ones using adversarial discriminators, leading to unstable…

Machine Learning · Computer Science 2024-02-27 José Manuel de Frutos , Pablo M. Olmos , Manuel A. Vázquez , Joaquín Míguez

When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological…

Geophysics · Physics 2021-04-28 Jorge Lopez-Alvis , Eric Laloy , Frédéric Nguyen , Thomas Hermans

Variable selection for high-dimensional, highly correlated data has long been a challenging problem, often yielding unstable and unreliable models. We propose a resample-aggregate framework that exploits diffusion models' ability to…

Methodology · Statistics 2025-08-20 Minjie Wang , Xiaotong Shen , Wei Pan

In recent years there has been increased interest in understanding the interplay between deep generative models (DGMs) and the manifold hypothesis. Research in this area focuses on understanding the reasons why commonly-used DGMs succeed or…

Machine Learning · Computer Science 2024-09-27 Gabriel Loaiza-Ganem , Brendan Leigh Ross , Rasa Hosseinzadeh , Anthony L. Caterini , Jesse C. Cresswell