English
Related papers

Related papers: Manifold-Aware Perturbations for Constrained Gener…

200 papers

Normalizing Flows explicitly maximize a full-dimensional likelihood on the training data. However, real data is typically only supported on a lower-dimensional manifold leading the model to expend significant compute on modeling noise.…

Machine Learning · Computer Science 2024-06-28 Peter Sorrenson , Felix Draxler , Armand Rousselot , Sander Hummerich , Lea Zimmermann , Ullrich Köthe

The modeling of probability distributions, specifically generative modeling and density estimation, has become an immensely popular subject in recent years by virtue of its outstanding performance on sophisticated data such as images and…

Machine Learning · Statistics 2023-01-02 Hongkang Yang

We consider a class of conditional forward-backward diffusion models for conditional generative modeling, that is, generating new data given a covariate (or control variable). To formally study the theoretical properties of these…

Statistics Theory · Mathematics 2024-10-01 Rong Tang , Lizhen Lin , Yun Yang

In recent years, Generative Adversarial Networks (GANs) have shown substantial progress in modeling complex distributions of data. These networks have received tremendous attention since they can generate implicit probabilistic models that…

Signal Processing · Electrical Eng. & Systems 2018-10-25 Mehdi Ahmadi , Timothy Nest , Mostafa Abdelnaim , Thanh-Dung Le

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of…

Instrumentation and Methods for Astrophysics · Physics 2025-02-11 Gabriel Missael Barco , Alexandre Adam , Connor Stone , Yashar Hezaveh , Laurence Perreault-Levasseur

Humans excel at discovering regular structures from limited samples and applying inferred rules to novel settings. We investigate whether modern generative models can similarly learn underlying rules from finite samples and perform…

Machine Learning · Computer Science 2024-11-13 Binxu Wang , Jiaqi Shang , Haim Sompolinsky

Despite the remarkable success of generative adversarial networks, their performance seems less impressive for diverse training sets, requiring learning of discontinuous mapping functions. Though multi-mode prior or multi-generator models…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Jogendra Nath Kundu , Maharshi Gor , Dakshit Agrawal , R. Venkatesh Babu

Many promising applications of supervised machine learning face hurdles in the acquisition of labeled data in sufficient quantity and quality, creating an expensive bottleneck. To overcome such limitations, techniques that do not depend on…

Machine Learning · Computer Science 2023-03-14 Benedikt Boecking , Nicholas Roberts , Willie Neiswanger , Stefano Ermon , Frederic Sala , Artur Dubrawski

Recent deep generative models are able to provide photo-realistic images as well as visual or textual content embeddings useful to address various tasks of computer vision and natural language processing. Their usefulness is nevertheless…

Machine Learning · Computer Science 2020-01-29 Antoine Plumerault , Hervé Le Borgne , Céline Hudelot

The predictive advantage of combining several different predictive models is widely accepted. Particularly in time series forecasting problems, this combination is often dynamic to cope with potential non-stationary sources of variation…

Machine Learning · Statistics 2021-04-06 Vitor Cerqueira , Luis Torgo , Carlos Soares , Albert Bifet

Recent research has shown that generative models with highly disentangled representations fail to generalise to unseen combination of generative factor values. These findings contradict earlier research which showed improved performance in…

Machine Learning · Computer Science 2024-06-17 Milton L. Montero , Jeffrey S. Bowers , Rui Ponte Costa , Casimir J. H. Ludwig , Gaurav Malhotra

Recently, generative machine-learning models have gained popularity in physics, driven by the goal of improving the efficiency of Markov chain Monte Carlo techniques and of exploring their potential in capturing experimental data…

Statistical Mechanics · Physics 2021-09-03 Japneet Singh , Vipul Arora , Vinay Gupta , Mathias S. Scheurer

Different encodings of datapoints in the latent space of latent-vector generative models may result in more or less effective and disentangled characterizations of the different explanatory factors of variation behind the data. Many works…

Machine Learning · Computer Science 2022-07-15 Andrea Asperti , Valerio Tonelli

High-quality power flow datasets are essential for training machine learning models in power systems. However, security and privacy concerns restrict access to real-world data, making statistically accurate and physically consistent…

Machine Learning · Computer Science 2025-08-26 Milad Hoseinpour , Vladimir Dvorkin

Many generative models have to combat $\textit{missing modes}$. The conventional wisdom to this end is by reducing through training a statistical distance (such as $f$-divergence) between the generated distribution and provided data…

Machine Learning · Statistics 2019-10-28 Peilin Zhong , Yuchen Mo , Chang Xiao , Pengyu Chen , Changxi Zheng

Generating diverse yet specific data is the goal of the generative adversarial network (GAN), but it suffers from the problem of mode collapse. We introduce the concept of normalized diversity which force the model to preserve the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Shaohui Liu , Xiao Zhang , Jianqiao Wangni , Jianbo Shi

Manifold-learning techniques are routinely used in mining complex spatiotemporal data to extract useful, parsimonious data representations/parametrizations; these are, in turn, useful in nonlinear model identification tasks. We focus here…

While working within the spatial domain can pose problems associated with ill-conditioned scores caused by power-law decay, recent advances in diffusion-based generative models have shown that transitioning to the wavelet domain offers a…

Artificial Intelligence · Computer Science 2024-11-15 Xiongye Xiao , Shixuan Li , Luzhe Huang , Gengshuo Liu , Trung-Kien Nguyen , Yi Huang , Di Chang , Mykel J. Kochenderfer , Paul Bogdan

Generative models have emerged as powerful priors for solving inverse problems. These models typically represent a class of natural signals using a single fixed complexity or dimensionality. This can be limiting: depending on the problem, a…

Machine Learning · Computer Science 2026-03-11 Sean Gunn , Jorio Cocola , Oliver De Candido , Vaggos Chatziafratis , Paul Hand

Diffusion models have had a profound impact on many application areas, including those where data are intrinsically infinite-dimensional, such as images or time series. The standard approach is first to discretize and then to apply…

Machine Learning · Statistics 2025-06-09 Jakiw Pidstrigach , Youssef Marzouk , Sebastian Reich , Sven Wang