English
Related papers

Related papers: Adapting Noise to Data: Generative Flows from 1D P…

200 papers

Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these…

Machine Learning · Statistics 2022-07-13 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

The analysis of samples of random objects that do not lie in a vector space is gaining increasing attention in statistics. An important class of such object data is univariate probability measures defined on the real line. Adopting the…

Methodology · Statistics 2021-07-07 Yaqing Chen , Zhenhua Lin , Hans-Georg Müller

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

Optimization and Control · Mathematics 2024-08-20 Yifan Chen , Wuchen Li

We present theoretical convergence guarantees for ODE-based generative models, specifically flow matching. We use a pre-trained autoencoder network to map high-dimensional original inputs to a low-dimensional latent space, where a…

Machine Learning · Statistics 2024-04-30 Yuling Jiao , Yanming Lai , Yang Wang , Bokai Yan

We consider the problem of estimating the parameters of a $d$-dimensional rectified Gaussian distribution from i.i.d. samples. A rectified Gaussian distribution is defined by passing a standard Gaussian distribution through a one-layer ReLU…

Machine Learning · Computer Science 2019-09-20 Shanshan Wu , Alexandros G. Dimakis , Sujay Sanghavi

We study the asymptotic distribution of the output of a stable Linear Time-Invariant (LTI) system driven by a non-Gaussian stochastic input. Motivated by longstanding heuristics in the stochastic describing function method, we rigorously…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Yashaswini Murthy , Bassam Bamieh , R. Srikant

Density deconvolution is the task of estimating a probability density function given only noise-corrupted samples. We can fit a Gaussian mixture model to the underlying density by maximum likelihood if the noise is normally distributed, but…

Machine Learning · Statistics 2020-07-14 Tim Dockhorn , James A. Ritchie , Yaoliang Yu , Iain Murray

We propose a novel Bayesian approach to modelling nonlinear alignments of time series based on latent shared information. We apply the method to the real-world problem of finding common structure in the sensor data of wind turbines…

Machine Learning · Statistics 2018-05-24 Markus Kaiser , Clemens Otte , Thomas Runkler , Carl Henrik Ek

This paper presents a novel generative model to synthesize fluid simulations from a set of reduced parameters. A convolutional neural network is trained on a collection of discrete, parameterizable fluid simulation velocity fields. Due to…

Machine Learning · Computer Science 2019-09-05 Byungsoo Kim , Vinicius C. Azevedo , Nils Thuerey , Theodore Kim , Markus Gross , Barbara Solenthaler

Distributional (or distribution-valued) data are a new type of data arising from several sources and are considered as realizations of distributional variables. A new set of fuzzy c-means algorithms for data described by distributional…

Machine Learning · Statistics 2016-05-03 Antonio Irpino , Francisco De Carvalho , Rosanna Verde

This paper presents a novel Wasserstein distributionally robust control and state estimation algorithm for partially observable linear stochastic systems, where the probability distributions of disturbances and measurement noises are…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Minhyuk Jang , Astghik Hakobyan , Insoon Yang

Sampling from an unknown distribution, accessible only through discrete samples, is a fundamental problem at the core of generative AI. The current state-of-the-art methods follow a two-step process: first, estimating the score function…

Machine Learning · Computer Science 2026-05-20 Samuel Hurault , Matthieu Terris , Thomas Moreau , Gabriel Peyré

In inverse problems, many conditional generative models approximate the posterior measure by minimizing a distance between the joint measure and its learned approximation. While this approach also controls the distance between the posterior…

Machine Learning · Computer Science 2025-08-28 Jannis Chemseddine , Paul Hagemann , Gabriele Steidl , Christian Wald

Audio domain transfer is the process of modifying audio signals to match characteristics of a different domain, while retaining the original content. This paper investigates the potential of Gaussian Flow Bridges, an emerging approach in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-31 Eloi Moliner , Sebastian Braun , Hannes Gamper

A novel statistical method is proposed and investigated for estimating a heavy tailed density under mild smoothness assumptions. Statistical analyses of heavy-tailed distributions are susceptible to the problem of sparse information in the…

Methodology · Statistics 2022-11-18 Surya T Tokdar , Sheng Jiang , Erika L Cunningham

The Wasserstein distance received a lot of attention recently in the community of machine learning, especially for its principled way of comparing distributions. It has found numerous applications in several hard problems, such as domain…

Machine Learning · Statistics 2017-10-23 Nicolas Courty , Rémi Flamary , Mélanie Ducoffe

We propose the Wasserstein Auto-Encoder (WAE)---a new algorithm for building a generative model of the data distribution. WAE minimizes a penalized form of the Wasserstein distance between the model distribution and the target distribution,…

Machine Learning · Statistics 2019-12-06 Ilya Tolstikhin , Olivier Bousquet , Sylvain Gelly , Bernhard Schoelkopf

By building upon the recent theory that established the connection between implicit generative modeling (IGM) and optimal transport, in this study, we propose a novel parameter-free algorithm for learning the underlying distributions of…

Machine Learning · Statistics 2019-06-12 Antoine Liutkus , Umut Şimşekli , Szymon Majewski , Alain Durmus , Fabian-Robert Stöter

We suggest a simple Gaussian mixture model for data generation that complies with Feldman's long tail theory (2020). We demonstrate that a linear classifier cannot decrease the generalization error below a certain level in the proposed…

Machine Learning · Computer Science 2023-07-26 Arman Bolatov , Maxat Tezekbayev , Igor Melnykov , Artur Pak , Vassilina Nikoulina , Zhenisbek Assylbekov

Normalizing flow (NF) has gained popularity over traditional maximum likelihood based methods due to its strong capability to model complex data distributions. However, the standard approach, which maps the observed data to a normal…

Machine Learning · Computer Science 2022-11-22 Hanze Dong , Shizhe Diao , Weizhong Zhang , Tong Zhang