English
Related papers

Related papers: Path-Gradient Estimators for Continuous Normalizin…

200 papers

We develop a scalable class of models for latent variable estimation using composite Gaussian processes, with a focus on derivative Gaussian processes. We jointly model multiple data sources as outputs to improve the accuracy of latent…

Normalizing flow (NF) has gained popularity over traditional maximum likelihood based methods due to its strong capability to model complex data distributions. However, the standard approach, which maps the observed data to a normal…

Machine Learning · Computer Science 2022-11-22 Hanze Dong , Shizhe Diao , Weizhong Zhang , Tong Zhang

Parametric estimation for diffusion processes is considered for high frequency observations over a fixed time interval. The processes solve stochastic differential equations with an unknown parameter in the diffusion coefficient. We find…

Methodology · Statistics 2017-04-03 Nina Munkholt Jakobsen , Michael Sørensen

We introduce an ordinary differential equation (ODE) based deep generative method for learning conditional distributions, named Conditional F\"ollmer Flow. Starting from a standard Gaussian distribution, the proposed flow could approximate…

Machine Learning · Statistics 2025-10-14 Jinyuan Chang , Zhao Ding , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang

In this paper, we introduce a class of improved estimators for the mean parameter matrix of a multivariate normal distribution with an unknown variance-covariance matrix. In particular, the main results of [D.Ch\'etelat and M. T.…

Statistics Theory · Mathematics 2024-06-25 Arash A. Foroushani , Severien Nkurunziza

Normalizing Flows are generative models which produce tractable distributions where both sampling and density evaluation can be efficient and exact. The goal of this survey article is to give a coherent and comprehensive review of the…

Machine Learning · Statistics 2020-06-09 Ivan Kobyzev , Simon J. D. Prince , Marcus A. Brubaker

We propose a simple and general variant of the standard reparameterized gradient estimator for the variational evidence lower bound. Specifically, we remove a part of the total derivative with respect to the variational parameters that…

Machine Learning · Statistics 2017-05-30 Geoffrey Roeder , Yuhuai Wu , David Duvenaud

Reinforcement learning methods for robotics are increasingly successful due to the constant development of better policy gradient techniques. A precise (low variance) and accurate (low bias) gradient estimator is crucial to face…

Machine Learning · Computer Science 2022-03-09 Joao Carvalho , Jan Peters

The Gaussian process (GP) regression model is a widely employed surrogate modeling technique for computer experiments, offering precise predictions and statistical inference for the computer simulators that generate experimental data.…

Methodology · Statistics 2024-04-02 Lulu Kang , Yuanxing Cheng , Yiwei Wang , Chun Liu

In many applications we seek to maximize an expectation with respect to a distribution over discrete variables. Estimating gradients of such objectives with respect to the distribution parameters is a challenging problem. We analyze…

Machine Learning · Statistics 2019-06-18 Evgeny Andriyash , Arash Vahdat , Bill Macready

Flow matching has emerged as a powerful generative modeling approach with flexible choices of source distribution. While Gaussian distributions are commonly used, the potential for better alternatives in high-dimensional data generation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Junho Lee , Kwanseok Kim , Joonseok Lee

Stochastic coordinate descent algorithms are efficient methods in which each iterate is obtained by fixing most coordinates at their values from the current iteration, and approximately minimizing the objective with respect to the remaining…

Machine Learning · Statistics 2025-04-02 Eméric Gbaguidi

Normalizing flows are exact-likelihood generative neural networks which approximately transform samples from a simple prior distribution to samples of the probability distribution of interest. Recent work showed that such generative models…

Machine Learning · Statistics 2020-10-27 Jonas Köhler , Leon Klein , Frank Noé

Variational flows allow practitioners to learn complex continuous distributions, but approximating discrete distributions remains a challenge. Current methodologies typically embed the discrete target in a continuous space - usually via…

Computation · Statistics 2024-02-27 Gian Carlo Diluvi , Benjamin Bloem-Reddy , Trevor Campbell

A new approach of obtaining stratified random samples from statistically dependent random variables is described. The proposed method can be used to obtain samples from the input space of a computer forward model in estimating expectations…

Methodology · Statistics 2019-11-25 Anirban Mondal , Abhijit Mandal

Any continuous conditional distribution of $Y$ given $X$ can be generated from a transform of a known noise distribution $U$ such as the uniform or normal distribution via $Y = g(X, U)$. This paper provides an estimator of such a generative…

Methodology · Statistics 2026-05-05 Jinhang Chai , Jianqing Fan , Yihong Gu

A method to perform unfolding with Gaussian processes (GPs) is presented. Using Bayesian regression, we define an estimator for the underlying truth distribution as the mode of the posterior. We show that in the case where the bin contents…

Data Analysis, Statistics and Probability · Physics 2018-11-07 Adam Bozson , Glen Cowan , Francesco Spanò

A new class of integro-partial differential equation models is derived for the prediction of granular flow dynamics. These models are obtained using a novel limiting averaging method (inspired by techniques employed in the derivation of…

Chaotic Dynamics · Physics 2015-06-26 Denis Blackmore , Roman Samulyak , Anthony Rosato

The purpose of this work is mostly expository and aims to elucidate the Jordan-Kinderlehrer-Otto (JKO) scheme for uncertainty propagation, and a variant, the Laugesen-Mehta-Meyn-Raginsky (LMMR) scheme for filtering. We point out that these…

Optimization and Control · Mathematics 2017-10-03 Abhishek Halder , Tryphon T. Georgiou

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo