English
Related papers

Related papers: Importance Corrected Neural JKO Sampling

200 papers

Uncertainty quantification provides quantitative measures on the reliability of candidate solutions of ill-posed inverse problems. Due to their sequential nature, Monte Carlo sampling methods require large numbers of sampling steps for…

Geophysics · Physics 2021-04-14 Ali Siahkoohi , Felix J. Herrmann

We explore a generative machine learning-based approach for estimating multi-dimensional probability density functions (PDFs) in a target sample using a statistically independent but related control sample - a common challenge in particle…

Data Analysis, Statistics and Probability · Physics 2025-04-18 Eli Gendreau-Distler , Luc Le Pottier , Haichen Wang

Scalable sampling of molecular states in thermodynamic equilibrium is a long-standing challenge in statistical physics. Boltzmann Generators tackle this problem by pairing a generative model, capable of exact likelihood computation, with…

Machine Learning · Computer Science 2025-12-11 Danyal Rehman , Tara Akhound-Sadegh , Artem Gazizov , Yoshua Bengio , Alexander Tong

Normalizing flows can generate complex target distributions and thus show promise in many applications in Bayesian statistics as an alternative or complement to MCMC for sampling posteriors. Since no data set from the target posterior…

Machine Learning · Statistics 2021-07-19 Marylou Gabrié , Grant M. Rotskoff , Eric Vanden-Eijnden

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart

Accelerated magnetic resonance (MR) imaging attempts to reduce acquisition time by collecting data below the Nyquist rate. As an ill-posed inverse problem, many plausible solutions exist, yet the majority of deep learning approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-06-05 Jeffrey Wen , Rizwan Ahmad , Philip Schniter

We explore the ability of normalizing flow (NF) generative models to reproduce weak-lensing summary statistics when trained on a set of cosmological simulations. Our analysis focuses on how accurately NF models recover the mean, standard…

Cosmology and Nongalactic Astrophysics · Physics 2026-01-29 Joaquin Armijo , Leander Thiele , Jia Liu

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

Training generative models to sample from unnormalized density functions is an important and challenging task in machine learning. Traditional training methods often rely on the reverse Kullback-Leibler (KL) divergence due to its…

Machine Learning · Computer Science 2025-03-05 Jiajun He , Wenlin Chen , Mingtian Zhang , David Barber , José Miguel Hernández-Lobato

Unnormalized probability distributions are central to modeling complex physical systems across various scientific domains. Traditional sampling methods, such as Markov Chain Monte Carlo (MCMC), often suffer from slow convergence, critical…

Machine Learning · Computer Science 2025-10-27 Vikas Kanaujia , Vipul Arora

State inference and parameter learning in sequential models can be successfully performed with approximation techniques that maximize the evidence lower bound to the marginal log-likelihood of the data distribution. These methods may be…

Machine Learning · Computer Science 2026-03-10 Helena Calatrava , Ricardo Augusto Borsoi , Tales Imbiriba , Pau Closas

Likelihood-based deep generative models have been widely investigated for Image Anomaly Detection (IAD), particularly Normalizing Flows, yet their strict architectural invertibility needs often constrain scalability, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Liangwei Li , Lin Liu , Hanzhe Liang , Juanxiu Liu , Jing Zhang , Ruqian Hao , Xiaohui Du , Yong Liu , Pan Li

By chaining a sequence of differentiable invertible transformations, normalizing flows (NF) provide an expressive method of posterior approximation, exact density evaluation, and sampling. The trend in normalizing flow literature has been…

Machine Learning · Computer Science 2020-10-20 Robert Giaquinto , Arindam Banerjee

Density regression models allow a comprehensive understanding of data by modeling the complete conditional probability distribution. While flexible estimation approaches such as normalizing flows (NF) work particularly well in multiple…

Machine Learning · Statistics 2025-06-13 Marcel Arpogaus , Thomas Kneib , Thomas Nagler , David Rügamer

While behavior cloning with flow/diffusion policies excels at learning complex skills from demonstrations, it remains vulnerable to distributional shift, and standard RL methods struggle to fine-tune these models due to their iterative…

Machine Learning · Computer Science 2025-10-20 Mingyang Sun , Pengxiang Ding , Weinan Zhang , Donglin Wang

Obtaining samples from the posterior distribution of inverse problems with expensive forward operators is challenging especially when the unknowns involve the strongly heterogeneous Earth. To meet these challenges, we propose a…

Machine Learning · Statistics 2021-01-12 Ali Siahkoohi , Gabrio Rizzuti , Mathias Louboutin , Philipp A. Witte , Felix J. Herrmann

This paper studies the convergence properties of the inexact Jordan-Kinderlehrer-Otto (JKO) scheme and proximal-gradient algorithm in the context of Wasserstein spaces. The JKO scheme, a widely-used method for approximating solutions to…

Optimization and Control · Mathematics 2025-06-19 Simone Di Marino , Emanuele Naldi , Silvia Villa

The seminal paper of Jordan, Kinderlehrer, and Otto introduced what is now widely known as the JKO scheme, an iterative algorithmic framework for computing distributions. This scheme can be interpreted as a Wasserstein gradient flow and has…

Machine Learning · Statistics 2025-01-15 Shang Wu , Yazhen Wang

A number of distributions that arise in statistical applications can be expressed in the form of a weighted density: the product of a base density and a nonnegative weight function. Generating variates from such a distribution may be…

Methodology · Statistics 2025-03-18 Andrew M. Raim , James A. Livsey , Kyle M. Irimata

Modeling real-world distributions can often be challenging due to sample data that are subjected to perturbations, e.g., instrumentation errors, or added random noise. Since flow models are typically nonlinear algorithms, they amplify these…

Machine Learning · Computer Science 2022-10-11 Sameera Ramasinghe , Kasun Fernando , Salman Khan , Nick Barnes