English
Related papers

Related papers: Normalizing Flow Regression for Bayesian Inference…

200 papers

We introduce the sequential neural posterior and likelihood approximation (SNPLA) algorithm. SNPLA is a normalizing flows-based algorithm for inference in implicit models, and therefore is a simulation-based inference method that only…

Machine Learning · Statistics 2021-06-08 Samuel Wiqvist , Jes Frellsen , Umberto Picchini

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Predicting future states or actions of a given system remains a fundamental, yet unsolved challenge of intelligence, especially in the scope of complex and non-deterministic scenarios, such as modeling behavior of humans. Existing…

Machine Learning · Computer Science 2020-12-01 Maciej Zięba , Marcin Przewięźlikowski , Marek Śmieja , Jacek Tabor , Tomasz Trzcinski , Przemysław Spurek

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

Normalizing Flows (NFs) are flexible explicit generative models that have been shown to accurately model complex real-world data distributions. However, their invertibility constraint imposes limitations on data distributions that reside on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Janis Postels , Martin Danelljan , Luc Van Gool , Federico Tombari

The authors give an approximation method for Bayesian inference in arena model, which is focused on paired comparisons with eliminations and bifurcations. The approximation method simplifies the inference by reducing parameters and…

Methodology · Statistics 2019-11-20 Yutong Nie , Chenhe Zhang

This notebook tutorial demonstrates a method for sampling Boltzmann distributions of lattice field theories using a class of machine learning models known as normalizing flows. The ideas and approaches proposed in arXiv:1904.12072,…

Current methods for regularization in machine learning require quite specific model assumptions (e.g. a kernel shape) that are not derived from prior knowledge about the application, but must be imposed merely to make the method work. We…

Machine Learning · Statistics 2022-11-01 Matthias Wieler

Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled…

Machine Learning · Computer Science 2023-05-31 Matthias Kirchler , Christoph Lippert , Marius Kloft

Stokes inversion techniques are very powerful methods for obtaining information on the thermodynamic and magnetic properties of solar and stellar atmospheres. In recent years, very sophisticated inversion codes have been developed that are…

Solar and Stellar Astrophysics · Physics 2022-03-23 C. J. Díaz Baso , A. Asensio Ramos , J. de la Cruz Rodríguez

We introduce implicit Bayesian neural networks, a simple and scalable approach for uncertainty representation in deep learning. Standard Bayesian approach to deep learning requires the impractical inference of the posterior distribution…

Machine Learning · Statistics 2020-10-27 Trung Trinh , Samuel Kaski , Markus Heinonen

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

Distributional Reinforcement Learning (DistRL) improves upon expectation-based methods by modeling full return distributions, but standard approaches often remain far from parsimonious. Categorical methods (e.g., C51) rely on fixed supports…

Artificial Intelligence · Computer Science 2026-05-06 Simo Alami C. , Rim Kaddah , Jesse Read , Marie-Paule Cani

Deep learning models are being used for the analysis of parametric statistical models based on simulation-only frameworks. Bayesian models using normalizing flows simulate data from a prior distribution and are composed of two deep neural…

Statistics Theory · Mathematics 2026-03-12 Stefan Böhringer

We propose a unified framework that employs variational inference (VI) with (conditional) normalizing flows (NFs) to train both between-model and within-model proposals for reversible jump Markov chain Monte Carlo, enabling efficient…

Machine Learning · Statistics 2026-02-05 Pingping Yin , Xiyun Jiao

Regression on function spaces is typically limited to models with Gaussian process priors. We introduce the notion of universal functional regression, in which we aim to learn a prior distribution over non-Gaussian function spaces that…

Machine Learning · Computer Science 2024-11-28 Yaozhong Shi , Angela F. Gao , Zachary E. Ross , Kamyar Azizzadenesheli

Bayesian Optimization (BO) has been recognized for its effectiveness in optimizing expensive and complex objective functions. Recent advancements in Latent Bayesian Optimization (LBO) have shown promise by integrating generative models such…

Machine Learning · Computer Science 2025-04-22 Seunghun Lee , Jinyoung Park , Jaewon Chu , Minseo Yoon , Hyunwoo J. Kim

Inverse problems arise anywhere we have indirect measurement. As, in general they are ill-posed, to obtain satisfactory solutions for them needs prior knowledge. Classically, different regularization methods and Bayesian inference based…

Machine Learning · Statistics 2023-08-31 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

Bayesian neural networks (BNN) can estimate the uncertainty in predictions, as opposed to non-Bayesian neural networks (NNs). However, BNNs have been far less widely used than non-Bayesian NNs in practice since they need iterative NN…

Machine Learning · Computer Science 2022-02-15 Namuk Park , Taekyu Lee , Songkuk Kim