English
Related papers

Related papers: Approximation of Intractable Likelihood Functions …

200 papers

Given an inverse problem with a normalizing flow prior, we wish to estimate the distribution of the underlying signal conditioned on the observations. We approach this problem as a task of conditional inference on the pre-trained…

Machine Learning · Statistics 2021-06-16 Jay Whang , Erik M. Lindgren , Alexandros G. Dimakis

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

Normalizing flows have shown great promise for modelling flexible probability distributions in a computationally tractable way. However, whilst data is often naturally described on Riemannian manifolds such as spheres, torii, and hyperbolic…

Machine Learning · Statistics 2020-12-10 Emile Mathieu , Maximilian Nickel

Models with intractable normalizing functions arise frequently in statistics. Common examples of such models include exponential random graph models for social networks and Markov point processes for ecology and disease modeling. Inference…

Computation · Statistics 2018-08-03 Jaewoo Park , Murali Haran

Normalizing flows model a complex target distribution in terms of a bijective transform operating on a simple base distribution. As such, they enable tractable computation of a number of important statistical quantities, particularly…

Machine Learning · Computer Science 2022-09-01 Chandramouli Shama Sastry , Andreas Lehrmann , Marcus Brubaker , Alexander Radovic

Normalizing Flows (NFs) are able to model complicated distributions p(y) with strong inter-dimensional correlations and high multimodality by transforming a simple base density p(z) through an invertible neural network under the change of…

Machine Learning · Computer Science 2023-11-14 Christina Winkler , Daniel Worrall , Emiel Hoogeboom , Max Welling

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based…

Cosmology and Nongalactic Astrophysics · Physics 2020-11-11 Ana Diaz Rivero , Cora Dvorkin

Normalizing flows are a promising tool for modeling probability distributions in physical systems. While state-of-the-art flows accurately approximate distributions and energies, applications in physics additionally require smooth energies…

Machine Learning · Statistics 2021-12-01 Jonas Köhler , Andreas Krämer , Frank Noé

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

Machine Learning · Statistics 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

This notebook tutorial demonstrates a method for sampling Boltzmann distributions of lattice field theories using a class of machine learning models known as normalizing flows. The ideas and approaches proposed in arXiv:1904.12072,…

Normalizing flows have emerged as an important family of deep neural networks for modelling complex probability distributions. In this note, we revisit their coupling and autoregressive transformation layers as probabilistic graphical…

Machine Learning · Computer Science 2020-06-05 Antoine Wehenkel , Gilles Louppe

Normalizing flows model complex probability distributions by combining a base distribution with a series of bijective neural networks. State-of-the-art architectures rely on coupling and autoregressive transformations to lift up invertible…

Machine Learning · Computer Science 2021-02-15 Antoine Wehenkel , Gilles Louppe

Stochastic processes defined on integer valued state spaces are popular within the physical and biological sciences. These models are necessary for capturing the dynamics of small systems where the individual nature of the populations…

Machine Learning · Statistics 2024-04-15 Luke O'Loughlin , John Maclean , Andrew Black

Normalizing flows are an established approach for modelling complex probability densities through invertible transformations from a base distribution. However, the accuracy with which the target distribution can be captured by the…

Machine Learning · Statistics 2024-02-02 Harry Bevins , Will Handley , Thomas Gessey-Jones

We study the approximation of functions which are invariant with respect to certain permutations of the input indices using flow maps of dynamical systems. Such invariant functions includes the much studied translation-invariant ones…

Machine Learning · Computer Science 2022-08-19 Qianxiao Li , Ting Lin , Zuowei Shen

Normalizing flows have shown great success as general-purpose density estimators. However, many real world applications require the use of domain-specific knowledge, which normalizing flows cannot readily incorporate. We propose…

Machine Learning · Statistics 2022-03-17 Gianluigi Silvestri , Emily Fertig , Dave Moore , Luca Ambrogioni

In the past few years, deep generative models, such as generative adversarial networks \autocite{GAN}, variational autoencoders \autocite{vaepaper}, and their variants, have seen wide adoption for the task of modelling complex data…

Machine Learning · Statistics 2020-09-02 Guilherme G. P. Freitas Pires , Mário A. T. Figueiredo

The sampling of probability distributions specified up to a normalization constant is an important problem in both machine learning and statistical mechanics. While classical stochastic sampling methods such as Markov Chain Monte Carlo…

Machine Learning · Statistics 2020-10-27 Hao Wu , Jonas Köhler , Frank Noé

In this work, we perform safety analysis of linear dynamical systems with uncertainties. Instead of computing a conservative overapproximation of the reachable set, our approach involves computing a statistical approximate reachable set. As…

Systems and Control · Electrical Eng. & Systems 2021-09-17 Bineet Ghosh , Parasara Sridhar Duggirala