English
Related papers

Related papers: Preferential Normalizing Flows

200 papers

Designing predictive models for subjective problems in natural language processing (NLP) remains challenging. This is mainly due to its non-deterministic nature and different perceptions of the content by different humans. It may be solved…

Artificial Intelligence · Computer Science 2023-12-12 Piotr Miłkowski , Konrad Karanowski , Patryk Wielopolski , Jan Kocoń , Przemysław Kazienko , Maciej Zięba

Normalizing flows are generative models that provide tractable density estimation via an invertible transformation from a simple base distribution to a complex target distribution. However, this technique cannot directly model data…

Machine Learning · Statistics 2021-11-15 Brendan Leigh Ross , Jesse C. Cresswell

Normalizing Flows (NFs) are emerging as a powerful class of generative models, as they not only allow for efficient sampling, but also deliver, by construction, density estimation. They are of great potential usage in High Energy Physics…

Machine Learning · Statistics 2023-03-01 Humberto Reyes-Gonzalez , Riccardo Torre

Recently, there has been a surge of interest in incorporating neural networks into particle filters, e.g. differentiable particle filters, to perform joint sequential state estimation and model learning for non-linear non-Gaussian…

Machine Learning · Computer Science 2025-01-07 Xiongjie Chen , Yunpeng Li

Normalizing flows (NFs) have become a prominent method for deep generative models that allow for an analytic probability density estimation and efficient synthesis. However, a flow-based network is considered to be inefficient in parameter…

Machine Learning · Computer Science 2020-10-26 Sang-gil Lee , Sungwon Kim , Sungroh Yoon

Normalizing flows have emerged as an important family of deep neural networks for modelling complex probability distributions. In this note, we revisit their coupling and autoregressive transformation layers as probabilistic graphical…

Machine Learning · Computer Science 2020-06-05 Antoine Wehenkel , Gilles Louppe

Incorporation of expert information in inference or decision settings is often important, especially in cases where data are unavailable, costly or unreliable. One approach is to elicit prior quantiles from an expert and then to fit these…

Statistics Theory · Mathematics 2016-11-04 Nicholas M. Kiefer

Modern reinforcement learning (RL) algorithms have found success by using powerful probabilistic models, such as transformers, energy-based models, and diffusion/flow-based models. To this end, RL researchers often choose to pay the price…

Machine Learning · Computer Science 2025-06-05 Raj Ghugare , Benjamin Eysenbach

Normalizing flows are a class of generative models that enable exact likelihood evaluation. While these models have already found various applications in particle physics, normalizing flows are not flexible enough to model many of the…

High Energy Physics - Phenomenology · Physics 2022-09-07 Rob Verheyen

Recent work shows that path gradient estimators for normalizing flows have lower variance compared to standard estimators for variational inference, resulting in improved training. However, they are often prohibitively more expensive from a…

Machine Learning · Computer Science 2024-03-26 Lorenz Vaitl , Ludwig Winkler , Lorenz Richter , Pan Kessel

Eliciting informative prior distributions for Bayesian inference can often be complex and challenging. While popular methods rely on asking experts probability based questions to quantify uncertainty, these methods are not without their…

Methodology · Statistics 2022-03-11 Julia R. Falconer , Eibe Frank , Devon L. L. Polaschek , Chaitanya Joshi

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

Building on the recent trend of new deep generative models known as Normalizing Flows (NF), simulation-based inference (SBI) algorithms can now efficiently accommodate arbitrary complex and high-dimensional data distributions. The…

Machine Learning · Statistics 2022-11-28 Julia Linhart , Alexandre Gramfort , Pedro L. C. Rodrigues

Obtaining samples from the posterior distribution of inverse problems with expensive forward operators is challenging especially when the unknowns involve the strongly heterogeneous Earth. To meet these challenges, we propose a…

Machine Learning · Statistics 2021-01-12 Ali Siahkoohi , Gabrio Rizzuti , Mathias Louboutin , Philipp A. Witte , Felix J. Herrmann

The pooling of prior opinions is an important area of research and has been for a number of decades. The idea is to obtain a single belief probability distribution from a set of expert opinion belief distributions. The paper proposes a new…

Methodology · Statistics 2022-07-27 A. Kume , C. Villa , S. G. Walker

Normalizing Flows (NFs) are universal density estimators based on Neural Networks. However, this universality is limited: the density's support needs to be diffeomorphic to a Euclidean space. In this paper, we propose a novel method to…

Machine Learning · Computer Science 2022-02-02 Christian Horvat , Jean-Pascal Pfister

The Normalizing Flow (NF) models a general probability density by estimating an invertible transformation applied on samples drawn from a known distribution. We introduce a new type of NF, called Deep Diffeomorphic Normalizing Flow (DDNF).…

Machine Learning · Statistics 2018-11-26 Hadi Salman , Payman Yadollahpour , Tom Fletcher , Kayhan Batmanghelich

Normalizing flows are a powerful tool to create flexible probability distributions with a wide range of potential applications in cosmology. Here we are studying normalizing flows which represent cosmological observables at field level,…

Cosmology and Nongalactic Astrophysics · Physics 2021-05-26 Adam Rouhiainen , Utkarsh Giri , Moritz Münchmeyer

Normalizing flows, which learn a distribution by transforming the data to samples from a Gaussian base distribution, have proven powerful density approximations. But their expressive power is limited by this choice of the base distribution.…

Machine Learning · Computer Science 2021-07-16 Mike Laszkiewicz , Johannes Lederer , Asja Fischer

Normalizing Flows are a promising new class of algorithms for unsupervised learning based on maximum likelihood optimization with change of variables. They offer to learn a factorized component representation for complex nonlinear data and,…

Machine Learning · Computer Science 2020-02-17 Reuben Feinman , Nikhil Parthasarathy