English
Related papers

Related papers: Flexible Tails for Normalizing Flows

200 papers

We present elliptical processes, a family of non-parametric probabilistic models that subsume Gaussian processes and Student's t processes. This generalization includes a range of new heavy-tailed behaviors while retaining computational…

Machine Learning · Computer Science 2023-11-23 Maria Bånkestad , Jens Sjölund , Jalil Taghia , Thomas B. Schöon

The presence of non-Gaussian tails is a prevalent characteristic in many financial modeling scenarios, necessitating the use of complex non-Gaussian distributions such as the generalized beta of the second kind (GB2) and the skewed…

Applications · Statistics 2025-12-10 Xing Yan , Yue Zhao , Qi Wu , Wenxuan Ma

We introduce in this work the normalizing field flows (NFF) for learning random fields from scattered measurements. More precisely, we construct a bijective transformation (a normalizing flow characterizing by neural networks) between a…

Machine Learning · Computer Science 2022-05-11 Ling Guo , Hao Wu , Tao Zhou

A normalizing flow (NF) is a mapping that transforms a chosen probability distribution to a normal distribution. Such flows are a common technique used for data generation and density estimation in machine learning and data science. The…

Optimization and Control · Mathematics 2022-12-01 Alexander Vidal , Samy Wu Fung , Luis Tenorio , Stanley Osher , Levon Nurbekyan

Eliciting a high-dimensional probability distribution from an expert via noisy judgments is notoriously challenging, yet useful for many applications, such as prior elicitation and reward modeling. We introduce a method for eliciting the…

Machine Learning · Computer Science 2024-10-17 Petrus Mikkola , Luigi Acerbi , Arto Klami

Normalizing flows have arisen as a tool to accelerate Monte Carlo sampling for lattice field theories. This work reviews recent progress in applying normalizing flows to 4-dimensional nonabelian gauge theories, focusing on two advancements:…

High Energy Physics - Lattice · Physics 2025-02-04 Ryan Abbott , Denis Boyda , Daniel C. Hackett , Gurtej Kanwar , Fernando Romero-López , Phiala E. Shanahan , Julian M. Urban

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

We present a novel theoretical framework for understanding the expressive power of normalizing flows. Despite their prevalence in scientific applications, a comprehensive understanding of flows remains elusive due to their restricted…

Machine Learning · Computer Science 2025-01-30 Felix Draxler , Stefan Wahl , Christoph Schnörr , Ullrich Köthe

The normalization constraint on probability density poses a significant challenge for solving the Fokker-Planck equation. Normalizing Flow, an invertible generative model leverages the change of variables formula to ensure probability…

Machine Learning · Computer Science 2023-09-28 Feng Liu , Faguo Wu , Xiao Zhang

Safe and reliable state estimation techniques are a critical component of next-generation robotic systems. Agents in such systems must be able to reason about the intentions and trajectories of other agents for safe and efficient motion…

Robotics · Computer Science 2023-06-28 Harrison Delecki , Liam A. Kruse , Marc R. Schlichting , Mykel J. Kochenderfer

To predict future trajectories, the normalizing flow with a standard Gaussian prior suffers from weak diversity. The ineffectiveness comes from the conflict between the fact of asymmetric and multi-modal distribution of likely outcomes and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Jiahe Chen , Jinkun Cao , Dahua Lin , Kris Kitani , Jiangmiao Pang

We investigate the ability of popular flow based methods to capture tail-properties of a target density by studying the increasing triangular maps used in these flow methods acting on a tractable source density. We show that the density…

Statistics Theory · Mathematics 2020-09-22 Priyank Jaini , Ivan Kobyzev , Yaoliang Yu , Marcus Brubaker

Normalizing flows transform a latent distribution through an invertible neural network for a flexible and pleasingly simple approach to generative modelling, while preserving an exact likelihood. We propose FlowGMM, an end-to-end approach…

Machine Learning · Computer Science 2020-01-01 Pavel Izmailov , Polina Kirichenko , Marc Finzi , Andrew Gordon Wilson

A normalizing flow models a complex probability density as an invertible transformation of a simple density. The invertibility means that we can evaluate densities and generate samples from a flow. In practice, autoregressive flow-based…

Machine Learning · Statistics 2019-06-06 Conor Durkan , Artur Bekasov , Iain Murray , George Papamakarios

Normalizing flows and autoregressive models have been successfully combined to produce state-of-the-art results in density estimation, via Masked Autoregressive Flows (MAF), and to accelerate state-of-the-art WaveNet-based speech synthesis…

Machine Learning · Computer Science 2018-04-04 Chin-Wei Huang , David Krueger , Alexandre Lacoste , Aaron Courville

We study the consequences of mode-collapse of normalizing flows in the context of lattice field theory. Normalizing flows allow for independent sampling. For this reason, it is hoped that they can avoid the tunneling problem of local-update…

High Energy Physics - Lattice · Physics 2023-11-06 Kim A. Nicoli , Christopher J. Anders , Tobias Hartung , Karl Jansen , Pan Kessel , Shinichi Nakajima

Normalizing flows are a class of generative models that enable exact likelihood evaluation. While these models have already found various applications in particle physics, normalizing flows are not flexible enough to model many of the…

High Energy Physics - Phenomenology · Physics 2022-09-07 Rob Verheyen

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

Machine Learning · Computer Science 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

The future motion of traffic participants is inherently uncertain. To plan safely, therefore, an autonomous agent must take into account multiple possible trajectory outcomes and prioritize them. Recently, this problem has been addressed…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Christoph Schöller , Alois Knoll

Continuous mixtures of distributions are widely employed in the statistical literature as models for phenomena with highly divergent outcomes; in particular, many familiar heavy-tailed distributions arise naturally as mixtures of…

Methodology · Statistics 2017-10-10 Carter T. Butts