English
Related papers

Related papers: Fat-Tailed Variational Inference with Anisotropic …

200 papers

We investigate the ability of popular flow based methods to capture tail-properties of a target density by studying the increasing triangular maps used in these flow methods acting on a tractable source density. We show that the density…

Statistics Theory · Mathematics 2020-09-22 Priyank Jaini , Ivan Kobyzev , Yaoliang Yu , Marcus Brubaker

Normalizing flows are a flexible class of probability distributions, expressed as transformations of a simple base distribution. A limitation of standard normalizing flows is representing distributions with heavy tails, which arise in…

Machine Learning · Statistics 2025-06-13 Tennessee Hickling , Dennis Prangle

Learning the tail behavior of a distribution is a notoriously difficult problem. By definition, the number of samples from the tail is small, and deep generative models, such as normalizing flows, tend to concentrate on learning the body of…

Machine Learning · Computer Science 2022-06-28 Mike Laszkiewicz , Johannes Lederer , Asja Fischer

Normalizing flows with a Gaussian base provide a computationally efficient way to approximate posterior distributions in Bayesian inference, but they often struggle to capture complex posteriors with multimodality and heavy tails. We…

Machine Learning · Statistics 2025-10-10 Seungsu Han , Juyoung Hwang , Won Chang

Normalizing flows provide an elegant method for obtaining tractable density estimates from distributions by using invertible transformations. The main challenge is to improve the expressivity of the models while keeping the invertibility…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Avideep Mukherjee , Badri Narayan Patro , Vinay P. Namboodiri

Normalizing flows are flexible, parameterized distributions that can be used to approximate expectations from intractable distributions via importance sampling. However, current flow-based approaches are limited on challenging targets where…

Machine Learning · Computer Science 2022-03-15 Laurence Illing Midgley , Vincent Stimper , Gregor N. C. Simm , José Miguel Hernández-Lobato

We present a novel technique for amortized posterior estimation using Normalizing Flows trained with likelihood-weighted importance sampling. This approach allows for the efficient inference of theoretical parameters in high-dimensional…

Machine Learning · Computer Science 2026-02-23 Rajneil Baruah

Standard generative models struggle with heavy-tailed data: Lipschitz architectures cannot produce power-law tails from Gaussian noise, and interpolating between heavy-tailed data and Gaussians is ill-posed. We propose a simple fix: apply…

Machine Learning · Statistics 2026-05-20 Jean Pachebat

Large deviations for fat tailed distributions, i.e. those that decay slower than exponential, are not only relatively likely, but they also occur in a rather peculiar way where a finite fraction of the whole sample deviation is concentrated…

Statistical Mechanics · Physics 2015-06-03 Mario Filiasi , Giacomo Livan , Matteo Marsili , Maria Peressi , Erik Vesselli , Elia Zarinelli

Flexible spatial models that allow transitions between tail dependence classes have recently appeared in the literature. However, inference for these models is computationally prohibitive, even in moderate dimensions, due to the necessity…

Statistics Theory · Mathematics 2020-12-03 Likun Zhang , Benjamin A. Shaby , Jennifer L. Wadsworth

The framework of normalizing flows provides a general strategy for flexible variational inference of posteriors over latent variables. We propose a new type of normalizing flow, inverse autoregressive flow (IAF), that, in contrast to…

Machine Learning · Computer Science 2017-02-01 Diederik P. Kingma , Tim Salimans , Rafal Jozefowicz , Xi Chen , Ilya Sutskever , Max Welling

We study the problems related to the estimation of the Gini index in presence of a fat-tailed data generating process, i.e. one in the stable distribution class with finite mean but infinite variance (i.e. with tail index $\alpha\in(1,2)$).…

Methodology · Statistics 2018-05-02 Andrea Fontanari , Nassim Nicholas Taleb , Pasquale Cirillo

Normalizing flows are tractable density models that can approximate complicated target distributions, e.g. Boltzmann distributions of physical systems. However, current methods for training flows either suffer from mode-seeking behavior,…

Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how these methods can be…

Machine Learning · Computer Science 2020-07-14 Simon Alexanderson , Gustav Eje Henter

We propose a transformation capable of altering the tail properties of a distribution, motivated by extreme value theory, which can be used as a layer in a normalizing flow to approximate multivariate heavy tailed distributions. We apply…

Machine Learning · Statistics 2023-11-02 Tennessee Hickling , Dennis Prangle

The displacement of a fluid by another less viscous one in a quasi-two dimensional geometry typically leads to complex fingering patterns. In an isotropic system, dense-branching growth arises, which is characterized by repeated…

Fluid Dynamics · Physics 2021-01-19 Qing Zhang , Amin Amooie , Martin Z. Bazant , Irmgard Bischofberger

This article introduces a non-parametric information-theoretic approach to inference about the tail of a continuous or a discrete distribution. Leveraging a new concept named tail profile -- a set of information-theoretic quantities…

Applications · Statistics 2025-03-19 Jialin Zhang , Zhiyi Zhang

Anisotropic flow coefficients and their fluctuations are investigated for Au+Au collisions at center of mass energy $\sqrt{s_{NN}}$ = 200 GeV by using a multi-phase transport model with string melting scenario. Experimental results of…

Nuclear Theory · Physics 2015-06-19 L. Ma , G. L. Ma , Y. G. Ma

We show that the quotient of Levy processes of jump-diffusion type has a fat-tailed distribution. An application is to price theory in economics. We show that fat tails arise endogenously from modeling of price change based on an excess…

General Economics · Economics 2021-03-11 Gunduz Caginalp

A 6-parameter fat-tailed distribution is proposed that generalises the t-distribution and allows asymmetry of scale and also of tail power, whilst avoiding the discontinuity of the second derivative of the split-t (AST) distribution. With…

Methodology · Statistics 2016-06-17 Rose D. Baker
‹ Prev 1 2 3 10 Next ›