English
Related papers

Related papers: Fat-Tailed Variational Inference with Anisotropic …

200 papers

It is argued that there is a need for fat-tailed distributions that become thin in the extreme tail. A 3-parameter distribution is introduced that visually resembles the t-distribution and interpolates between the normal distribution and…

Statistics Theory · Mathematics 2022-02-08 Rose D Baker

In complex systems such as turbulent flows and financial markets, the dynamics in long and short time-lags, signaled by Gaussian and fat-tailed statistics, respectively, calls for a unified description. To address this issue we analyze a…

Statistical Finance · Quantitative Finance 2008-12-02 A. A. G. Cortines , R. Riera , C. Anteneodo

Normalising-flow variational inference (VI) can approximate complex posteriors, yet single-flow models often behave inconsistently across qualitatively different distributions. We propose Adaptive Mixture Flow Variational Inference…

Machine Learning · Computer Science 2025-10-03 Benjamin Wiriyapong , Oktay Karakuş , Kirill Sidorov

This paper introduces Generalized Attention Flow (GAF), a novel feature attribution method for Transformer-based models to address the limitations of current approaches. By extending Attention Flow and replacing attention weights with the…

Machine Learning · Computer Science 2025-02-25 Behrooz Azarkhalili , Maxwell Libbrecht

Fine-tuning pre-trained diffusion and flow models to optimize downstream utilities is central to real-world deployment. Existing entropy-regularized methods primarily maximize expected reward, providing no mechanism to shape tail behavior.…

Machine Learning · Computer Science 2026-02-20 Zifan Wang , Riccardo De Santi , Xiaoyu Mo , Michael M. Zavlanos , Andreas Krause , Karl H. Johansson

Adaptive importance sampling (AIS) algorithms are widely used to approximate expectations with respect to complicated target probability distributions. When the target has heavy tails, existing AIS algorithms can provide inconsistent…

Computation · Statistics 2023-10-26 Thomas Guilmeau , Nicola Branchini , Emilie Chouzenoux , Víctor Elvira

Variational inference with {\alpha}-divergences has been widely used in modern probabilistic machine learning. Compared to Kullback-Leibler (KL) divergence, a major advantage of using {\alpha}-divergences (with positive {\alpha} values) is…

Machine Learning · Computer Science 2019-09-10 Dilin Wang , Hao Liu , Qiang Liu

This paper proposes a new method to combine several densities such that each density dominates a separate part of a joint distribution. The method is fully unsupervised, i.e. the parameters in the densities and the thresholds are…

Methodology · Statistics 2009-02-25 Lars Holden , Ola Haug

We study anomalous transport arising in disordered one-dimensional spin chains, specifically focusing on the subdiffusive transport typically found in a phase preceding the many-body localization transition. Different types of transport can…

Disordered Systems and Neural Networks · Physics 2020-03-09 Maximilian Schulz , Scott R. Taylor , Antonello Scardicchio , Marko Žnidarič

A complete theoretical presentation of the Continuum-mechanical, Anisotropic Flow model, based on an anisotropic Flow Enhancement factor (CAFFE model) is given. The CAFFE model is an application of the theory of mixtures with continuous…

Geophysics · Physics 2010-03-22 Luca Placidi , Ralf Greve , Hakime Seddik , Sergio H. Faria

We consider a model for multivariate data with heavy-tailed marginal distributions and a Gaussian dependence structure. The different marginals in the model are allowed to have non-identical tail behavior in contrast to most popular…

Methodology · Statistics 2023-05-23 Bikramjit Das

Masked autoregressive flow (MAF) is a state-of-the-art non-parametric density estimation technique. It is based on the idea (known as a normalizing flow) that a simple base probability distribution can be mapped into a complicated target…

Instrumentation and Methods for Astrophysics · Physics 2023-05-25 Rico K. L. Lo

We report results of dissipative particle dynamics simulations and develop a semi-analytical theory of an anisotropic flow in a parallel-plate channel with two superhydrophobic striped walls. Our approach is valid for any local slip at the…

Fluid Dynamics · Physics 2015-06-04 Jiajia Zhou , Aleksey V. Belyaev , Friederike Schmid , Olga I. Vinogradova

This is an epistemological approach to errors in both inference and risk management, leading to necessary structural properties for the probability distribution. Many mechanisms have been used to show the emergence of fat tails. Here we…

Methodology · Statistics 2019-12-16 Nassim Nicholas Taleb , Pasquale Cirillo

Normalizing flows and autoregressive models have been successfully combined to produce state-of-the-art results in density estimation, via Masked Autoregressive Flows (MAF), and to accelerate state-of-the-art WaveNet-based speech synthesis…

Machine Learning · Computer Science 2018-04-04 Chin-Wei Huang , David Krueger , Alexandre Lacoste , Aaron Courville

We propose a new Bayesian strategy for adaptation to smoothness in nonparametric models based on heavy tailed series priors. We illustrate it in a variety of settings, showing in particular that the corresponding Bayesian posterior…

Statistics Theory · Mathematics 2024-05-30 Sergios Agapiou , Ismaël Castillo

A fractional diffusion equation with advection term is rigorously derived from a kinetic transport model with a linear turning operator, featuring a fat-tailed equilibrium distribution and a small directional bias due to a given vector…

Analysis of PDEs · Mathematics 2015-10-19 Pedro Aceves-Sanchez , Christian Schmeiser

Spatially referenced data often have autocovariance functions with elliptical isolevel contours, a property known as geometric anisotropy. The anisotropy parameters include the tilt of the ellipse (orientation angle) with respect to a…

Statistics Theory · Mathematics 2021-10-04 Manolis P. Petrakis , Dionissios T. Hristopulos

A novel statistical method is proposed and investigated for estimating a heavy tailed density under mild smoothness assumptions. Statistical analyses of heavy-tailed distributions are susceptible to the problem of sparse information in the…

Methodology · Statistics 2022-11-18 Surya T Tokdar , Sheng Jiang , Erika L Cunningham

Predicting the future trajectories of the traffic agents is a gordian technique in autonomous driving. However, trajectory prediction suffers from data imbalance in the prevalent datasets, and the tailed data is often more complicated and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yuning Wang , Pu Zhang , Lei Bai , Jianru Xue