English
Related papers

Related papers: Fat-Tailed Variational Inference with Anisotropic …

200 papers

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

The non-Markovian continuous-time random walk model, featuring fat-tailed waiting times and narrow distributed displacements with a non-zero mean, is a well studied model for anomalous diffusion. Using an analytical approach, we recently…

Statistical Mechanics · Physics 2023-09-18 Wanli Wang , Eli Barkai

We consider the problem of risk diversification of $\alpha$-stable heavy tailed risks. We study the behaviour of the aggregated Value-at-Risk, with particular reference to the impact of different tail dependence structures on the limits to…

Risk Management · Quantitative Finance 2017-04-25 Umberto Cherubini , Paolo Neri

The primary goal of this paper is to develop robust methods to handle two ubiquitous features appearing in the modeling of geophysical flows: (i) the anisotropy of the viscous stress tensor, (ii) stratification effects. We focus on the…

Analysis of PDEs · Mathematics 2020-11-05 Edoardo Bocchi , Francesco Fanelli , Christophe Prange

Fast Adversarial Training (FAT) has gained increasing attention within the research community owing to its efficacy in improving adversarial robustness. Particularly noteworthy is the challenge posed by catastrophic overfitting (CO) in this…

Machine Learning · Computer Science 2024-02-29 Mengnan Zhao , Lihe Zhang , Yuqiu Kong , Baocai Yin

The initial energy density distribution and fluctuation in the transverse direction lead to anisotropic flows of final hadrons through collective expansion in high-energy heavy-ion collisions. Fluctuations along the longitudinal direction,…

Nuclear Theory · Physics 2016-05-04 Long-Gang Pang , Hannah Petersen , Guang-You Qin , Victor Roy , Xin-Nian Wang

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

Diffusion models achieve state-of-the-art generation quality across many applications, but their ability to capture rare or extreme events in heavy-tailed distributions remains unclear. In this work, we show that traditional diffusion and…

Machine Learning · Computer Science 2024-10-30 Kushagra Pandey , Jaideep Pathak , Yilun Xu , Stephan Mandt , Michael Pritchard , Arash Vahdat , Morteza Mardani

Variational inference often struggles with the posterior geometry exhibited by complex hierarchical Bayesian models. Recent advances in flow-based variational families and Variationally Inferred Parameters (VIP) each address aspects of this…

Machine Learning · Computer Science 2025-11-06 Joohwan Ko , Justin Domke

In this paper we propose Discretely Indexed flows (DIF) as a new tool for solving variational estimation problems. Roughly speaking, DIF are built as an extension of Normalizing Flows (NF), in which the deterministic transport becomes…

Machine Learning · Statistics 2022-04-05 Elouan Argouarc'h , François Desbouvries , Eric Barat , Eiji Kawasaki , Thomas Dautremer

We consider the time evolution of a dilute atomic Fermi gas after release from a trapping potential. A common difficulty with using fluid dynamics to study the expansion of the gas is that the theory is not applicable in the dilute corona,…

Quantum Gases · Physics 2015-10-07 Marcus Bluhm , Thomas Schaefer

Data in the real world tends to exhibit a long-tailed label distribution, which poses great challenges for the training of neural networks in visual recognition. Existing methods tackle this problem mainly from the perspective of data…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Yan Zhao , Weicong Chen , Xu Tan , Kai Huang , Jihong Zhu

The choice of approximate posterior distribution is one of the core problems in variational inference. Most applications of variational inference employ simple families of posterior approximations in order to allow for efficient inference,…

Machine Learning · Statistics 2016-06-15 Danilo Jimenez Rezende , Shakir Mohamed

A variational time discretization of anisotropic Willmore flow combined with a spatial discretization via piecewise affine finite elements is presented. Here, both the energy and the metric underlying the gradient flow are anisotropic,…

Numerical Analysis · Mathematics 2015-03-25 Ricardo Perl , Paola Pozzi , Martin Rumpf

We present the elliptical processes -- a family of non-parametric probabilistic models that subsumes the Gaussian process and the Student-t process. This generalization includes a range of new fat-tailed behaviors yet retains computational…

Methodology · Statistics 2020-12-03 Maria Bånkestad , Jens Sjölund , Jalil Taghia , Thomas Schön

Normalizing flows, a popular class of deep generative models, often fail to represent extreme phenomena observed in real-world processes. In particular, existing normalizing flow architectures struggle to model multivariate extremes,…

Machine Learning · Computer Science 2022-05-04 Andrew McDonald , Pang-Ning Tan , Lifeng Luo

Two fundamental problems in unsupervised learning are efficient inference for latent-variable models and robust density estimation based on large amounts of unlabeled data. Algorithms for the two tasks, such as normalizing flows and…

Machine Learning · Statistics 2018-08-02 Changyou Chen , Chunyuan Li , Liqun Chen , Wenlin Wang , Yunchen Pu , Lawrence Carin

We study large deviation properties of probability distributions with either a compact support or a fat tail by comparing them with q-deformed exponential distributions. Our main result is a large deviation property for probability…

Mathematical Physics · Physics 2015-06-02 Jan Naudts , Hiroki Suyari

We propose a multivariate generative model to capture the complex dependence structure often encountered in business and financial data. Our model features heterogeneous and asymmetric tail dependence between all pairs of individual…

Machine Learning · Computer Science 2025-12-10 Xiangqian Sun , Xing Yan , Qi Wu

We propose a novel probabilistic model to facilitate the learning of multivariate tail dependence of multiple financial assets. Our method allows one to construct from known random vectors, e.g., standard normal, sophisticated joint…

Risk Management · Quantitative Finance 2020-01-14 Xing Yan , Qi Wu , Wen Zhang