English
Related papers

Related papers: Flexible Tails for Normalizing Flows

200 papers

Conditional Normalizing Flows (CNFs) are flexible generative models capable of representing complicated distributions with high dimensionality and large interdimensional correlations, making them appealing for structured output learning.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mohsen Zand , Ali Etemad , Michael Greenspan

Normalizing flows define a probability distribution by an explicit invertible transformation $\boldsymbol{\mathbf{z}}=f(\boldsymbol{\mathbf{x}})$. In this work, we present implicit normalizing flows (ImpFlows), which generalize normalizing…

Machine Learning · Statistics 2021-03-18 Cheng Lu , Jianfei Chen , Chongxuan Li , Qiuhao Wang , Jun Zhu

Normalizing flows, diffusion normalizing flows and variational autoencoders are powerful generative models. This chapter provides a unified framework to handle these approaches via Markov chains. We consider stochastic normalizing flows as…

Machine Learning · Computer Science 2023-02-06 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

Normalizing flows have received a great deal of recent attention as they allow flexible generative modeling as well as easy likelihood computation. While a wide variety of flow models have been proposed, there is little formal understanding…

Machine Learning · Computer Science 2020-06-02 Zhifeng Kong , Kamalika Chaudhuri

We present a data-driven approach for probabilistic wind power forecasting based on conditional normalizing flow (CNF). In contrast with the existing, this approach is distribution-free (as for non-parametric and quantile-based approaches)…

Systems and Control · Electrical Eng. & Systems 2022-07-20 Honglin Wen , Pierre Pinson , Jinghuan Ma , Jie Gu , Zhijian Jin

A phase-type distribution is the distribution of the time until absorption in a finite state-space time-homogeneous Markov jump process, with one absorbing state and the rest being transient. These distributions are mathematically tractable…

Statistics Theory · Mathematics 2021-12-08 Martin Bladt , Jorge Yslas

Normalizing flows (NF) are a class of powerful generative models that have gained popularity in recent years due to their ability to model complex distributions with high flexibility and expressiveness. In this work, we introduce a new type…

Machine Learning · Computer Science 2023-06-08 Jonas Köhler , Michele Invernizzi , Pim de Haan , Frank Noé

Linear regression with the classical normality assumption for the error distribution may lead to an undesirable posterior inference of regression coefficients due to the potential outliers. This paper considers the finite mixture of two…

Methodology · Statistics 2021-01-12 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

Some new survival distributions are introduced based on a generalised exponential function. This class of distributions includes heavy-tailed generalisations of exponential, Weibull and gamma distributions. Properties of the distributions…

Methodology · Statistics 2014-12-03 Rose Baker

Normalizing flows are bijective mappings between inputs and latent representations with a fully factorized distribution. They are very attractive due to exact likelihood valuation and efficient sampling. However, their effective capacity is…

Machine Learning · Computer Science 2021-11-03 Matej Grcić , Ivan Grubišić , Siniša Šegvić

Normalizing flows are a powerful tool for generative modelling, density estimation and posterior reconstruction in Bayesian inverse problems. In this paper, we introduce proximal residual flows, a new architecture of normalizing flows.…

Machine Learning · Computer Science 2023-05-19 Johannes Hertrich

To better conform to data geometry, recent deep generative modelling techniques adapt Euclidean constructions to non-Euclidean spaces. In this paper, we study normalizing flows on manifolds. Previous work has developed flow models for…

Machine Learning · Statistics 2020-06-19 Aaron Lou , Derek Lim , Isay Katsman , Leo Huang , Qingxuan Jiang , Ser-Nam Lim , Christopher De Sa

In this paper we propose Discretely Indexed flows (DIF) as a new tool for solving variational estimation problems. Roughly speaking, DIF are built as an extension of Normalizing Flows (NF), in which the deterministic transport becomes…

Machine Learning · Statistics 2022-04-05 Elouan Argouarc'h , François Desbouvries , Eric Barat , Eiji Kawasaki , Thomas Dautremer

Leveraging the recently emerging geometric approach to multivariate extremes and the flexibility of normalising flows on the hypersphere, we propose a principled deep-learning-based methodology that enables accurate joint tail extrapolation…

Methodology · Statistics 2025-05-07 Lambert De Monte , Raphaël Huser , Ioannis Papastathopoulos , Jordan Richards

Normalising flows (NFs) for discrete data are challenging because parameterising bijective transformations of discrete variables requires predicting discrete/integer parameters. Having a neural network architecture predict discrete…

Machine Learning · Computer Science 2020-06-12 Rob Hesselink , Wilker Aziz

The family of location and scale mixtures of Gaussians has the ability to generate a number of flexible distributional forms. It nests as particular cases several important asymmetric distributions like the Generalised Hyperbolic…

Methodology · Statistics 2014-08-05 Darren Wraith , Florence Forbes

We present a framework for learning probability distributions on topologically non-trivial manifolds, utilizing normalizing flows. Current methods focus on manifolds that are homeomorphic to Euclidean space, enforce strong structural priors…

Machine Learning · Computer Science 2022-07-12 Dimitris Kalatzis , Johan Ziruo Ye , Alison Pouplin , Jesper Wohlert , Søren Hauberg

I report a new statistical distribution formulated to confront the infamous, long-standing, computational/modeling challenge presented by highly skewed and/or leptokurtic ("fat- or heavy-tailed") data. The distribution is straightforward,…

Statistical Finance · Quantitative Finance 2011-11-01 Lawrence R. Thorne

Recent work shows that path gradient estimators for normalizing flows have lower variance compared to standard estimators for variational inference, resulting in improved training. However, they are often prohibitively more expensive from a…

Machine Learning · Computer Science 2024-03-26 Lorenz Vaitl , Ludwig Winkler , Lorenz Richter , Pan Kessel

We propose a variational tail bound for norms of random vectors under moment assumptions on their one-dimensional marginals. A simplified version of the bound that parametrizes the ``aggregating distribution'' using a certain pushforward of…

Probability · Mathematics 2026-02-02 Sohail Bahmani