English
Related papers

Related papers: Sylvester Normalizing Flows for Variational Infere…

200 papers

The normalization constraint on probability density poses a significant challenge for solving the Fokker-Planck equation. Normalizing Flow, an invertible generative model leverages the change of variables formula to ensure probability…

Machine Learning · Computer Science 2023-09-28 Feng Liu , Faguo Wu , Xiao Zhang

We introduce `atomic flows': they are graphs obtained from derivations by tracing atom occurrences and forgetting the logical structure. We study simple manipulations of atomic flows that correspond to complex reductions on derivations.…

Logic · Mathematics 2015-07-01 Alessio Guglielmi , Tom Gundersen

Normalizing flows transform a latent distribution through an invertible neural network for a flexible and pleasingly simple approach to generative modelling, while preserving an exact likelihood. We propose FlowGMM, an end-to-end approach…

Machine Learning · Computer Science 2020-01-01 Pavel Izmailov , Polina Kirichenko , Marc Finzi , Andrew Gordon Wilson

Normalizing flows provide an elegant approach to generative modeling that allows for efficient sampling and exact density evaluation of unknown data distributions. However, current techniques have significant limitations in their…

Machine Learning · Computer Science 2022-06-22 Sahil Sidheekh , Chris B. Dock , Tushar Jain , Radu Balan , Maneesh K. Singh

Normalizing flows model complex probability distributions using maps obtained by composing invertible layers. Special linear layers such as masked and 1x1 convolutions play a key role in existing architectures because they increase…

Machine Learning · Computer Science 2022-09-29 Chenlin Meng , Linqi Zhou , Kristy Choi , Tri Dao , Stefano Ermon

Due to the success of generative flows to model data distributions, they have been explored in inverse problems. Given a pre-trained generative flow, previous work proposed to minimize the 2-norm of the latent variables as a regularization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 José A. Chávez

Normalizing Flows (NFs) are powerful and efficient models for density estimation. When modeling densities on manifolds, NFs can be generalized to injective flows but the Jacobian determinant becomes computationally prohibitive. Current…

Machine Learning · Computer Science 2025-01-27 Marcello Massimo Negri , Jonathan Aellen , Volker Roth

We present a novel technique for amortized posterior estimation using Normalizing Flows trained with likelihood-weighted importance sampling. This approach allows for the efficient inference of theoretical parameters in high-dimensional…

Machine Learning · Computer Science 2026-02-23 Rajneil Baruah

Normalizing Flows (NFs) learn invertible mappings between the data and a Gaussian distribution. Prior works usually suffer from two limitations. First, they add random noise to training samples or VAE latents as data augmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Qinyu Zhao , Guangting Zheng , Tao Yang , Rui Zhu , Xingjian Leng , Stephen Gould , Liang Zheng

Normalizing flows, diffusion normalizing flows and variational autoencoders are powerful generative models. This chapter provides a unified framework to handle these approaches via Markov chains. We consider stochastic normalizing flows as…

Machine Learning · Computer Science 2023-02-06 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

In this paper, we propose a new volume-preserving flow and show that it performs similarly to the linear general normalizing flow. The idea is to enrich a linear Inverse Autoregressive Flow by introducing multiple lower-triangular matrices…

Machine Learning · Statistics 2017-06-15 Jakub M. Tomczak , Max Welling

Tabular regression is a well-studied problem with numerous industrial applications, yet most existing approaches focus on point estimation, often leading to overconfident predictions. This issue is particularly critical in industrial…

Normalizing Flows provide a principled framework for high-dimensional density estimation and generative modeling by constructing invertible transformations with tractable Jacobian determinants. We propose Fractal Flow, a novel normalizing…

Machine Learning · Statistics 2025-08-28 Binhui Zhang , Jianwei Ma

Unsupervised anomaly detection is often framed around two widely studied paradigms. Deep one-class classification, exemplified by Deep SVDD, learns compact latent representations of normality, while density estimators realized by…

Machine Learning · Computer Science 2025-10-13 Faried Abu Zaid , Tim Katzke , Emmanuel Müller , Daniel Neider

Variational Bayesian phylogenetic inference (VBPI) provides a promising general variational framework for efficient estimation of phylogenetic posteriors. However, the current diagonal Lognormal branch length approximation would…

Populations and Evolution · Quantitative Biology 2020-12-02 Cheng Zhang

Due to the non-stationarity of time series, the distribution shift problem largely hinders the performance of time series forecasting. Existing solutions either rely on using certain statistics to specify the shift, or developing specific…

Machine Learning · Computer Science 2025-02-10 Wei Fan , Shun Zheng , Pengyang Wang , Rui Xie , Kun Yi , Qi Zhang , Jiang Bian , Yanjie Fu

Variational inference (VI) is a technique to approximate difficult to compute posteriors by optimization. In contrast to MCMC, VI scales to many observations. In the case of complex posteriors, however, state-of-the-art VI approaches often…

Machine Learning · Statistics 2024-02-26 Oliver Dürr , Stephan Hörling , Daniel Dold , Ivonne Kovylov , Beate Sick

Normalizing flows are machine-learned maps between different lattice theories which can be used as components in exact sampling and inference schemes. Ongoing work yields increasingly expressive flows on gauge fields, but it remains an open…

Generative modeling seeks to uncover the underlying factors that give rise to observed data that can often be modeled as the natural symmetries that manifest themselves through invariances and equivariances to certain transformation laws.…

Machine Learning · Computer Science 2022-08-16 Avishek Joey Bose , Marcus Brubaker , Ivan Kobyzev

The field of general-purpose robotics has recently embraced powerful probabilistic diffusion-based models to learn the complex embodiment behaviours. However, existing models often come with significant trade-offs, namely high computational…

Robotics · Computer Science 2026-02-26 Jialong Li , Simon Kristoffersson Lind , Wenrui Xie , Maj Stenmark , Volker Krüger