English
Related papers

Related papers: Woodbury Transformations for Deep Generative Flows

200 papers

The present work proposes an inflow turbulence generation strategy using deep learning methods. This is achieved with the help of an autoencoder architecture with two different types of operational layers in the latent-space: a fully…

Fluid Dynamics · Physics 2019-10-16 Aakash Vijay Patil

Invertible convolutions have been an essential element for building expressive normalizing flow-based generative models since their introduction in Glow. Several attempts have been made to design invertible $k \times k$ convolutions that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Aditya Kallappa , Sandeep Nagar , Girish Varma

Deep learning models are being used for the analysis of parametric statistical models based on simulation-only frameworks. Bayesian models using normalizing flows simulate data from a prior distribution and are composed of two deep neural…

Statistics Theory · Mathematics 2026-03-12 Stefan Böhringer

To overcome topological constraints and improve the expressiveness of normalizing flow architectures, Wu, K\"ohler and No\'e introduced stochastic normalizing flows which combine deterministic, learnable flow transformations with stochastic…

Machine Learning · Computer Science 2022-12-02 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

We address the problem of improving the performance and in particular the sample complexity of deep neural networks by enforcing and guaranteeing invariances to symmetry transformations rather than learning them from data. Group-equivariant…

Machine Learning · Computer Science 2023-03-06 Matthias Rath , Alexandru Paul Condurache

Differentiable particle filters provide a flexible mechanism to adaptively train dynamic and measurement models by learning from observed data. However, most existing differentiable particle filters are within the bootstrap particle…

Artificial Intelligence · Computer Science 2021-11-11 Xiongjie Chen , Hao Wen , Yunpeng Li

Normalizing flows map an independent set of latent variables to their samples using a bijective transformation. Despite the exact correspondence between samples and latent variables, their high level relationship is not well understood. In…

Machine Learning · Statistics 2022-02-16 Edmond Cunningham , Adam Cobb , Susmit Jha

Normalizing flows leverage the Change of Variables Formula (CVF) to define flexible density models. Yet, the requirement of smooth transformations (diffeomorphisms) in the CVF poses a significant challenge in the construction of these…

Machine Learning · Statistics 2021-07-12 Niklas Koenen , Marvin N. Wright , Peter Maaß , Jens Behrmann

The prevalence of convolution in applications within signal processing, deep neural networks, and numerical solvers has motivated the development of numerous fast convolution algorithms. In many of these problems, convolution is performed…

Numerical Analysis · Mathematics 2020-07-03 Caleb Ju , Edgar Solomonik

We introduce ImitationFlow, a novel Deep generative model that allows learning complex globally stable, stochastic, nonlinear dynamics. Our approach extends the Normalizing Flows framework to learn stable Stochastic Differential Equations.…

Machine Learning · Computer Science 2020-10-27 Julen Urain , Michelle Ginesi , Davide Tateo , Jan Peters

Normalizing flow (NF) has gained popularity over traditional maximum likelihood based methods due to its strong capability to model complex data distributions. However, the standard approach, which maps the observed data to a normal…

Machine Learning · Computer Science 2022-11-22 Hanze Dong , Shizhe Diao , Weizhong Zhang , Tong Zhang

In this work, we investigate the use of normalizing flows to model conditional distributions. In particular, we use our proposed method to analyze inverse problems with invertible neural networks by maximizing the posterior likelihood. Our…

Machine Learning · Computer Science 2019-11-07 Zhisheng Xiao , Qing Yan , Yali Amit

We present a novel integrator based on normalizing flows which can be used to improve the unweighting efficiency of Monte-Carlo event generators for collider physics simulations. In contrast to machine learning approaches based on surrogate…

High Energy Physics - Phenomenology · Physics 2020-04-22 Christina Gao , Stefan Hoeche , Joshua Isaacson , Claudius Krause , Holger Schulz

Time series forecasting is often fundamental to scientific and engineering problems and enables decision making. With ever increasing data set sizes, a trivial solution to scale up predictions is to assume independence between interacting…

Machine Learning · Computer Science 2021-01-18 Kashif Rasul , Abdul-Saboor Sheikh , Ingmar Schuster , Urs Bergmann , Roland Vollgraf

Deep learning often faces the challenge of efficiently processing dynamic inputs, such as sensor data or user inputs. For example, an AI writing assistant is required to update its suggestions in real time as a document is edited.…

Machine Learning · Computer Science 2023-07-28 Or Sharir , Anima Anandkumar

Whenever invertible generative networks are needed for LHC physics, normalizing flows show excellent performance. In this work, we investigate their performance for fast calorimeter shower simulations with increasing phase space dimension.…

High Energy Physics - Phenomenology · Physics 2025-03-06 Florian Ernst , Luigi Favaro , Claudius Krause , Tilman Plehn , David Shih

Inverse problems of partial differential equations are ubiquitous across various scientific disciplines and can be formulated as statistical inference problems using Bayes' theorem. To address large-scale problems, it is crucial to develop…

Numerical Analysis · Mathematics 2025-12-23 Yang Zhao , Haoyu Lu , Junxiong Jia , Tao Zhou

In the quest to build generative surrogate models as computationally efficient alternatives to rule-based simulations, the quality of the generated samples remains a crucial frontier. So far, normalizing flows have been among the models…

Instrumentation and Detectors · Physics 2024-09-05 Thorsten Buss , Frank Gaede , Gregor Kasieczka , Claudius Krause , David Shih

A normalizing flow is an invertible mapping between an arbitrary probability distribution and a standard normal distribution; it can be used for density estimation and statistical inference. Computing the flow follows the change of…

Machine Learning · Computer Science 2021-12-10 Derek Onken , Samy Wu Fung , Xingjian Li , Lars Ruthotto

We investigate the use of data-driven likelihoods to bypass a key assumption made in many scientific analyses, which is that the true likelihood of the data is Gaussian. In particular, we suggest using the optimization targets of flow-based…

Cosmology and Nongalactic Astrophysics · Physics 2020-11-11 Ana Diaz Rivero , Cora Dvorkin