English
Related papers

Related papers: Convolutional Normalizing Flows

200 papers

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

We present a novel generative modeling method called diffusion normalizing flow based on stochastic differential equations (SDEs). The algorithm consists of two neural SDEs: a forward SDE that gradually adds noise to the data to transform…

Machine Learning · Computer Science 2021-10-15 Qinsheng Zhang , Yongxin Chen

Bayesian inference is known to provide a general framework for incorporating prior knowledge or specific properties into machine learning models via carefully choosing a prior distribution. In this work, we propose a new type of prior…

Machine Learning · Statistics 2019-02-20 Andrei Atanov , Arsenii Ashukha , Kirill Struminsky , Dmitry Vetrov , Max Welling

A novel variational inference based resampling framework is proposed to evaluate the robustness and generalization capability of deep learning models with respect to distribution shift. We use Auto Encoding Variational Bayes to find a…

Machine Learning · Computer Science 2019-10-29 Xudong Sun , Alexej Gossmann , Yu Wang , Bernd Bischl

Counterfactual explanation is a form of interpretable machine learning that generates perturbations on a sample to achieve the desired outcome. The generated samples can act as instructions to guide end users on how to observe the desired…

Machine Learning · Computer Science 2023-03-28 Tri Dung Duong , Qian Li , Guandong Xu

Stability selection is a versatile framework for structure estimation and variable selection in high-dimensional setting, primarily grounded in frequentist principles. In this paper, we propose an enhanced methodology that integrates…

Methodology · Statistics 2026-05-05 Mahdi Nouraie , Connor Smith , Samuel Muller

Variational Bayes is a popular method for approximate inference but its derivation can be cumbersome. To simplify the process, we give a 3-step recipe to identify the posterior form by explicitly looking for linearity with respect to…

Machine Learning · Computer Science 2023-07-11 Mohammad Emtiyaz Khan

We introduce graph normalizing flows: a new, reversible graph neural network model for prediction and generation. On supervised tasks, graph normalizing flows perform similarly to message passing neural networks, but at a significantly…

Machine Learning · Computer Science 2019-05-31 Jenny Liu , Aviral Kumar , Jimmy Ba , Jamie Kiros , Kevin Swersky

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

Computer vision research has long aimed to build systems that are robust to spatial transformations found in natural data. Traditionally, this is done using data augmentation or hard-coding invariances into the architecture. However, too…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Utkarsh Singhal , Carlos Esteves , Ameesh Makadia , Stella X. Yu

It is well known that deep generative models have a rich latent space, and that it is possible to smoothly manipulate their outputs by traversing this latent space. Recently, architectures have emerged that allow for more complex…

Machine Learning · Computer Science 2019-12-06 Andrew Gambardella , Atılım Güneş Baydin , Philip H. S. Torr

We present an alternative to reweighting techniques for modifying distributions to account for a desired change in an underlying conditional distribution, as is often needed to correct for mis-modelling in a simulated sample. We employ…

High Energy Physics - Phenomenology · Physics 2023-05-01 Malte Algren , Tobias Golling , Manuel Guth , Chris Pollard , John Andrew Raine

Traditional neural networks are simple to train but they typically produce overconfident predictions. In contrast, Bayesian neural networks provide good uncertainty quantification but optimizing them is time consuming due to the large…

Machine Learning · Computer Science 2024-11-07 Yadi Wei , Roni Khardon

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

Normalizing flows are deep generative models that enable efficient likelihood estimation and sampling through invertible transformations. A key challenge is to design linear layers that enhance expressiveness while maintaining efficient…

Machine Learning · Computer Science 2025-11-18 Xuchen Feng , Siyu Liao

We propose a Bayesian neural network-based continual learning algorithm using Variational Inference, aiming to overcome several drawbacks of existing methods. Specifically, in continual learning scenarios, storing network parameters at each…

Machine Learning · Computer Science 2024-11-22 Sanchar Palit , Biplab Banerjee , Subhasis Chaudhuri

We study Bayesian inverse problems with mixed noise, modeled as a combination of additive and multiplicative Gaussian components. While traditional inference methods often assume fixed or known noise characteristics, real-world…

Machine Learning · Computer Science 2025-10-17 Paul Hagemann , Robert Gruhlke , Bernhard Stankewitz , Claudia Schillings , Gabriele Steidl

The standard approach to Bayesian inference is based on the assumption that the distribution of the data belongs to the chosen model class. However, even a small violation of this assumption can have a large impact on the outcome of a…

Methodology · Statistics 2015-06-22 Jeffrey W. Miller , David B. Dunson

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

Gaussian distributions are widely used in Bayesian variational inference to approximate intractable posterior densities, but the ability to accommodate skewness can improve approximation accuracy significantly, when data or prior…

Methodology · Statistics 2025-02-05 Linda S. L. Tan , Aoxiang Chen