English
Related papers

Related papers: On the expressivity of bi-Lipschitz normalizing fl…

200 papers

We consider the regular Lagrangian flow X associated to a bounded divergence-free vector field b with bounded variation. We prove a Lusin-Lipschitz regularity result for X and we show that the Lipschitz constant grows at most linearly in…

Analysis of PDEs · Mathematics 2021-12-20 Paolo Bonicatto , Elio Marconi

We study the stability of two-fluid flow through a plane channel at Reynolds numbers of a hundred to a thousand in the linear and nonlinear regimes. The two fluids have the same density but different viscosities. The fluids, when miscible,…

Fluid Dynamics · Physics 2021-01-27 Kirti Chandra Sahu , Rama Govindarajan

Variational inference relies on flexible approximate posterior distributions. Normalizing flows provide a general recipe to construct flexible variational posteriors. We introduce Sylvester normalizing flows, which can be seen as a…

Machine Learning · Statistics 2019-02-21 Rianne van den Berg , Leonard Hasenclever , Jakub M. Tomczak , Max Welling

This manuscript bridges nonparametric smoothness-based and shape-restricted estimation, which may appear as two disjoint paradigms in the field. The proposed approach is motivated by a conceptually simple observation: every Lipschitz…

Methodology · Statistics 2026-05-22 Kenta Takatsu , Tianyu Zhang , Arun Kumar Kuchibhotla

Normalizing flows are powerful non-parametric statistical models that function as a hybrid between density estimators and generative models. Current learning algorithms for normalizing flows assume that data points are sampled…

Machine Learning · Computer Science 2023-05-31 Matthias Kirchler , Christoph Lippert , Marius Kloft

Normalizing flows are invertible neural networks with tractable change-of-volume terms, which allow optimization of their parameters to be efficiently performed via maximum likelihood. However, data of interest are typically assumed to live…

Machine Learning · Statistics 2021-11-04 Anthony L. Caterini , Gabriel Loaiza-Ganem , Geoff Pleiss , John P. Cunningham

We introduce a method for reconstructing an infinitesimal normalizing flow given only an infinitesimal change to a (possibly unnormalized) probability distribution. This reverses the conventional task of normalizing flows -- rather than…

Machine Learning · Statistics 2020-12-04 David Pfau , Danilo Rezende

The two key characteristics of a normalizing flow is that it is invertible (in particular, dimension preserving) and that it monitors the amount by which it changes the likelihood of data points as samples are propagated along the network.…

Machine Learning · Computer Science 2023-01-27 Bálint Máté , Samuel Klein , Tobias Golling , François Fleuret

In many scientific applications, the target probability distribution cannot be evaluated in closed form or sampled from directly. Instead, it can often be decomposed into multiple components, some of which are accessible only through…

Methodology · Statistics 2026-03-10 Roxana Darvishi , David C. Stenning , Ted von Hippel , Owen G. Ward

We establish existence of steepest descent curves emanating from almost every point of a regular locally Lipschitz quasiconvex functions, where regularity means that the sweeping process flow induced by the sublevel sets is reversible. We…

Optimization and Control · Mathematics 2024-07-19 Aris Daniilidis , David Salas

Despite their advantages, normalizing flows generally suffer from several shortcomings including their tendency to generate unrealistic data (e.g., images) and their failing to detect out-of-distribution data. One reason for these…

Machine Learning · Statistics 2022-07-13 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

Modeling real-world distributions can often be challenging due to sample data that are subjected to perturbations, e.g., instrumentation errors, or added random noise. Since flow models are typically nonlinear algorithms, they amplify these…

Machine Learning · Computer Science 2022-10-11 Sameera Ramasinghe , Kasun Fernando , Salman Khan , Nick Barnes

We present a novel theoretical framework for understanding the expressive power of normalizing flows. Despite their prevalence in scientific applications, a comprehensive understanding of flows remains elusive due to their restricted…

Machine Learning · Computer Science 2025-01-30 Felix Draxler , Stefan Wahl , Christoph Schnörr , Ullrich Köthe

Performative prediction is a framework for learning models that influence the data they intend to predict. We focus on finding classifiers that are performatively stable, i.e. optimal for the data distribution they induce. Standard…

Machine Learning · Computer Science 2025-02-07 Mehrnaz Mofakhami , Ioannis Mitliagkas , Gauthier Gidel

ResNets constrained to be bi-Lipschitz, that is, approximately distance preserving, have been a crucial component of recently proposed techniques for deterministic uncertainty quantification in neural models. We show that theoretical…

Machine Learning · Computer Science 2021-06-18 Lewis Smith , Joost van Amersfoort , Haiwen Huang , Stephen Roberts , Yarin Gal

This paper examines the asymptotic convergence properties of Lipschitz interpolation methods within the context of bounded stochastic noise. In the first part of the paper, we establish probabilistic consistency guarantees of the classical…

Optimization and Control · Mathematics 2023-10-12 Julien Walden Huang , Stephen Roberts , Jan-Peter Calliess

Existing machine learning methods for causal inference usually estimate quantities expressed via the mean of potential outcomes (e.g., average treatment effect). However, such quantities do not capture the full information about the…

Machine Learning · Computer Science 2023-06-21 Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

We are concerned with the two-dimensional steady supersonic reacting Euler flow past Lipschitz bending walls that are small perturbations of a convex one, and establish the existence of global entropy solutions when the total variation of…

Analysis of PDEs · Mathematics 2016-11-15 Gui-Qiang Chen , Jie Kuang , Yongqian Zhang

Ptychography, as an essential tool for high-resolution and nondestructive material characterization, presents a challenging large-scale nonlinear and non-convex inverse problem; however, its intrinsic photon statistics create clear…

Machine Learning · Statistics 2021-11-02 Agnimitra Dasgupta , Zichao Wendy Di

The Lipschitz constant is an important quantity that arises in analysing the convergence of gradient-based optimization methods. It is generally unclear how to estimate the Lipschitz constant of a complex model. Thus, this paper studies an…

Machine Learning · Statistics 2023-02-10 Calypso Herrera , Florian Krach , Josef Teichmann