English
Related papers

Related papers: Robust normalizing flows using Bernstein-type poly…

200 papers

The development of safety validation methods is essential for the safe deployment and operation of Automated Driving Systems (ADSs). One of the goals of safety validation is to prospectively evaluate the risk of an ADS dealing with…

Robotics · Computer Science 2025-07-31 Erwin de Gelder , Maren Buermann , Olaf Op den Camp

Unnormalized probability distributions are central to modeling complex physical systems across various scientific domains. Traditional sampling methods, such as Markov Chain Monte Carlo (MCMC), often suffer from slow convergence, critical…

Machine Learning · Computer Science 2025-10-27 Vikas Kanaujia , Vipul Arora

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

Continuous normalizing flows (CNFs) learn an ordinary differential equation to transform prior samples into data. Flow matching (FM) has recently emerged as a simulation-free approach for training CNFs by regressing a velocity model towards…

Machine Learning · Statistics 2024-05-28 Tianyu Xie , Yu Zhu , Longlin Yu , Tong Yang , Ziheng Cheng , Shiyue Zhang , Xiangyu Zhang , Cheng Zhang

We introduce stochastic normalizing flows, an extension of continuous normalizing flows for maximum likelihood estimation and variational inference (VI) using stochastic differential equations (SDEs). Using the theory of rough paths, the…

Machine Learning · Statistics 2020-02-27 Liam Hodgkinson , Chris van der Heide , Fred Roosta , Michael W. Mahoney

Normalizing Flows explicitly maximize a full-dimensional likelihood on the training data. However, real data is typically only supported on a lower-dimensional manifold leading the model to expend significant compute on modeling noise.…

Machine Learning · Computer Science 2024-06-28 Peter Sorrenson , Felix Draxler , Armand Rousselot , Sander Hummerich , Lea Zimmermann , Ullrich Köthe

Normalizing Flows (NF) are powerful likelihood-based generative models that are able to trade off between expressivity and tractability to model complex densities. A now well established research avenue leverages optimal transport (OT) and…

Machine Learning · Computer Science 2023-04-17 Guillaume Morel , Lucas Drumetz , Simon Benaïchouche , Nicolas Courty , François Rousseau

Flow-based methods have demonstrated promising results in addressing the ill-posed nature of super-resolution (SR) by learning the distribution of high-resolution (HR) images with the normalizing flow. However, these methods can only…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Jie-En Yao , Li-Yuan Tsao , Yi-Chen Lo , Roy Tseng , Chia-Che Chang , Chun-Yi Lee

Despite superior performance in many situations, deep neural networks are often vulnerable to adversarial examples and distribution shifts, limiting model generalization ability in real-world applications. To alleviate these problems,…

Machine Learning · Computer Science 2023-02-14 Hoang Phan , Trung Le , Trung Phung , Tuan Anh Bui , Nhat Ho , Dinh Phung

We study image inverse problems with a normalizing flow prior. Our formulation views the solution as the maximum a posteriori estimate of the image conditioned on the measurements. This formulation allows us to use noise models with…

Machine Learning · Computer Science 2021-07-02 Jay Whang , Qi Lei , Alexandros G. Dimakis

Normalizing Flows (NFs) describe a class of models that express a complex target distribution as the composition of a series of bijective transformations over a simpler base distribution. By limiting the space of candidate transformations…

Machine Learning · Computer Science 2023-09-11 Keegan Kelly , Lorena Piedras , Sukrit Rao , David Roth

Normalizing flows are flexible, parameterized distributions that can be used to approximate expectations from intractable distributions via importance sampling. However, current flow-based approaches are limited on challenging targets where…

Machine Learning · Computer Science 2022-03-15 Laurence Illing Midgley , Vincent Stimper , Gregor N. C. Simm , José Miguel Hernández-Lobato

Recently normalizing flows (NFs) have demonstrated state-of-the-art performance on modeling 3D point clouds while allowing sampling with arbitrary resolution at inference time. However, these flow-based models still require long training…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Janis Postels , Mengya Liu , Riccardo Spezialetti , Luc Van Gool , Federico Tombari

To overcome topological constraints and improve the expressiveness of normalizing flow architectures, Wu, K\"ohler and No\'e introduced stochastic normalizing flows which combine deterministic, learnable flow transformations with stochastic…

Machine Learning · Computer Science 2022-12-02 Paul Hagemann , Johannes Hertrich , Gabriele Steidl

Graphs are playing a crucial role in different fields since they are powerful tools to unveil intrinsic relationships among signals. In many scenarios, an accurate graph structure representing signals is not available at all and that…

Machine Learning · Computer Science 2021-05-14 Xiang Zhang , Yinfei Xu , Qinghe Liu , Zhicheng Liu , Jian Lu , Qiao Wang

The scalability of continuous normalizing flows (CNFs) for unbiased Boltzmann sampling remains limited in high-dimensional systems due to the cost of Jacobian-determinant evaluation, which requires $D$ backpropagation passes through the…

Machine Learning · Computer Science 2026-01-30 Xin Peng , Ang Gao

A normalizing flow models a complex probability density as an invertible transformation of a simple base density. Flows based on either coupling or autoregressive transforms both offer exact density evaluation and sampling, but rely on the…

Machine Learning · Statistics 2019-12-03 Conor Durkan , Artur Bekasov , Iain Murray , George Papamakarios

Recent work shows that path gradient estimators for normalizing flows have lower variance compared to standard estimators for variational inference, resulting in improved training. However, they are often prohibitively more expensive from a…

Machine Learning · Computer Science 2024-03-26 Lorenz Vaitl , Ludwig Winkler , Lorenz Richter , Pan Kessel

Although many deep-learning-based super-resolution approaches have been proposed in recent years, because no ground truth is available in the inference stage, few can quantify the errors and uncertainties of the super-resolved results. For…

Image and Video Processing · Electrical Eng. & Systems 2023-08-10 Jingyi Shen , Han-Wei Shen

Normalizing flows are exact-likelihood generative neural networks which approximately transform samples from a simple prior distribution to samples of the probability distribution of interest. Recent work showed that such generative models…

Machine Learning · Statistics 2020-10-27 Jonas Köhler , Leon Klein , Frank Noé