English
Related papers

Related papers: Proximal Residual Flows for Bayesian Inverse Probl…

200 papers

Learning probabilistic surrogates for partial differential equations remains challenging in data-scarce regimes: neural operators require large amounts of high-fidelity data, while generative approaches typically sacrifice resolution…

Computation · Statistics 2025-12-18 Sahil Bhola , Karthik Duraisamy

This paper discusses basic results and recent developments on variational regularization methods, as developed for inverse problems. In a typical setup we review basic properties needed to obtain a convergent regularization scheme and…

Machine Learning · Computer Science 2021-12-10 Martin Burger

Normalizing flows transform a simple base distribution into a complex target distribution and have proved to be powerful models for data generation and density estimation. In this work, we propose a novel type of normalizing flow driven by…

Machine Learning · Computer Science 2021-07-14 Ruizhi Deng , Bo Chang , Marcus A. Brubaker , Greg Mori , Andreas Lehrmann

Challenges in multi-fidelity modeling relate to accuracy, uncertainty estimation and high-dimensionality. A novel additive structure is introduced in which the highest fidelity solution is written as a sum of the lowest fidelity solution…

Machine Learning · Computer Science 2021-04-09 Wei W. Xing , Akeel A. Shah , Peng Wang , Shandian Zhe Qian Fu , Robert. M. Kirby

Through examples of coordinate and probability transformation between different distributions, the basic principle of normalizing flow is introduced in a simple and concise manner. From the perspective of the distribution of random variable…

Machine Learning · Computer Science 2024-01-22 Hongjun Zhang

Recent work demonstrated that flow-based invertible neural networks are promising tools for solving ambiguous inverse problems. Following up on this, we investigate how ten invertible architectures and related models fare on two intuitive,…

Machine Learning · Computer Science 2021-06-23 Jakob Kruse , Lynton Ardizzone , Carsten Rother , Ullrich Köthe

Estimating the parameters of mathematical models is a common problem in almost all branches of science. However, this problem can prove notably difficult when processes and model descriptions become increasingly complex and an explicit…

Machine Learning · Statistics 2024-02-09 Stefan T. Radev , Ulf K. Mertens , Andreas Voss , Lynton Ardizzone , Ullrich Köthe

Normalising flows are tractable probabilistic models that leverage the power of deep learning to describe a wide parametric family of distributions, all while remaining trainable using maximum likelihood. We discuss how these methods can be…

Machine Learning · Computer Science 2020-07-14 Simon Alexanderson , Gustav Eje Henter

Regularization methods are a key tool in the solution of inverse problems. They are used to introduce prior knowledge and make the approximation of ill-posed (pseudo-)inverses feasible. In the last two decades interest has shifted from…

Numerical Analysis · Mathematics 2018-01-31 Martin Benning , Martin Burger

This review provides an introduction to - and overview of - the current state of the art in neural-network based regularization methods for inverse problems in imaging. It aims to introduce readers with a solid knowledge in applied…

Optimization and Control · Mathematics 2023-12-25 Andreas Habring , Martin Holler

We propose an approach for improving sequence modeling based on autoregressive normalizing flows. Each autoregressive transform, acting across time, serves as a moving frame of reference, removing temporal correlations, and simplifying the…

Machine Learning · Computer Science 2022-03-09 Joseph Marino , Lei Chen , Jiawei He , Stephan Mandt

Differentiable particle filters provide a flexible mechanism to adaptively train dynamic and measurement models by learning from observed data. However, most existing differentiable particle filters are within the bootstrap particle…

Artificial Intelligence · Computer Science 2021-11-11 Xiongjie Chen , Hao Wen , Yunpeng Li

Normalizing Flows provide a principled framework for high-dimensional density estimation and generative modeling by constructing invertible transformations with tractable Jacobian determinants. We propose Fractal Flow, a novel normalizing…

Machine Learning · Statistics 2025-08-28 Binhui Zhang , Jianwei Ma

Neural posterior estimation (NPE), a simulation-based computational approach for Bayesian inference, has shown great success in approximating complex posterior distributions. Existing NPE methods typically rely on normalizing flows, which…

Machine Learning · Statistics 2025-03-14 Tianyu Chen , Vansh Bansal , James G. Scott

Normalizing flows are diffeomorphic, typically dimension-preserving, models trained using the likelihood of the model. We use the SurVAE framework to construct dimension reducing surjective flows via a new layer, known as the funnel. We…

Machine Learning · Computer Science 2021-12-16 Samuel Klein , John A. Raine , Sebastian Pina-Otey , Slava Voloshynovskiy , Tobias Golling

A generative model based on a continuous-time normalizing flow between any pair of base and target probability densities is proposed. The velocity field of this flow is inferred from the probability current of a time-dependent density that…

Machine Learning · Computer Science 2023-03-10 Michael S. Albergo , Eric Vanden-Eijnden

This work presents mixed variational flows (MixFlows), a new variational family that consists of a mixture of repeated applications of a map to an initial reference distribution. First, we provide efficient algorithms for i.i.d. sampling,…

Machine Learning · Statistics 2025-06-03 Zuheng Xu , Naitong Chen , Trevor Campbell

Learning neural networks using only few available information is an important ongoing research topic with tremendous potential for applications. In this paper, we introduce a powerful regularizer for the variational modeling of inverse…

Machine Learning · Computer Science 2023-05-17 Fabian Altekrüger , Alexander Denker , Paul Hagemann , Johannes Hertrich , Peter Maass , Gabriele Steidl

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson