English
Related papers

Related papers: Preconditioned training of normalizing flows for v…

200 papers

Offline reinforcement learning aims to train a policy on a pre-recorded and fixed dataset without any additional environment interactions. There are two major challenges in this setting: (1) extrapolation error caused by approximating the…

Machine Learning · Computer Science 2023-01-31 Dmitriy Akimov , Vladislav Kurenkov , Alexander Nikulin , Denis Tarasov , Sergey Kolesnikov

Diffusion models (DMs) have emerged as powerful generative models for solving inverse problems, offering a good approximation of prior distributions of real-world image data. Typically, diffusion models rely on large-scale clean signals to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yifei Wang , Weimin Bai , Weijian Luo , Wenzheng Chen , He Sun

Full Waveform Inversion (FWI) is a technique employed to attain a high resolution subsurface velocity model. However, FWI results are effected by the limited illumination of the model domain and the quality of that illumination, which is…

Geophysics · Physics 2024-08-20 Lingyun Yang , Omar M. Saad , Guochen Wu , Tariq Alkhalifah

Data-carving methods perform selective inference by conditioning the distribution of data on the observed selection event. However, existing data-carving approaches typically require an analytically tractable characterization of the…

Methodology · Statistics 2025-06-03 Sifan Liu , Snigdha Panigrahi

Sampling from unnormalized densities is analogous to the generative modeling problem, but the target distribution is defined by a known energy function instead of data samples. Because evaluating the energy function is often costly, a…

Machine Learning · Computer Science 2026-05-06 Aaron Havens , Brian Karrer , Neta Shaul

Motivated by applications in conditional sampling, given a probability measure $\mu$ and a diffeomorphism $\phi$, we consider the problem of simultaneously approximating $\phi$ and the pushforward $\phi_{\#}\mu$ by means of the flow of a…

Optimization and Control · Mathematics 2026-05-13 Borjan Geshkovski , Domènec Ruiz-Balet

Imaging inverse problems are commonly addressed by minimizing measurement consistency and signal prior terms. While huge attention has been paid to developing high-performance priors, even the most advanced signal prior may lose its…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Romario Gualdrón-Hurtado , Roman Jacome , Leon Suarez , Laura Galvis , Henry Arguello

Pre-trained Transformers are now ubiquitous in natural language processing, but despite their high end-task performance, little is known empirically about whether they are calibrated. Specifically, do these models' posterior probabilities…

Computation and Language · Computer Science 2020-10-16 Shrey Desai , Greg Durrett

Normalizing flows model a complex target distribution in terms of a bijective transform operating on a simple base distribution. As such, they enable tractable computation of a number of important statistical quantities, particularly…

Machine Learning · Computer Science 2022-09-01 Chandramouli Shama Sastry , Andreas Lehrmann , Marcus Brubaker , Alexander Radovic

Solving inverse problems requires the knowledge of the forward operator, but accurate models can be computationally expensive and hence cheaper variants that do not compromise the reconstruction quality are desired. This chapter reviews…

Numerical Analysis · Mathematics 2024-03-19 Simon Arridge , Andreas Hauptmann , Yury Korolev

Consistency distillation is a prevalent way for accelerating diffusion models adopted in consistency (trajectory) models, in which a student model is trained to traverse backward on the probability flow (PF) ordinary differential equation…

Machine Learning · Computer Science 2025-05-01 Kaiwen Zheng , Guande He , Jianfei Chen , Fan Bao , Jun Zhu

Foundation models have demonstrated remarkable performance across modalities such as language and vision. However, model reuse across distinct modalities (e.g., text and vision) remains limited due to the difficulty of aligning internal…

Machine Learning · Computer Science 2025-05-20 Ali Gholamzadeh , Noor Sajid

Generative models excel at synthesizing high-fidelity samples from complex data distributions, but they often violate hard constraints arising from physical laws or task specifications. A common remedy is to project intermediate samples…

Machine Learning · Computer Science 2025-09-30 Jinhao Liang , Yixuan Sun , Anirban Samaddar , Sandeep Madireddy , Ferdinando Fioretto

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

Prior flow matching methods in robotics have primarily learned velocity fields to morph one distribution of trajectories into another. In this work, we extend flow matching to capture second-order trajectory dynamics, incorporating…

Robotics · Computer Science 2025-03-11 Khang Nguyen , An T. Le , Tien Pham , Manfred Huber , Jan Peters , Minh Nhat Vu

We introduce a new paradigm for generative modeling built on Continuous Normalizing Flows (CNFs), allowing us to train CNFs at unprecedented scale. Specifically, we present the notion of Flow Matching (FM), a simulation-free approach for…

Machine Learning · Computer Science 2023-02-09 Yaron Lipman , Ricky T. Q. Chen , Heli Ben-Hamu , Maximilian Nickel , Matt Le

Normalizing flows are a powerful tool for generative modelling, density estimation and posterior reconstruction in Bayesian inverse problems. In this paper, we introduce proximal residual flows, a new architecture of normalizing flows.…

Machine Learning · Computer Science 2023-05-19 Johannes Hertrich

A normalizing flow is an invertible mapping between an arbitrary probability distribution and a standard normal distribution; it can be used for density estimation and statistical inference. Computing the flow follows the change of…

Machine Learning · Computer Science 2021-12-10 Derek Onken , Samy Wu Fung , Xingjian Li , Lars Ruthotto

Flow-based generative modeling is a powerful tool for solving inverse problems in physical sciences that can be used for sampling and likelihood evaluation with much lower inference times than traditional methods. We propose to refine flows…

Machine Learning · Computer Science 2024-10-31 Benjamin Holzschuh , Nils Thuerey

We introduce an ordinary differential equation (ODE) based deep generative method for learning conditional distributions, named Conditional F\"ollmer Flow. Starting from a standard Gaussian distribution, the proposed flow could approximate…

Machine Learning · Statistics 2025-10-14 Jinyuan Chang , Zhao Ding , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang