English
Related papers

Related papers: Ensemble Kalman Diffusion Guidance: A Derivative-f…

200 papers

Diffusion models have emerged as powerful learned priors for solving inverse problems. However, current iterative solving approaches which alternate between diffusion sampling and data consistency steps typically require hundreds or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Minwoo Kim , Hongki Lim

Denoising-based generative models, particularly diffusion and flow matching algorithms, have achieved remarkable success. However, aligning their output distributions with complex downstream objectives, such as human preferences,…

Machine Learning · Computer Science 2025-08-29 Luozhijie Jin , Zijie Qiu , Jie Liu , Zijie Diao , Lifeng Qiao , Ning Ding , Alex Lamb , Xipeng Qiu

The choice of prior is central to solving ill-posed imaging inverse problems, making it essential to select one consistent with the measurements $y$ to avoid severe bias. In Bayesian inverse problems, this could be achieved by evaluating…

Machine Learning · Computer Science 2026-05-01 Frederic Wang , Katherine L. Bouman

This work introduces a new, distributed implementation of the Ensemble Kalman Filter (EnKF) that allows for non-sequential assimilation of large datasets in high-dimensional problems. The traditional EnKF algorithm is computationally…

Machine Learning · Statistics 2023-11-23 Cédric Travelletti , Jörg Franke , David Ginsbourger , Stefan Brönnimann

Diffusion models have emerged as a formidable tool for training-free conditional generation.However, a key hurdle in inference-time guidance techniques is the need for compute-heavy backpropagation through the diffusion network for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Nithin Gopalakrishnan Nair , Vishal M Patel

Solving inverse problems continues to be a challenge in a wide array of applications ranging from deblurring, image inpainting, source separation etc. Most existing techniques solve such inverse problems by either explicitly or implicitly…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Rushil Anirudh , Jayaraman J. Thiagarajan , Bhavya Kailkhura , Timo Bremer

The use of ensemble methods to solve inverse problems is attractive because it is a derivative-free methodology which is also well-adapted to parallelization. In its basic iterative form the method produces an ensemble of solutions which…

Numerical Analysis · Mathematics 2018-05-09 Neil K. Chada , Marco A. Iglesias , Lassi Roininen , Andrew M. Stuart

Diffusion models have shown tremendous results in image generation. However, due to the iterative nature of the diffusion process and its reliance on classifier-free guidance, inference times are slow. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yi-Ting Hsiao , Siavash Khodadadeh , Kevin Duarte , Wei-An Lin , Hui Qu , Mingi Kwon , Ratheesh Kalarot

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here we explore another promising solution in which diffusion models are used to…

Mathematical Physics · Physics 2024-04-02 Feng Bao , Hristo G. Chipilski , Siming Liang , Guannan Zhang , Jeffrey S. Whitaker

Recovering high-dimensional signals from corrupted measurements is a central challenge in inverse problems. Recent advances in generative diffusion models have shown remarkable empirical success in providing strong data-driven priors, but…

Machine Learning · Computer Science 2025-09-26 Oscar Leong , Yann Traonmilin

We introduce a new multivariate statistical problem that we refer to as the Ensemble Inverse Problem (EIP). The aim of EIP is to invert for an ensemble that is distributed according to the pushforward of a prior under a forward process. In…

Machine Learning · Computer Science 2026-01-30 Zhengyan Huan , Camila Pazos , Martin Klassen , Vincent Croft , Pierre-Hugues Beauchemin , Shuchin Aeron

This paper investigates ensemble Kalman inversion (EKI) for variational inverse problems with convex, potentially non-smooth regularization. While deterministic EKI and its Tikhonov-regularized variants have primarily been analyzed for…

Numerical Analysis · Mathematics 2026-03-24 Simon Weissmann

Inverse problems aim to determine parameters from observations, a crucial task in engineering and science. Lately, generative models, especially diffusion models, have gained popularity in this area for their ability to produce realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Gabriel della Maggiora , Luis Alberto Croquevielle , Nikita Deshpande , Harry Horsley , Thomas Heinis , Artur Yakimovich

Frequency-domain electromagnetic (FDEM) data of the subsurface are determined by electrical conductivity and magnetic susceptibility. We apply a Kalman Ensemble generator (KEG) to one-dimensional probabilistic multi-layer inversion of FDEM…

This tutorial provides an in-depth guide on inference-time guidance and alignment methods for optimizing downstream reward functions in diffusion models. While diffusion models are renowned for their generative modeling capabilities,…

Artificial Intelligence · Computer Science 2025-01-22 Masatoshi Uehara , Yulai Zhao , Chenyu Wang , Xiner Li , Aviv Regev , Sergey Levine , Tommaso Biancalani

Diffusion models have demonstrated exceptional ability in modeling complex image distributions, making them versatile plug-and-play priors for solving imaging inverse problems. However, their reliance on large-scale clean datasets for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Weimin Bai , Weiheng Tang , Enze Ye , Siyi Chen , Wenzheng Chen , He Sun

The task of dynamic flow estimation is to construct an approximation of an evolving flow---and particularly, its response to disturbances---using measurements from available sensors. Building from previous work by Darakananda et al.~(Phys…

Fluid Dynamics · Physics 2021-05-19 Mathieu Le Provost , Jeff D. Eldredge

The Ensemble Kalman Filter (EnKF), as a fundamental data assimilation approach, has been widely used in many fields of the sciences and engineering. When the state variable is of high dimensional accompanied with high resolution…

Methodology · Statistics 2025-09-18 Shouxia Wang , Hao-Xuan Sun , Song Xi Chen

Diffusion models have recently shown considerable potential in solving Bayesian inverse problems when used as priors. However, sampling from the resulting denoising posterior distributions remains a challenge as it involves intractable…

Machine Learning · Statistics 2024-12-25 Badr Moufad , Yazid Janati , Lisa Bedin , Alain Durmus , Randal Douc , Eric Moulines , Jimmy Olsson

Diffusion models have recently gained prominence in offline reinforcement learning due to their ability to effectively learn high-performing, generalizable policies from static datasets. Diffusion-based planners facilitate long-horizon…

Machine Learning · Computer Science 2025-10-27 Donghyeon Ki , JunHyeok Oh , Seong-Woong Shim , Byung-Jun Lee