English
Related papers

Related papers: ODE-DPS: ODE-based Diffusion Posterior Sampling fo…

200 papers

Diffusion models can generate a variety of high-quality images by modeling complex data distributions. Trained diffusion models can also be very effective image priors for solving inverse problems. Most of the existing diffusion-based…

Image and Video Processing · Electrical Eng. & Systems 2025-09-01 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

Optimizing over the stationary distribution of stochastic differential equations (SDEs) is computationally challenging. A new forward propagation algorithm has been recently proposed for the online optimization of SDEs. The algorithm solves…

Probability · Mathematics 2022-07-12 Ziheng Wang , Justin Sirignano

Probabilistic ordinary differential equation (ODE) solvers have been introduced over the past decade as uncertainty-aware numerical integrators. They typically proceed by assuming a functional prior to the ODE solution, which is then…

Numerical Analysis · Mathematics 2025-03-25 Yvann Le Fay , Simo Särkkä , Adrien Corenflos

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

Probability · Mathematics 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

The traditional approach of hand-crafting priors (such as sparsity) for solving inverse problems is slowly being replaced by the use of richer learned priors (such as those modeled by deep generative networks). In this work, we study the…

Machine Learning · Computer Science 2021-05-14 Viraj Shah , Rakib Hyder , M. Salman Asif , Chinmay Hegde

Recent years have witnessed significant progress in developing effective training and fast sampling techniques for diffusion models. A remarkable advancement is the use of stochastic differential equations (SDEs) and their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Defang Chen , Zhenyu Zhou , Jian-Ping Mei , Chunhua Shen , Chun Chen , Can Wang

Simulating the time evolution of Partial Differential Equations (PDEs) of large-scale systems is crucial in many scientific and engineering domains such as fluid dynamics, weather forecasting and their inverse optimization problems.…

Machine Learning · Computer Science 2022-10-13 Tailin Wu , Takashi Maruyama , Jure Leskovec

Neural networks have emerged as promising tools for solving partial differential equations (PDEs), particularly through the application of neural operators. Training neural operators typically requires a large amount of training data to…

Machine Learning · Computer Science 2025-01-27 Chaoyu Liu , Chris Budd , Carola-Bibiane Schönlieb

High-dimensional Partial Differential Equations (PDEs) are a popular mathematical modelling tool, with applications ranging from finance to computational chemistry. However, standard numerical techniques for solving these PDEs are typically…

Numerical Analysis · Mathematics 2023-11-22 Weiqi Wang , Simone Brugiapaglia

We consider a class of inverse problems where it is possible to aggregate the results of multiple experiments. This class includes problems where the forward model is the solution operator to linear ODEs or PDEs. The tremendous size of such…

Computational Engineering, Finance, and Science · Computer Science 2018-08-23 Aleksandr Aravkin , Michael P. Friedlander , Tristan van Leeuwen

We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as…

Machine Learning · Computer Science 2023-10-24 Yanfang Liu , Minglei Yang , Zezhong Zhang , Feng Bao , Yanzhao Cao , Guannan Zhang

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of…

Instrumentation and Methods for Astrophysics · Physics 2025-02-11 Gabriel Missael Barco , Alexandre Adam , Connor Stone , Yashar Hezaveh , Laurence Perreault-Levasseur

Beyond estimating parameters of interest from data, one of the key goals of statistical inference is to properly quantify uncertainty in these estimates. In Bayesian inference, this uncertainty is provided by the posterior distribution, the…

Machine Learning · Computer Science 2025-01-03 Daniela de Albuquerque , John Pearson

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala

The inverse diffusion curve problem focuses on automatic creation of diffusion curve images that resemble user provided color fields. This problem is challenging since the 1D curves have a nonlinear and global impact on resulting color…

Graphics · Computer Science 2016-10-11 Shuang Zhao , Fredo Durand , Changxi Zheng

We propose a new Neural Galerkin Normalizing Flow framework to approximate the transition probability density function of a diffusion process by solving the corresponding Fokker-Planck equation with an atomic initial distribution,…

Machine Learning · Computer Science 2026-03-20 Riccardo Saporiti , Fabio Nobile

Current strategies for solving image-based inverse problems apply latent diffusion models to perform posterior sampling.However, almost all approaches make no explicit attempt to explore the solution space, instead drawing only a single…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Amir Nazemi , Mohammad Hadi Sepanj , Nicholas Pellegrino , Chris Czarnecki , Paul Fieguth

Diffusion-based generative processes, formulated as differential equation solving, frequently balance computational speed with sample quality. Our theoretical investigation of ODE- and SDE-based solvers reveals complementary weaknesses: ODE…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Ruoyu Wang , Beier Zhu , Junzhi Li , Liangyu Yuan , Chi Zhang

Abstract Diffusion models have recently gained prominence as a novel category of generative models. Despite their success, these models face a notable drawback in terms of slow sampling speeds, requiring a high number of function…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Sanghwan Kim , Hao Tang , Fisher Yu

Ordinary differential equations (ODEs) are widely used to describe dynamical systems in science, but identifying parameters that explain experimental measurements is challenging. In particular, although ODEs are differentiable and would…

Machine Learning · Computer Science 2024-07-22 Jonas Beck , Nathanael Bosch , Michael Deistler , Kyra L. Kadhim , Jakob H. Macke , Philipp Hennig , Philipp Berens