English
Related papers

Related papers: Convergence Properties of Score-Based Models for L…

200 papers

Discrete-time diffusion-based generative models and score matching methods have shown promising results in modeling high-dimensional image data. Recently, Song et al. (2021) show that diffusion processes that transform data into noise can…

Machine Learning · Computer Science 2021-10-01 Chin-Wei Huang , Jae Hyun Lim , Aaron Courville

Inverse problems in granular flows, such as landslides and debris flows, involve estimating material parameters or boundary conditions based on target runout profile. Traditional high-fidelity simulators for these inverse problems are…

Geophysics · Physics 2024-04-29 Yongjin Choi , Krishna Kumar

Generative learning generates high dimensional data based on low dimensional conditions, also called prompts. Therefore, generative learning algorithms are eligible for solving (Bayesian) inverse problems. In this article we compare a…

Machine Learning · Computer Science 2026-02-02 Patrick Krüger , Patrick Materne , Werner Krebs , Hanno Gottschalk

Score-based generative models (SGMs) have emerged as one of the most popular classes of generative models. A substantial body of work now exists on the analysis of SGMs, focusing either on discretization aspects or on their statistical…

Machine Learning · Statistics 2026-02-10 Benjamin Dupuis , Dario Shariatian , Maxime Haddouche , Alain Durmus , Umut Simsekli

In phase retrieval and similar inverse problems, the stability of solutions across different noise levels is crucial for applications. One approach to promote it is using signal priors in a form of a generative model as a regularization, at…

Machine Learning · Statistics 2025-02-04 Selin Aslan , Tristan van Leeuwen , Allard Mosk , Palina Salanevich

Score-based generative models (SGMs) have recently shown promising results for image reconstruction on simulated positron emission tomography (PET) datasets. In this work we have developed and implemented practical methodology for 3D image…

When images are statistically described by a generative model we can use this information to develop optimum techniques for various image restoration problems as inpainting, super-resolution, image coloring, generative model inversion, etc.…

Image and Video Processing · Electrical Eng. & Systems 2020-06-17 Kalliopi Basioti , George V. Moustakides

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

We compute approximate solutions to inverse problems for determining parameters in differential equation models with stochastic data on output quantities. The formulation of the problem and modeling framework define a solution as a…

Numerical Analysis · Mathematics 2014-07-16 Troy Butler , Don Estep , Simon Tavener , Timothy Wildey , Clint Dawson , Lindley Graham

Score-based generative models (SGMs) is a recent class of deep generative models with state-of-the-art performance in many applications. In this paper, we establish convergence guarantees for a general class of SGMs in 2-Wasserstein…

Machine Learning · Computer Science 2025-02-18 Xuefeng Gao , Hoang M. Nguyen , Lingjiong Zhu

Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have…

Machine Learning · Computer Science 2024-06-10 Adrien Carrel

Stochastic gradient method (SGM) has been popularly applied to solve optimization problems with objective that is stochastic or an average of many functions. Most existing works on SGMs assume that the underlying problem is unconstrained or…

Optimization and Control · Mathematics 2019-06-19 Yangyang Xu

Stochastic gradient descent (SGD) and its variants are widely used and highly effective optimization methods in machine learning, especially for neural network training. By using a single datum or a small subset of the data, selected…

Numerical Analysis · Mathematics 2026-01-21 Bangti Jin , Zeljko Kereta , Yuxin Xia

Due to the success of generative flows to model data distributions, they have been explored in inverse problems. Given a pre-trained generative flow, previous work proposed to minimize the 2-norm of the latent variables as a regularization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 José A. Chávez

Score-based generative modeling (SGM) has grown to be a hugely successful method for learning to generate samples from complex data distributions such as that of images and audio. It is based on evolving an SDE that transforms white noise…

Machine Learning · Computer Science 2022-10-04 Holden Lee , Jianfeng Lu , Yixin Tan

Symmetry is ubiquitous in many real-world phenomena and tasks, such as physics, images, and molecular simulations. Empirical studies have demonstrated that incorporating symmetries into generative models can provide better generalization…

Machine Learning · Statistics 2026-05-12 Ziyu Chen , Markos A. Katsoulakis , Benjamin J. Zhang

Score-based generative models (SGMs) need to approximate the scores $\nabla \log p_t$ of the intermediate distributions as well as the final distribution $p_T$ of the forward process. The theoretical underpinnings of the effects of these…

Machine Learning · Statistics 2022-10-18 Jakiw Pidstrigach

Solving inverse problems -- recovering signals from incomplete or noisy measurements -- is fundamental in science and engineering. Score-based generative models (SGMs) have recently emerged as a powerful framework for this task. Two main…

Machine Learning · Computer Science 2025-10-27 Bartlomiej Sobieski , Matthew Tivnan , Yuang Wang , Siyeop Yoon , Pengfei Jin , Dufan Wu , Quanzheng Li , Przemyslaw Biecek

Gradient-based methods are widely used to solve various optimization problems, however, they are either constrained by local optima dilemmas, simple convex constraints, and continuous differentiability requirements, or limited to…

Machine Learning · Computer Science 2026-03-19 Ming Li

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

Computational Engineering, Finance, and Science · Computer Science 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy