English
Related papers

Related papers: Global Well-posedness and Convergence Analysis of …

200 papers

The proposed BSDE-based diffusion model represents a novel approach to diffusion modeling, which extends the application of stochastic differential equations (SDEs) in machine learning. Unlike traditional SDE-based diffusion models, our…

Machine Learning · Computer Science 2023-04-27 Zihao Wang

Score-based generative models (SGMs) is a recent class of deep generative models with state-of-the-art performance in many applications. In this paper, we establish convergence guarantees for a general class of SGMs in 2-Wasserstein…

Machine Learning · Computer Science 2025-02-18 Xuefeng Gao , Hoang M. Nguyen , Lingjiong Zhu

Score-based generative models are shown to achieve remarkable empirical performances in various applications such as image generation and audio synthesis. However, a theoretical understanding of score-based diffusion models is still…

Machine Learning · Computer Science 2022-12-14 Dohyun Kwon , Ying Fan , Kangwook Lee

This paper considers the problem of unconstrained minimization of smooth convex functions having Lipschitz continuous gradients with known Lipschitz constant. We recently proposed an optimized gradient method (OGM) for this problem and…

Optimization and Control · Mathematics 2019-06-14 Donghwan Kim , Jeffrey A. Fessler

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

Statistics Theory · Mathematics 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

We study the problem of estimating the score function of an unknown probability distribution $\rho^*$ from $n$ independent and identically distributed observations in $d$ dimensions. Assuming that $\rho^*$ is subgaussian and has a…

Statistics Theory · Mathematics 2024-06-13 Andre Wibisono , Yihong Wu , Kaylee Yingxi Yang

Through an uncertainty quantification (UQ) perspective, we show that score-based generative models (SGMs) are provably robust to the multiple sources of error in practical implementation. Our primary tool is the Wasserstein uncertainty…

Machine Learning · Statistics 2024-05-27 Nikiforos Mimikos-Stamatopoulos , Benjamin J. Zhang , Markos A. Katsoulakis

Score-based diffusion models have demonstrated outstanding empirical performance in machine learning and artificial intelligence, particularly in generating high-quality new samples from complex probability distributions. Improving the…

Machine Learning · Statistics 2025-05-30 Yuchen Jiao , Gen Li

Score-based generative modeling, implemented through probability flow ODEs, has shown impressive results in numerous practical settings. However, most convergence guarantees rely on restrictive regularity assumptions on the target…

Machine Learning · Statistics 2025-10-21 Gitte Kremling , Francesco Iafrate , Mahsa Taheri , Johannes Lederer

Large-scale nonconvex optimization problems are ubiquitous in modern machine learning, and among practitioners interested in solving them, Stochastic Gradient Descent (SGD) reigns supreme. We revisit the analysis of SGD in the nonconvex…

Optimization and Control · Mathematics 2020-07-27 Ahmed Khaled , Peter Richtárik

Score-based generative models (SGMs) sample from a target distribution by iteratively transforming noise using the score function of the perturbed target. For any finite training set, this score function can be evaluated in closed form, but…

Machine Learning · Computer Science 2025-05-07 Christopher Scarvelis , Haitz Sáez de Ocáriz Borde , Justin Solomon

Score-based generative models (SGMs) have revolutionized the field of generative modeling, achieving unprecedented success in generating realistic and diverse content. Despite empirical advances, the theoretical basis for why optimizing the…

Machine Learning · Computer Science 2024-08-30 Gen Li , Yuling Yan

Distributed optimization plays an important role in modern large-scale machine learning and data processing systems by optimizing the utilization of computational resources. One of the classical and popular approaches is Local Stochastic…

Optimization and Control · Mathematics 2024-12-19 Andrey Sadchikov , Savelii Chezhegov , Aleksandr Beznosikov , Alexander Gasnikov

The paper concerns the sharp boundary regularity estimates in homogenization of Dirichlet problem for Stokes systems. We obtain the Lipschitz estimates for velocity term and $L^\infty$ estimate for pressure term, under some reasonable…

Analysis of PDEs · Mathematics 2016-12-20 Shu Gu , Qiang Xu

Score-based diffusion models have become a foundational paradigm for modern generative modeling, demonstrating exceptional capability in generating samples from complex high-dimensional distributions. Despite the dominant adoption of…

Machine Learning · Computer Science 2025-03-13 Changxiao Cai , Gen Li

Score-based Generative Models (SGMs) have demonstrated remarkable generalization abilities, e.g. generating unseen, but natural data. However, the greater the generalization power, the more likely the unintended generalization, and the more…

Machine Learning · Computer Science 2025-06-27 Wan Jiang , He Wang , Xin Zhang , Dan Guo , Zhaoxin Fan , Yunfeng Diao , Richang Hong

Despite the remarkable empirical success of score-based diffusion models, their statistical guarantees remain underdeveloped. Existing analyses often provide pessimistic convergence rates that do not reflect the intrinsic low-dimensional…

Machine Learning · Statistics 2026-04-24 Saptarshi Chakraborty , Quentin Berthet , Peter L. Bartlett

Score-based diffusion models demonstrate superior performance in generative tasks but encounter fundamental bottlenecks in inverse problems due to the analytical intractability of the time-dependent likelihood score. To bridge this gap, we…

Optimization and Control · Mathematics 2026-05-28 Boyang Zhang , Zhiguo Wang , Ya-Feng Liu

Score-based generative models (SGMs) are a popular family of deep generative models that achieve leading image generation quality. Early studies extend SGMs to tackle class-conditional generation by coupling an unconditional SGM with the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Paul Kuo-Ming Huang , Si-An Chen , Hsuan-Tien Lin

Score-based generative models (SGMs) synthesize new data samples from Gaussian white noise by running a time-reversed Stochastic Differential Equation (SDE) whose drift coefficient depends on some probabilistic score. The discretization of…

Machine Learning · Computer Science 2022-08-11 Florentin Guth , Simon Coste , Valentin De Bortoli , Stephane Mallat