English
Related papers

Related papers: Convergence Analysis for General Probability Flow …

200 papers

We study a system of two continuity equations with nonlocal velocity fields using interaction potentials of both attractive and repulsive Morse type. Such a system is of interest in many contexts in multi-population modelling. We prove…

Analysis of PDEs · Mathematics 2024-06-28 Marco Di Francesco , Valeria Iorio

We consider sampling from a Gibbs distribution by evolving a finite number of particles using a particular score estimator rather than Brownian motion. To accelerate the particles, we consider a second-order score-based ODE, similar to…

Machine Learning · Statistics 2026-01-19 Hong Ye Tan , Stanley Osher , Wuchen Li

Diffusion-based generative models use stochastic differential equations (SDEs) and their equivalent ordinary differential equations (ODEs) to establish a smooth connection between a complex data distribution and a tractable prior…

Machine Learning · Computer Science 2024-08-25 Defang Chen , Zhenyu Zhou , Can Wang , Chunhua Shen , Siwei Lyu

Several issues in machine learning and inverse problems require to generate discrete data, as if sampled from a model probability distribution. A common way to do so relies on the construction of a uniform probability distribution over a…

Optimization and Control · Mathematics 2021-06-16 Quentin Merigot , Filippo Santambrogio , Clément Sarrazin

In this paper, for $\mu$ and $\nu$ two probability measures on $\mathbb{R}^d$ with finite moments of order $\rho\ge 1$, we define the respective projections for the $W_\rho$-Wasserstein distance of $\mu$ and $\nu$ on the sets of probability…

Probability · Mathematics 2019-02-11 Aurélien Alfonsi , Jacopo Corbetta , Benjamin Jourdain

Despite the widespread adoption of deterministic samplers in diffusion models (DMs), their potential limitations remain largely unexplored. In this paper, we identify collapse errors, a previously unrecognized phenomenon in ODE-based…

Machine Learning · Computer Science 2025-08-25 Yi Zhang , Zhenyu Liao , Jingfeng Wu , Difan Zou

In this paper, we obtain quantitative, non-asymptotic, and data-dependent \textit{Bernstein-von Mises type} bounds on the normal approximation of the posterior distribution in exponential family models with arbitrary centring and scaling.…

Statistics Theory · Mathematics 2025-01-14 Adrian Fischer , Robert E. Gaunt , Gesine Reinert , Yvik Swan

In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired…

Numerical Analysis · Mathematics 2024-04-23 Enze Jiang , Jishen Peng , Zheng Ma , Xiong-Bin Yan

Deep neural networks achieve superior performance in semantic segmentation, but are limited to a predefined set of classes, which leads to failures when they encounter unknown objects in open-world scenarios. Recognizing and segmenting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Arnold Brosch , Abdelrahman Eldesokey , Michael Felsberg , Kira Maag

We develop a general framework for statistical inference with the 1-Wasserstein distance. Recently, the Wasserstein distance has attracted considerable attention and has been widely applied to various machine learning tasks because of its…

Statistics Theory · Mathematics 2022-02-16 Masaaki Imaizumi , Hirofumi Ota , Takuo Hamaguchi

Flow matching (FM) has gained significant attention as a simulation-free generative model. Unlike diffusion models, which are based on stochastic differential equations, FM employs a simpler approach by solving an ordinary differential…

Machine Learning · Computer Science 2024-10-14 Kenji Fukumizu , Taiji Suzuki , Noboru Isobe , Kazusato Oko , Masanori Koyama

Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error…

Statistics Theory · Mathematics 2026-05-27 Zhengyan Wan , Yidong Ouyang , Qiang Yao , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

We consider the 2-dimensional random matching problem in $\mathbb{R}^2.$ In a challenging paper, Caracciolo et. al. arXiv:1402.6993 on the basis of a subtle linearization of the Monge Ampere equation, conjectured that the expected value of…

Mathematical Physics · Physics 2020-08-26 Dario Benedetto , Emanuele Caglioti

Schr\"{o}dinger-F\"{o}llmer sampler (SFS) is a novel and efficient approach for sampling from possibly unnormalized distributions without ergodicity. SFS is based on the Euler-Maruyama discretization of Schr\"{o}dinger-F\"{o}llmer diffusion…

Computation · Statistics 2021-07-13 Yuling Jiao , Lican Kang , Yanyan Liu , Youzhou Zhou

We present algorithms for diffusion model sampling which obtain $\delta$-error in $\mathrm{polylog}(1/\delta)$ steps, given access to $\widetilde O(\delta)$-accurate score estimates in $L^2$. This is an exponential improvement over all…

Machine Learning · Computer Science 2026-04-28 Fan Chen , Sinho Chewi , Constantinos Daskalakis , Alexander Rakhlin

Assuming that a reflected Ornstein-Uhlenbeck state process is observed at discrete time instants, we propose generalized moment estimators to estimate all drift and diffusion parameters via the celebrated ergodic theorem. With the sampling…

Statistics Theory · Mathematics 2020-09-14 Yaozhong Hu , Yuejuan Xi

We study stochastic gradient descent {\em without replacement} (\sgdwor) for smooth convex functions. \sgdwor is widely observed to converge faster than true \sgd where each sample is drawn independently {\em with replacement}…

Optimization and Control · Mathematics 2020-02-28 Prateek Jain , Dheeraj Nagaraj , Praneeth Netrapalli

A method for analyzing non-asymptotic guarantees of numerical discretizations of ergodic SDEs in Wasserstein-2 distance is presented by Sanz-Serna and Zygalakis in ``Wasserstein distance estimates for the distributions of numerical…

Machine Learning · Statistics 2024-12-03 Daniel Paulin , Peter A. Whalley

We study a system of drift-diffusion PDEs for a potentially infinite number of incompressible phases, subject to a joint pointwise volume constraint. Our analysis is based on the interpretation as a collection of coupled Wasserstein…

Analysis of PDEs · Mathematics 2024-11-22 Clément Cancès , Daniel Matthes , Ismael Medina , Bernhard Schmitzer

Over the past fifteen years, the theory of Wasserstein gradient flows of convex (or, more generally, semiconvex) energies has led to advances in several areas of partial differential equations and analysis. In this work, we extend the…

Analysis of PDEs · Mathematics 2017-05-04 Katy Craig