English
Related papers

Related papers: Theory and Algorithms for Diffusion Processes on R…

200 papers

This study addresses the inverse problem of parameter estimation for Stochastic Differential Equations (SDEs) by minimizing a regularized discrepancy functional via Stochastic Gradient Descent (SGD). To achieve computational efficiency, we…

Machine Learning · Statistics 2026-03-31 Francisco Delgado-Vences , José Julián Pavón-Español , Arelly Ornelas

We propose Riemannian Denoising Diffusion Probabilistic Models (RDDPMs) for learning distributions on submanifolds of Euclidean space that are level sets of functions, including most of the manifolds relevant to applications. Existing…

Machine Learning · Computer Science 2026-02-17 Zichen Liu , Wei Zhang , Christof Schütte , Tiejun Li

Orthogonality constrained optimization is widely used in applications from science and engineering. Due to the nonconvex orthogonality constraints, many numerical algorithms often can hardly achieve the global optimality. We aim at…

Optimization and Control · Mathematics 2019-06-18 Honglin Yuan , Xiaoyi Gu , Rongjie Lai , Zaiwen Wen

In this thesis, we extend the recently introduced theory of stochastic modified equations (SMEs) for stochastic gradient optimization algorithms. In Ch. 3 we study time-inhomogeneous SDEs driven by Brownian motion. For certain SDEs we prove…

Probability · Mathematics 2025-11-26 Stefan Perko

The present work introduces and investigates an explicit time discretization scheme, called the projected Euler method,to numerically approximate random periodic solutions of semi-linear SDEs under non-globally Lipschitz conditions. The…

Numerical Analysis · Mathematics 2024-11-26 Yujia Guo , Xiaojie Wang , Yue Wu

We analyze a natural extension of the backward Euler approximation for a class of BSDEs with Lipschitz generators and random (unbounded) time horizons. We derive strong error bounds in terms of the underlying stepsize; the distance between…

Probability · Mathematics 2025-07-08 Frank T. Seifried , Maximilian Würschmidt

As a means of improving analysis of biological shapes, we propose an algorithm for sampling a Riemannian manifold by sequentially selecting points with maximum uncertainty under a Gaussian process model. This greedy strategy is known to be…

Methodology · Statistics 2019-01-10 Tingran Gao , Shahar Z. Kovalsky , Ingrid Daubechies

We propose a novel approach to numerically approximate McKean-Vlasov stochastic differential equations (MV-SDE) using stochastic gradient descent (SGD) while avoiding the use of interacting particle systems (IPS) {and the associated…

Numerical Analysis · Mathematics 2026-01-22 Ankush Agarwal , Andrea Amato , Goncalo dos Reis , Stefano Pagliarani

Diffusion models for continuous state spaces based on Gaussian noising processes are now relatively well understood from both practical and theoretical perspectives. In contrast, results for diffusion models on discrete state spaces remain…

Machine Learning · Computer Science 2026-04-02 Giovanni Conforti , Alain Durmus , Le-Tuyet-Nhi Pham , Gael Raoul

Stochastic partial differential equations (SPDEs) have become a crucial ingredient in a number of models from economics and the natural sciences. Many SPDEs that appear in such applications include non-globally monotone nonlinearities.…

Probability · Mathematics 2021-11-02 Arnulf Jentzen , Primož Pušnik

We study a singularly perturbed fast-slow system of two partial differential equations (PDEs) of reaction-diffusion type on a bounded domain via Galerkin discretisation. We assume that the reaction kinetics in the fast variable realise a…

Analysis of PDEs · Mathematics 2024-10-15 Maximilian Engel , Felix Hummel , Christian Kuehn , Nikola Popović , Mariya Ptashnyk , Thomas Zacharis

Stochastic gradient descent (SGD) has been widely used in machine learning due to its computational efficiency and favorable generalization properties. Recently, it has been empirically demonstrated that the gradient noise in several deep…

Machine Learning · Statistics 2019-06-24 Thanh Huy Nguyen , Umut Şimşekli , Mert Gürbüzbalaban , Gaël Richard

In this article, we consider diffusion approximations for a general class of stochastic recursions. Such recursions arise as models for population growth, genetics, financial securities, multiplicative time series, numerical schemes and…

Probability · Mathematics 2016-01-13 David Kelly

Semilinear hyperbolic stochastic partial differential equations (SPDEs) find widespread applications in the natural and engineering sciences. However, the traditional Gaussian setting may prove too restrictive, as phenomena in mathematical…

Numerical Analysis · Mathematics 2023-07-04 Andrea Barth , Andreas Stein

We investigate the validity and accuracy of weak-noise (saddle-point or instanton) approximations for piecewise-smooth stochastic differential equations (SDEs), taking as an illustrative example a piecewise-constant SDE, which serves as a…

Statistical Mechanics · Physics 2013-11-05 Yaming Chen , Adrian Baule , Hugo Touchette , Wolfram Just

We study stochastic differential equations (SDEs) whose drift and diffusion coefficients are path-dependent and controlled. We construct a value process on the canonical path space, considered simultaneously under a family of singular…

Probability · Mathematics 2012-05-08 Marcel Nutz

An implicit Euler--Maruyama method with non-uniform step-size applied to a class of stochastic partial differential equations is studied. A spectral method is used for the spatial discretization and the truncation of the Wiener process. A…

Numerical Analysis · Mathematics 2018-04-11 Yoshihito Kazashi

Deep Gaussian process models typically employ discrete hierarchies, but recent advancements in differential Gaussian processes (DiffGPs) have extended these models to infinite depths. However, existing DiffGP approaches often overlook the…

Machine Learning · Computer Science 2025-12-16 Jian Xu , Zhiqi Lin , Min Chen , Junmei Yang , Delu Zeng , John Paisley

We revisit the theoretical properties of Hamiltonian stochastic differential equations (SDES) for Bayesian posterior sampling, and we study the two types of errors that arise from numerical SDE simulation: the discretization error and the…

Machine Learning · Computer Science 2021-11-08 Giulio Franzese , Dimitrios Milios , Maurizio Filippone , Pietro Michiardi

This paper is devoted to order-one explicit approximations of random periodic solutions to multiplicative noise driven stochastic differential equations (SDEs) with non-globally Lipschitz coefficients. The existence of the random periodic…

Probability · Mathematics 2025-01-06 Yujia Guo , Xiaojie Wang , Yue Wu