English
Related papers

Related papers: Stochastic gradient descent in continuous time for…

200 papers

We introduce a constructive framework to learn effective Langevin equations from stationary time series. Unlike conventional approaches that require iterative calibration to match target statistics, our construction guarantees the observed…

Chaotic Dynamics · Physics 2026-02-16 Ludovico Theo Giorgini

This paper focuses on a stochastic system identification problem: given time series observations of a stochastic differential equation (SDE) driven by L\'{e}vy $\alpha$-stable noise, estimate the SDE's drift field. For $\alpha$ in the…

Machine Learning · Statistics 2022-12-08 Harish S. Bhat

We study supervised multiclass classification for diffusion processes, where each class is characterized by a distinct drift function and trajectories are observed at discrete times. We first derive a multidimensional Bayes rule and then…

Machine Learning · Statistics 2026-05-14 Yuzhen Zhao , Jiarong Fan , Yating Liu

Over the recent past data-driven algorithms for solving stochastic optimal control problems in face of model uncertainty have become an increasingly active area of research. However, for singular controls and underlying diffusion dynamics…

Optimization and Control · Mathematics 2024-10-15 Sören Christensen , Asbjørn Holk Thomsen , Lukas Trottner

The paper studies asymptotic properties of estimators of multidimensional stochastic differential equations driven by Brownian motions from high-frequency discrete data. Consistency and central limit properties of a class of estimators of…

Statistics Theory · Mathematics 2024-11-07 Arnab Ganguly

Diffusion approximation provides weak approximation for stochastic gradient descent algorithms in a finite time horizon. In this paper, we introduce new tools motivated by the backward error analysis of numerical stochastic differential…

Machine Learning · Computer Science 2019-09-05 Yuanyuan Feng , Tingran Gao , Lei Li , Jian-Guo Liu , Yulong Lu

We consider a stochastic functional differential equation with an arbitrary Lipschitz diffusion coefficient depending on the past. The drift part contains a term with superlinear growth and satisfying a dissipativity condition. We prove…

Analysis of PDEs · Mathematics 2009-03-12 Abdelhadi Es--Sarhir , Onno van Gaans , Michael Scheutzow

Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function. The accurate estimation (or discovery)…

Machine Learning · Computer Science 2025-10-22 Patrick Seifner , Kostadin Cvejoski , David Berghaus , Cesar Ojeda , Ramses J. Sanchez

This paper establishes a quantitative, uniform-in-time diffusion approximation for the joint law of a broad class of fully coupled multiscale stochastic systems. We derive a precise characterization of the limiting joint distribution as a…

Probability · Mathematics 2026-04-02 Longjie Xie , Xicheng Zhang

We propose a novel non-parametric learning paradigm for the identification of drift and diffusion coefficients of multi-dimensional non-linear stochastic differential equations, which relies upon discrete-time observations of the state. The…

Machine Learning · Computer Science 2025-03-11 Riccardo Bonalli , Alessandro Rudi

Drift in machine learning refers to the phenomenon where the statistical properties of data or context, in which the model operates, change over time leading to a decrease in its performance. Therefore, maintaining a constant monitoring…

Computation and Language · Computer Science 2023-09-08 Saeed Khaki , Akhouri Abhinav Aditya , Zohar Karnin , Lan Ma , Olivia Pan , Samarth Marudheri Chandrashekar

Extracting governing stochastic differential equation models from elusive data is crucial to understand and forecast dynamics for complex systems. We devise a method to extract the drift term and estimate the diffusion coefficient of a…

Numerical Analysis · Mathematics 2020-08-21 Jian Ren , Jinqiao Duan

In this work, we consider a one-dimensional It{\^o} diffusion process X t with possibly nonlinear drift and diffusion coefficients. We show that, when the diffusion coefficient is known, the drift coefficient is uniquely determined by an…

Analysis of PDEs · Mathematics 2017-09-13 Michel Cristofol , Lionel Roques

Of stochastic differential equations, diffusion processes have been adopted in numerous applications, as more relevant and flexible models. This paper studies diffusion processes in a different setting, where for a given stationary…

Probability · Mathematics 2024-12-31 Saber Jafarizadeh

We consider the problem of sampling from a target distribution, which is \emph {not necessarily logconcave}, in the context of empirical risk minimization and stochastic optimization as presented in Raginsky et al. (2017). Non-asymptotic…

Statistics Theory · Mathematics 2021-02-03 Ngoc Huy Chau , Éric Moulines , Miklos Rásonyi , Sotirios Sabanis , Ying Zhang

Obtaining coarse-grained models that accurately incorporate finite-size effects is an important open challenge in the study of complex, multi-scale systems. We apply Langevin regression, a recently developed method for finding stochastic…

Adaptation and Self-Organizing Systems · Physics 2021-10-12 Jordan Snyder , Jared L. Callaham , Steven L. Brunton , J. Nathan Kutz

Inferring a diffusion equation from discretely-observed measurements is a statistical challenge of significant importance in a variety of fields, from single-molecule tracking in biophysical systems to modeling financial instruments.…

Machine Learning · Statistics 2023-12-12 Yinuo Ren , Yiping Lu , Lexing Ying , Grant M. Rotskoff

We analyze in a closed form the learning dynamics of stochastic gradient descent (SGD) for a single-layer neural network classifying a high-dimensional Gaussian mixture where each cluster is assigned one of two labels. This problem provides…

Machine Learning · Computer Science 2022-03-28 Francesca Mignacco , Florent Krzakala , Pierfrancesco Urbani , Lenka Zdeborová

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

A general method is proposed which allows one to estimate drift and diffusion coefficients of a stochastic process governed by a Langevin equation. It extends a previously devised approach [R. Friedrich et al., Physics Letters A 271, 217…

Data Analysis, Statistics and Probability · Physics 2009-11-11 D. Kleinhans , R. Friedrich , A. Nawroth , J. Peinke