English
Related papers

Related papers: Stochastic gradient descent in continuous time for…

200 papers

We study the problem of drift estimation for two-scale continuous time series. We set ourselves in the framework of overdamped Langevin equations, for which a single-scale surrogate homogenized equation exists. In this setting, estimating…

Numerical Analysis · Mathematics 2021-06-08 Assyr Abdulle , Giacomo Garegnani , Grigorios A. Pavliotis , Andrew M. Stuart , Andrea Zanoni

We study the estimation of time-homogeneous drift functions in multivariate stochastic differential equations with known diffusion coefficient, from multiple trajectories observed at high frequency over a fixed time horizon. We formulate…

Machine Learning · Statistics 2026-02-23 Marcos Tapia Costa , Nikolas Kantas , George Deligiannidis

We propose a novel method for drift estimation of multiscale diffusion processes when a sequence of discrete observations is given. For the Langevin dynamics in a two-scale potential, our approach relies on the eigenvalues and the…

Numerical Analysis · Mathematics 2022-04-15 Assyr Abdulle , Grigorios A. Pavliotis , Andrea Zanoni

Stochastic differential equations of Langevin-diffusion form have received significant attention, thanks to their foundational role in both Bayesian sampling algorithms and optimization in machine learning. In the latter, they serve as a…

Optimization and Control · Mathematics 2024-05-14 Fabio V. Difonzo , Vyacheslav Kungurtsev , Jakub Marecek

We consider the problem of minimizing a convex function that is evolving according to unknown and possibly stochastic dynamics, which may depend jointly on time and on the decision variable itself. Such problems abound in the machine…

Optimization and Control · Mathematics 2023-05-30 Joshua Cutler , Dmitriy Drusvyatskiy , Zaid Harchaoui

We consider nonparametric invariant density and drift estimation for a class of multidimensional degenerate resp. hypoelliptic diffusion processes, so-called stochastic damping Hamiltonian systems or kinetic diffusions, under anisotropic…

Statistics Theory · Mathematics 2022-05-24 Niklas Dexheimer , Claudia Strauch

We consider the problem of statistical inference for the effective dynamics of multiscale diffusion processes with (at least) two widely separated characteristic time scales. More precisely, we seek to determine parameters in the effective…

Statistics Theory · Mathematics 2013-05-30 Sebastian Krumscheid , Grigorios A. Pavliotis , Serafim Kalliadasis

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

This paper deals with a copies-based continuously differentiable and strictly decreasing estimator of the drift function for stochastic differential equations defining recurrent diffusion processes. The first part of our paper deals with…

Statistics Theory · Mathematics 2026-03-17 Nicolas Marie

We study the problem of parameter estimation using maximum likelihood for fast/slow systems of stochastic differential equations. Our aim is to shed light on the problem of model/data mismatch at small scales. We consider two classes of…

Statistics Theory · Mathematics 2008-06-20 A. Papavasiliou , G. A. Pavliotis , A. M. Stuart

Stochastic reduced-order models are widely used to represent the effective dynamics of complex systems, but estimating their drift and diffusion coefficients from data remains challenging. Standard approaches often rely on short-time…

Machine Learning · Statistics 2026-04-28 Ludovico T. Giorgini

The complex dynamics of physical systems can often be modeled with stochastic differential equations. However, computational constraints inhibit the estimation of dynamics from large time-series datasets. I present a method for estimating…

Data Analysis, Statistics and Probability · Physics 2023-11-02 William Davis

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

Optimization problems with continuous data appear in, e.g., robust machine learning, functional data analysis, and variational inference. Here, the target function is given as an integral over a family of (continuously) indexed target…

Machine Learning · Computer Science 2023-11-01 Kexin Jin , Jonas Latz , Chenguang Liu , Carola-Bibiane Schönlieb

In this study, we develop a stochastic optimal control approach with reinforcement learning structure to learn the unknown parameters appeared in the drift and diffusion terms of the stochastic differential equation. By choosing an…

Optimization and Control · Mathematics 2023-08-22 Shuzhen Yang

We analyze the dynamics of streaming stochastic gradient descent (SGD) in the high-dimensional limit when applied to generalized linear models and multi-index models (e.g. logistic regression, phase retrieval) with general data-covariance.…

Optimization and Control · Mathematics 2023-08-21 Elizabeth Collins-Woodfin , Courtney Paquette , Elliot Paquette , Inbar Seroussi

This paper explores the reconstruction of drift or diffusion coefficients of a scalar stochastic diffusion processes as it starts from an initial value and reaches, for the first time, a threshold value. We show that the distribution…

Statistical Mechanics · Physics 2009-11-10 Guillaume Bal , Tom Chou

A model has two main aims: predicting the behavior of a physical system and understanding its nature, that is how it works, at some desired level of abstraction. A promising recent approach to model building consists in deriving a…

Statistical Mechanics · Physics 2019-02-26 Marco Baldovin , Andrea Puglisi , Angelo Vulpiani

We present a novel methodology based on filtered data and moving averages for estimating effective dynamics from observations of multiscale systems. We show in a semi-parametric framework of the Langevin type that our approach is…

Numerical Analysis · Mathematics 2022-01-25 Giacomo Garegnani , Andrea Zanoni

We study efficiency of non-parametric estimation of diffusions (stochastic differential equations driven by Brownian motion) from long stationary trajectories. First, we introduce estimators based on conditional expectation which is…

Probability · Mathematics 2021-05-26 Xi Chen , Ilya Timofeyev
‹ Prev 1 2 3 10 Next ›