English
Related papers

Related papers: Minimax convergence rates of a binary classificati…

200 papers

We consider statistical inference for a class of dynamic mixed-effect models described by stochastic differential equations whose drift and diffusion coefficients simultaneously depend on fixed- and random-effect parameters. Assuming that…

Statistics Theory · Mathematics 2025-12-30 Maud Delattre , Hiroki Masuda

Recently, many studies have shed light on the high adaptivity of deep neural network methods in nonparametric regression models, and their superior performance has been established for various function classes. Motivated by this…

Statistics Theory · Mathematics 2023-07-04 Akihiro Oga , Yuta Koike

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set $\mathcal{G}$ up to the smallest possible additive term, called the convergence rate. When the…

Statistics Theory · Mathematics 2009-09-09 Jean-Yves Audibert

This paper derives a diffusion approximation for a sequence of discrete-time one-sided limit order book models with non-linear state dependent order arrival and cancellation dynamics. The discrete time sequences are specified in terms of an…

Probability · Mathematics 2017-08-25 Ulrich Horst , Dörte Kreher

Inferring a diffusion equation from discretely-observed measurements is a statistical challenge of significant importance in a variety of fields, from single-molecule tracking in biophysical systems to modeling financial instruments.…

Machine Learning · Statistics 2023-12-12 Yinuo Ren , Yiping Lu , Lexing Ying , Grant M. Rotskoff

We study the estimation of time-homogeneous drift functions in multivariate stochastic differential equations with known diffusion coefficient, from multiple trajectories observed at high frequency over a fixed time horizon. We formulate…

Machine Learning · Statistics 2026-02-23 Marcos Tapia Costa , Nikolas Kantas , George Deligiannidis

Recent success of diffusion models has inspired a surge of interest in developing sampling techniques using reverse diffusion processes. However, accurately estimating the drift term in the reverse stochastic differential equation (SDE)…

Machine Learning · Statistics 2024-10-22 Zhekun Shi , Longlin Yu , Tianyu Xie , Cheng Zhang

Of stochastic differential equations, diffusion processes have been adopted in numerous applications, as more relevant and flexible models. This paper studies diffusion processes in a different setting, where for a given stationary…

Probability · Mathematics 2024-12-31 Saber Jafarizadeh

We focus on the supervised binary classification problem, which consists in guessing the label $Y$ associated to a co-variate $X \in \R^d$, given a set of $n$ independent and identically distributed co-variates and associated labels…

Statistics Theory · Mathematics 2011-12-14 Jean-Baptiste Monnier

We consider the problem of nonparametric estimation of the drift and diffusion coefficients of a Stochastic Differential Equation (SDE), based on $n$ independent replicates $\left\{X_i(t)\::\: t\in [0,1]\right\}_{1 \leq i \leq n}$, observed…

Statistics Theory · Mathematics 2023-11-28 Neda Mohammadi , Leonardo Santoro , Victor M. Panaretos

The Sparse Identification of Nonlinear Dynamics (SINDy) algorithm can be applied to stochastic differential equations to estimate the drift and the diffusion function using data from a realization of the SDE. The SINDy algorithm requires…

Numerical Analysis · Mathematics 2024-01-29 Mathias Wanner , Igor Mezić

We study the problem of parameter estimation using maximum likelihood for fast/slow systems of stochastic differential equations. Our aim is to shed light on the problem of model/data mismatch at small scales. We consider two classes of…

Statistics Theory · Mathematics 2008-06-20 A. Papavasiliou , G. A. Pavliotis , A. M. Stuart

We develop minimax optimal risk bounds for the general learning task consisting in predicting as well as the best function in a reference set G up to the smallest possible additive term, called the convergence rate. When the reference set…

Statistics Theory · Mathematics 2008-03-04 Jean-Yves Audibert

An approximate maximum likelihood method of estimation of diffusion parameters $(\vartheta,\sigma)$ based on discrete observations of a diffusion $X$ along fixed time-interval $[0,T]$ and Euler approximation of integrals is analyzed. We…

Statistics Theory · Mathematics 2018-08-21 Miljenko Huzak

This work establishes the weak convergence of Euler-Maruyama's approximation for stochastic differential equations (SDEs) with singular drifts under the integrability condition in lieu of the widely used growth condition. This method is…

Probability · Mathematics 2018-08-23 Jinghai Shao

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

Stochastic differential equations (SDEs) are a fundamental tool for modelling dynamic processes, including gene regulatory networks (GRNs), contaminant transport, financial markets, and image generation. However, learning the underlying SDE…

The maximum likelihood approach is adapted to the problem of estimation of drift and diffusion functions of stochastic processes from measured time series. We reconcile a previously devised iterative procedure [Kleinhans et al., Physics…

Data Analysis, Statistics and Probability · Physics 2009-11-13 D. Kleinhans , R. Friedrich

In this paper, we consider the problem of minimizing the exit rate with which a diffusion process pertaining to a chain of distributed control systems, with random perturbations, exits from a given bounded open domain. In particular, we…

Dynamical Systems · Mathematics 2014-09-12 Getachew K. Befekadu , Panos J. Antsaklis

We study nonparametric density estimation in non-stationary drift settings. Given a sequence of independent samples taken from a distribution that gradually changes in time, the goal is to compute the best estimate for the current…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal