English
Related papers

Related papers: Minimax convergence rates of a binary classificati…

200 papers

Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper,…

Statistics Theory · Mathematics 2019-06-10 T. Tony Cai , Hongji Wei

Convergence properties of empirical risk minimizers can be conveniently expressed in terms of the associated population risk. To derive bounds for the performance of the estimator under covariate shift, however, pointwise convergence rates…

Statistics Theory · Mathematics 2024-01-01 Johannes Schmidt-Hieber , Petr Zamolodtchikov

In this paper we analyze the behaviour of the stochastic gradient descent (SGD), a widely used method in supervised learning for optimizing neural network weights via a minimization of non-convex loss functions. Since the pioneering work of…

Machine Learning · Computer Science 2025-05-13 Davide Barbieri , Matteo Bonforte , Peio Ibarrondo

In this paper, we consider the density estimation problem associated with the stationary measure of ergodic It\^o diffusions from a discrete-time series that approximate the solutions of the stochastic differential equations. To take an…

Numerical Analysis · Mathematics 2021-09-10 Yiqi Gu , John Harlim , Senwei Liang , Haizhao Yang

We introduce a lattice random walk discretisation scheme for stochastic differential equations (SDEs) that samples binary or ternary increments at each step, suppressing complex drift and diffusion computations to simple 1 or 2 bit random…

Numerical Analysis · Mathematics 2026-02-18 Samuel Duffield , Maxwell Aifer , Denis Melanson , Zach Belateche , Patrick J. Coles

A truncated sequential procedure is constructed for estimating the drift coefficient at a given state point based on discrete data of ergodic diffusion process. A nonasymptotic upper bound is obtained for a pointwise absolute error risk.…

Statistics Theory · Mathematics 2015-09-21 L. I. Galtchouk , S. M. Pergamenshchikov

For a fixed $T$ and $k \geq 2$, a $k$-dimensional vector stochastic differential equation $dX_t=\mu(X_t, \theta)dt+\nu(X_t)dW_t,$ is studied over a time interval $[0,T]$. Vector of drift parameters $\theta$ is unknown. The dependence in…

Statistics Theory · Mathematics 2023-07-19 Miljenko Huzak , Snježana Lubura Strunjak , Andreja Vlahek Štrok

We consider a drift-diffusion process with a time-independent and divergence-free random drift that is of white-noise character. We are interested in the critical case of two space dimensions, where one has to impose a small-scale cut-off…

Probability · Mathematics 2025-11-26 Felix Otto , Christian Wagner

Score-based diffusion models have become a foundational paradigm for modern generative modeling, demonstrating exceptional capability in generating samples from complex high-dimensional distributions. Despite the dominant adoption of…

Machine Learning · Computer Science 2025-03-13 Changxiao Cai , Gen Li

We establish the zero-diffusion limit for both continuous and discrete aggregation models over convex and bounded domains. Compared with a similar zero-diffusion limit derived in [44], our approach is different and relies on a coupling…

Analysis of PDEs · Mathematics 2018-09-07 Razvan C. Fetecau , Hui Huang , Daniel Messenger , Weiran Sun

We consider the setting of multiscale overdamped Langevin stochastic differential equations, and study the problem of learning the drift function of the homogenized dynamics from continuous-time observations of the multiscale system. We…

Numerical Analysis · Mathematics 2024-11-12 Max Hirsch , Andrea Zanoni

We study the Bayesian problems of detecting a change in the drift rate of an observable diffusion process with linear and exponential penalty costs for a detection delay. The optimal times of alarms are found as the first times at which the…

Statistics Theory · Mathematics 2011-11-08 Pavel V. Gapeev , Albert N. Shiryaev

The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity. The estimation is…

Information Theory · Computer Science 2018-02-22 Yuheng Bu , Shaofeng Zou , Yingbin Liang , Venugopal V. Veeravalli

We investigate robust parameter estimation and testing procedure for multivariate diffusion processes observed at high frequency via the minimum density power divergence estimator (MDPDE). Within a general diffusion framework and under…

Methodology · Statistics 2026-03-17 Sourojyoti Barick

A new class of explicit Milstein schemes, which approximate stochastic differential equations (SDEs) with superlinearly growing drift and diffusion coefficients, is proposed in this article. It is shown, under very mild conditions, that…

Probability · Mathematics 2016-01-13 Chaman Kumar , Sotirios Sabanis

We study a class of reflected backward stochastic differential equations with nonpositive jumps and upper barrier. Existence and uniqueness of a minimal solution is proved by a double penalization approach under regularity assumptions on…

Probability · Mathematics 2013-08-27 Sébastien Choukroun , Andrea Cosso , Huyen Pham

We consider stochastic gradient descent and its averaging variant for binary classification problems in a reproducing kernel Hilbert space. In the traditional analysis using a consistency property of loss functions, it is known that the…

Machine Learning · Statistics 2022-07-26 Atsushi Nitanda , Taiji Suzuki

We establish an explicit rate of convergence for some systems of mean-field interacting diffusions with logistic binary branching towards the solutions of nonlinear evolution equations with non-local self-diffusion and logistic mass growth,…

Probability · Mathematics 2021-09-29 Joaquín Fontbona , Felipe Muñoz-Hernández

In this work, we consider a one-dimensional It{\^o} diffusion process X t with possibly nonlinear drift and diffusion coefficients. We show that, when the diffusion coefficient is known, the drift coefficient is uniquely determined by an…

Analysis of PDEs · Mathematics 2017-09-13 Michel Cristofol , Lionel Roques

This paper proposes an adaptive time-stepping mothods for stochastic diffusion systems whose drift and diffusion coefficients are locally Lipschitz continuous and may exhibit polynomial growth. By controlling the growth of both the drift…

Numerical Analysis · Mathematics 2026-02-09 Xueqi Wen , Guozhen Li , Yuanping Cui , Xiaoyue Li