English
Related papers

Related papers: Large and moderate deviations principles for kerne…

200 papers

We establish large deviation principles for the largest eigenvalue of large random matrices with variance profiles. For $N \in \mathbb N$, we consider random $N \times N$ symmetric matrices $H^N$ which are such that…

Probability · Mathematics 2024-03-25 Raphaël Ducatez , Alice Guionnet , Jonathan Husson

The work concerns deviation estimates for multivalued McKean-Vlasov stochastic differential equations. First of all, we prove the large deviation principle for them by the weak convergence approach. Then the central limit theorem for them…

Probability · Mathematics 2022-08-10 Kun Fang , Huijie Qiao

This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a…

Machine Learning · Statistics 2024-11-27 Masahiro Kato

Compared to nonparametric estimators in the multivariate setting, kernel estimators for functional data models have a larger order of bias. This is problematic for constructing confidence regions or statistical tests since the bias might…

Statistics Theory · Mathematics 2025-11-21 Melanie Birke , Tim Greger

Motivated by the study of dependent random variables by coupling with independent blocks of variables, we obtain first sufficient conditions for the moderate deviation principle in its functional form for triangular arrays of independent…

Probability · Mathematics 2008-05-07 Florence Merlevede , Magda Peligrad

This article studies a trimmed version of the Nadaraya-Watson estimator to estimate the unknown non-parametric regression function. The characterization of the estimator through minimization problem is established, and its pointwise…

Statistics Theory · Mathematics 2019-09-27 Subhra Sankar Dhar , Prashant Jha , Prabrisha Rakhshit

This paper studies an intriguing phenomenon related to the good generalization performance of estimators obtained by using large learning rates within gradient descent algorithms. First observed in the deep learning literature, we show that…

Machine Learning · Statistics 2022-06-06 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

We consider a family of positive operator valued measures associated with representations of compact connected Lie groups. For many independent copies of a single state and a tensor power representation we show that the observed probability…

Mathematical Physics · Physics 2024-09-04 Alonso Botero , Matthias Christandl , Péter Vrana

We prove a moderate deviation principle for the continuous time interpolation of discrete time recursive stochastic processes. The methods of proof are somewhat different from the corresponding large deviation result, and in particular the…

Probability · Mathematics 2014-01-24 Paul Dupuis , Dane Johnson

The term noncentral moderate deviations is used in the literature to mean a class of large deviation principles that, in some sense, fills the gap between the convergence in probability to a constant (governed by a reference large deviation…

Probability · Mathematics 2025-12-18 Claudio Macci , Barbara Pacchiarotti

The main purpose is to estimate the regression function of a real random variable with functional explanatory variable by using a recursive nonparametric kernel approach. The mean square error and the almost sure convergence of a family of…

Statistics Theory · Mathematics 2013-08-07 Aboubacar Amiri , Christophe Crambes , Baba Thiam

We prove a large deviation principle for deep neural networks with Gaussian weights and at most linearly growing activation functions, such as ReLU. This generalises earlier work, in which bounded and continuous activation functions were…

Machine Learning · Statistics 2026-02-10 Quirin Vogel

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

In a pioneer work, R\'ev\'esz (1973) introduces the stochastic approximation method to build up a recursive kernel estimator of the regression function $x\mapsto E(Y|X=x)$. However, according to R\'ev\'esz (1977), his estimator has two main…

Statistics Theory · Mathematics 2008-12-23 Abdelkader Mokkadem , Mariane Pelletier , Yousri Slaoui

Associated kernels have been introduced to improve the classical continuous kernels for smoothing any functional on several kinds of supports such as bounded continuous and discrete sets. This work deals with the effects of combined…

Statistics Theory · Mathematics 2021-09-08 Sobom M. Somé , Célestin C. Kokonendji

The main aim of this paper is to study the moderate deviation principle for McKean-Vlasov stochastic differential equations with multiple scales. Specifically, we are interested in the asymptotic estimates of the deviation processes…

Probability · Mathematics 2024-09-20 Wei Hong , Ge Li , Shihu Li

For a class of martingales, this paper provides a framework on the uniform consistency with broad applicability. The main condition imposed is only related to the conditional variance of the martingale, which holds true for stationary…

Statistics Theory · Mathematics 2014-02-06 Qiying Wang , Nigel Chan

This paper introduces a kernel discrepancy-based framework for rerandomization to enhance the precision of causal inference in controlled experiments. We demonstrate that the kernel discrepancy is the key part of the variance upper bound…

Methodology · Statistics 2025-11-05 Yiou Li , Lulu Kang

We establish a sharp large deviation principle for renewal-reward processes, supposing that each renewal involves a broad-sense reward taking values in a real separable Banach space. In fact, we demonstrate a weak large deviation principle…

Probability · Mathematics 2023-04-24 Marco Zamparo

This study examines the optimal selections of bandwidth and semi-metric for a functional partial linear model. Our proposed method begins by estimating the unknown error density using a kernel density estimator of residuals, where the…

Methodology · Statistics 2020-11-17 Han Lin Shang