English
Related papers

Related papers: Large and moderate deviation principles for recurs…

200 papers

In this paper we prove large and moderate deviations principles for the recursive kernel estimator of a probability density function and its partial derivatives. Unlike the density estimator, the derivatives estimators exhibit a quadratic…

Statistics Theory · Mathematics 2007-06-13 Abdelkader Mokkadem , Mariane Pelletier , Baba Thiam

We apply the stochastic approximation method to construct a large class of recursive kernel estimators of a probability density, including the one introduced by Hall and Patil (1994). We study the properties of these estimators and compare…

Statistics Theory · Mathematics 2008-07-21 Abdelkader Mokkadem , Mariane Pelletier , Yousri Slaoui

In this paper we prove large deviations principles for the averaged stochastic approximation method for the estimation of a regression function introduced by A. Mokkadem et al. [Revisiting R\'ev\'esz's stochastic approximation method for…

Statistics Theory · Mathematics 2013-04-30 Yousri Slaoui

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

The paper considers nonparametric kernel density/regression estimation from a stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained…

Statistics Theory · Mathematics 2024-09-05 Vladimir Norkin , Vladimir Kirilyuk

In various practical situations, we encounter data from stochastic processes which can be efficiently modelled by an appropriate parametric model for subsequent statistical analyses. Unfortunately, the most common estimation and inference…

Methodology · Statistics 2022-04-12 Rohan Hore , Abhik Ghosh

We prove two Large deviations principles (LDP) in the zone of moderate deviation probabilities. First we establish LDP for the conditional distributions of moderate deviations of empirical bootstrap measures given empirical probability…

Statistics Theory · Mathematics 2014-05-22 Mikhail Ermakov

In this paper, we investigate a stochastic approximation procedure $\left(X_n\right)_{n\ge 0}$ taking values in $R$. The process is adapted to a filtration $(F_n)_{n\ge 0}$ and satisfies the recursion…

Probability · Mathematics 2026-05-11 Jianan Shi , Qing Yin , Yu Miao

The goal of this paper is to study the Moderate Deviation Principle (MDP) for a system of stochastic reaction-diffusion equations with a time-scale separation in slow and fast components and small noise in the slow component. Based on weak…

Probability · Mathematics 2022-02-03 Ioannis Gasteratos , Michael Salins , Konstantinos Spiliopoulos

Bitseki and Delmas (2021) have studied recently the central limit theorem for kernel estimator of invariant density in bifurcating Markov chains models. We complete their work by proving a moderate deviation principle for this estimator.…

Probability · Mathematics 2021-09-03 S. Valère Bitseki Penda

In this paper, we introduce a robust nonparametric density estimator combining the popular Kernel Density Estimation method and the Median-of-Means principle (MoM-KDE). This estimator is shown to achieve robustness to any kind of anomalous…

Statistics Theory · Mathematics 2020-07-01 Pierre Humbert , Batiste Le Bars , Ludovic Minvielle , Nicolas Vayatis

We provide estimates of the rate of strong approximation and bounds for probabilities of moderate deviations in the CLT for the $L_1$-norm of the kernel density estimator without any assumptions on the density and assuming that the kernel…

Probability · Mathematics 2014-02-07 Andrei Yu. Zaitsev

Estimating the ratio of two probability densities from finitely many observations of the densities is a central problem in machine learning and statistics with applications in two-sample testing, divergence estimation, generative modeling,…

Machine Learning · Computer Science 2024-03-12 Werner Zellinger , Stefan Kindermann , Sergei V. Pereverzyev

Kernel density estimation (KDE) is one of the most widely used nonparametric density estimation methods. The fact that it is a memory-based method, i.e., it uses the entire training data set for prediction, makes it unsuitable for most…

Machine Learning · Computer Science 2022-08-08 Joseph A. Gallego , Juan F. Osorio , Fabio A. González

We establish the large deviations principle (LDP) and the moderate deviations principle (MDP) and an almost sure version of the central limit theorem (CLT) for the stochastic 3D viscous primitive equations driven by a multiplicative white…

Probability · Mathematics 2020-10-27 Jakub Slavík

Kernel density estimation is a widely used nonparametric approach to estimate an unknown distribution. Recent work in Bayesian predictive inference has considered stochastic processes formed by specifying the predictive distribution for the…

Methodology · Statistics 2026-05-15 Torey Hilbert

We investigate the discrepancy principle for choosing smoothing parameters for kernel density estimation. The method is based on the distance between the empirical and estimated distribution functions. We prove some new positive and…

Statistics Theory · Mathematics 2015-03-19 Thoralf Mildenberger

This article gives a new insight of kernel-based (approximation) methods to solve the high-dimensional stochastic partial differential equations. We will combine the techniques of meshfree approximation and kriging interpolation to extend…

Numerical Analysis · Mathematics 2015-02-20 Qi Ye

This paper is devoted to the estimation of the common marginal density function of weakly dependent processes. The accuracy of estimation is measured using pointwise risks. We propose a datadriven procedure using kernel rules. The bandwidth…

Statistics Theory · Mathematics 2016-04-04 Karine Bertin , Nicolas Klutchnikoff

This paper describes how to specify probability models for data analysis via a backward induction procedure. The new approach yields coherent, prior-free uncertainty assessment. After presenting some intuition-building examples, the new…

Methodology · Statistics 2015-02-24 P. Richard Hahn
‹ Prev 1 2 3 10 Next ›