English
Related papers

Related papers: Large and moderate deviations principles for recur…

200 papers

We establish large deviation principles for the couple of the maximum likelihood estimators of dimensional and drift coefficients in the generalised squared radial Ornstein-Uhlenbeck process. We focus our attention to the most tractable…

Probability · Mathematics 2016-11-28 Marie du Roy de Chaumaray

The theory of stochastic approximations form the theoretical foundation for studying convergence properties of many popular recursive learning algorithms in statistics, machine learning and statistical physics. Large deviations for…

Probability · Mathematics 2025-02-05 Henrik Hult , Adam Lindhe , Pierre Nyquist , Guo-Jhen Wu

This paper presents a novel method for analytical derivations of marginal densities using the fractional derivatives of moment-generating functions. Although the method requires likelihood functions to take specific forms, its assumptions…

Methodology · Statistics 2026-04-06 Si-Yang Li , David A. van Dyk , Maximilian Autenrieth

In this paper we establish a large deviations type estimate for strongly mixing Markov chains with respect to the Lp norm. As applications we derive such estimates for the iterates of a locally constant random cocycle with mixed rank, as…

Dynamical Systems · Mathematics 2026-02-10 Anselmo Pontes

Coded distributed computation has become common practice for performing gradient descent on large datasets to mitigate stragglers and other faults. This paper proposes a novel algorithm that encodes the partial derivatives themselves and…

Machine Learning · Computer Science 2022-06-22 Pedro Soto , Ilia Ilmer , Haibin Guan , Jun Li

Asymptotic properties of a dimension-robust dependence measure are investigated. It is related to those used in independence tests, but is derivable, thus suitable for independent component analysis. An adjustable kernel allows to…

Statistics Theory · Mathematics 2007-06-13 Sophie Achard

In a previous article, a least square regression estimation procedure was proposed: first, we condiser a family of functions and study the properties of an estimator in every unidimensionnal model defined by one of these functions; we then…

Statistics Theory · Mathematics 2007-06-13 Pierre Alquier

We consider a stable but nearly unstable autoregressive process of any order. The bridge between stability and instability is expressed by a time-varying companion matrix $A_{n}$ with spectral radius $\rho(A_{n}) < 1$ satisfying…

Statistics Theory · Mathematics 2019-10-17 Frédéric Proïa

In this paper, we study the problem of pointwise estimation of a multivariate density. We provide a data-driven selection rule from the family of kernel estimators and derive for it a pointwise oracle inequality. Using the latter bound, we…

Statistics Theory · Mathematics 2015-09-21 Gilles Rebelles

In this paper, we develop a quadrature framework for large-scale kernel machines via a numerical integration representation. Considering that the integration domain and measure of typical kernels, e.g., Gaussian kernels, arc-cosine kernels,…

Machine Learning · Computer Science 2021-06-14 Fanghui Liu , Xiaolin Huang , Yudong Chen , Johan A. K. Suykens

We prove a large deviation result for a random symmetric n x n matrix with independent identically distributed entries to have a few eigenvalues of size n. If the spectrum S survives when the matrix is rescaled by a factor of n, it can only…

Probability · Mathematics 2013-04-22 Sourav Chatterjee , S. R. S. Varadhan

In this paper, we investigate a stochastic approximation procedure $\left(X_n\right)_{n\ge 0}$ taking values in $R$. The process is adapted to a filtration $(F_n)_{n\ge 0}$ and satisfies the recursion…

Probability · Mathematics 2026-05-11 Jianan Shi , Qing Yin , Yu Miao

We prove an large deviation principle for multivalued sdes

Probability · Mathematics 2011-04-28 Jiagang Ren , Siyan Xu , Xicheng Zhang

Existing results for the estimation of the L\'evy measure are mostly limited to the onedimensional setting. We apply the spectral method to multidimensional L\'evy processes in order to construct a nonparametric estimator for the…

Statistics Theory · Mathematics 2023-05-24 Maximilian F. Steffen

We consider Markov chains which are polynomially mixing, in a weak sense expressed in terms of the space of functions on which the mixing speed is controlled. In this context, we prove polynomial large and moderate deviations inequalities.…

Probability · Mathematics 2016-07-22 J Dedecker , Sébastien Gouëzel , F Merlevède

We study the Cram\'er type moderate deviation for partial sums of random fields by applying the conjugate method. The results are applicable to the partial sums of linear random fields with short or long memory and to nonparametric…

Statistics Theory · Mathematics 2019-07-22 Aleksandr Beknazaryan , Hailin Sang , Yimin Xiao

To investigate a dilemma of statistical and computational efficiency faced by long-run variance estimators, we propose a decomposition of kernel weights in a quadratic form and some online inference principles. These proposals allow us to…

Methodology · Statistics 2024-09-10 Man Fung Leung , Kin Wai Chan

The main results in this paper concern large deviations for families of non-Gaussian processes obtained as suitable perturbations of continuous centered multivariate Gaussian processes which satisfy a large deviation principle. We present…

Probability · Mathematics 2023-07-06 C. Macci , B. Pacchiarotti

In this paper, we propose a new concept of derivative with respect to an arbitrary kernel-function. Several properties related to this new operator, like inversion rules, integration by parts, etc. are studied. In particular, we introduce…

Classical Analysis and ODEs · Mathematics 2018-12-26 Mohamed Jleli , Mokhtar Kirane , Bessem Samet

Kernel density estimation (KDE) is integral to a range of generative and discriminative tasks in machine learning. Drawing upon tools from the multidimensional calculus of variations, we derive an optimal weight function that reduces bias…

Machine Learning · Computer Science 2023-11-07 Sangwoong Yoon , Frank C. Park , Gunsu S Yun , Iljung Kim , Yung-Kyun Noh