English
Related papers

Related papers: Uniform strong consistency of a frontier estimator…

200 papers

We prove the statistical consistency of kernel Partial Least Squares Regression applied to a bounded regression learning problem on a reproducing kernel Hilbert space. Partial Least Squares stands out of well-known classical approaches as…

Methodology · Statistics 2010-08-13 Gilles Blanchard , Nicole Kraemer

We focus on the distribution regression problem: regressing to a real-valued response from a probability distribution. Although there exist a large number of similarity measures between distributions, very little is known about their…

Statistics Theory · Mathematics 2015-01-28 Zoltan Szabo , Arthur Gretton , Barnabas Poczos , Bharath Sriperumbudur

Random Fourier features is one of the most popular techniques for scaling up kernel methods, such as kernel ridge regression. However, despite impressive empirical results, the statistical properties of random Fourier features are still not…

Machine Learning · Computer Science 2018-05-22 Haim Avron , Michael Kapralov , Cameron Musco , Christopher Musco , Ameya Velingker , Amir Zandieh

We present a new method for estimating the frontier of a sample. The estimator is based on a local polynomial regression on the power-transformed data. We assume that the exponent of the transformation goes to infinity while the bandwidth…

Methodology · Statistics 2011-04-04 Stéphane Girard , Pierre Jacob

In this paper, we establish uniform asymptotic certainty bands for the conditional cumulative distribution function. To this aim, we give exact rate of strong uniform consistency for the local linear estimator of this function. The…

Statistics Theory · Mathematics 2014-07-21 Sandie Ferrigno , Bernard Foliguet , Myriam Maumy-Bertrand , Aurélie Muller-Gueudin

Modern black-box predictive models are often accompanied by weak performance guarantees that only hold asymptotically in the size of the dataset or require strong parametric assumptions. In response to this, split conformal prediction…

Machine Learning · Statistics 2022-10-27 Roel Hulsman

Given additional distributional information in the form of moment restrictions, kernel density and distribution function estimators with implied generalised empirical likelihood probabilities as weights achieve a reduction in variance due…

Methodology · Statistics 2019-10-08 Vitaliy Oryshchenko , Richard J. Smith

We prove statistical rates of convergence for kernel-based least squares regression from i.i.d. data using a conjugate gradient algorithm, where regularization against overfitting is obtained by early stopping. This method is related to…

Statistics Theory · Mathematics 2016-07-11 Gilles Blanchard , Nicole Krämer

We consider a kernel based harmonic analysis of "boundary," and boundary representations. Our setting is general: certain classes of positive definite kernels. Our theorems extend (and are motivated by) results and notions from classical…

Functional Analysis · Mathematics 2016-11-15 Palle Jorgensen , Feng Tian

The purpose of the present paper is to establish moment estimates of Rosenthal type for a rather general class of random variables satisfying certain bounds on the cumulants. We consider sequences of random variables which satisfy a central…

Probability · Mathematics 2019-01-16 Peter Eichelsbacher , Lukas Knichel

Under the frequency domain framework for weakly dependent functional time series, a key element is the spectral density kernel which encapsulates the second-order dynamics of the process. We propose a class of spectral density kernel…

Statistics Theory · Mathematics 2018-12-11 Tingyi Zhu , Dimitris N. Politis

The pair correlation function is a fundamental spatial point process characteristic that, given the intensity function, determines second order moments of the point process. Non-parametric estimation of the pair correlation function is a…

Statistics Theory · Mathematics 2023-04-25 Abdollah Jalilian , Yongtao Guan , Rasmus Waagepetersen

In this paper, we discuss the convergence analysis of the conjugate gradient-based algorithm for the functional linear model in the reproducing kernel Hilbert space framework, utilizing early stopping results in regularization against…

Statistics Theory · Mathematics 2023-10-05 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

Integrating the outputs of multiple classifiers via combiners or meta-learners has led to substantial improvements in several difficult pattern recognition problems. In the typical setting investigated till now, each classifier is trained…

Machine Learning · Computer Science 2007-05-23 Kagan Tumer , Joydeep Ghosh

We consider the Grenander estimator that is the maximum likelihood estimator for non-increasing densities. We prove uniform central limit theorems for certain subclasses of bounded variation functions and for H\"older balls of smoothness…

Statistics Theory · Mathematics 2015-06-29 Jakob Söhl

Persistent homology has become an important tool for extracting geometric and topological features from data, whose multi-scale features are summarized in a persistence diagram. From a statistical perspective, however, persistence diagrams…

Statistics Theory · Mathematics 2022-06-07 Siddharth Vishwanath , Kenji Fukumizu , Satoshi Kuriki , Bharath Sriperumbudur

We introduce a divergence measure between data distributions based on operators in reproducing kernel Hilbert spaces defined by kernels. The empirical estimator of the divergence is computed using the eigenvalues of positive definite Gram…

Machine Learning · Computer Science 2023-05-31 Jhoan Keider Hoyos Osorio , Oscar Skean , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

Consistent weighted least square estimators are proposed for a wide class of nonparametric regression models with random regression function, where this real-valued random function of $k$ arguments is assumed to be continuous with…

Statistics Theory · Mathematics 2023-07-04 Yu. Yu. Linke , I. S. Borisov , P. S. Ruzankin

In 1975 James Pickands III showed that the excesses over a high threshold are approximatly Generalized Pareto distributed. Since then, a variety of estimators for the parameters of this cdf have been studied, but always assuming the…

Statistics Theory · Mathematics 2016-05-26 Lukas Martig , Jürg Hüsler

Classical distributed estimation scenarios typically assume timely and reliable exchanges of information over the sensor network. This paper, in contrast, considers single time-scale distributed estimation via a sensor network subject to…

Systems and Control · Electrical Eng. & Systems 2021-09-08 Mohammadreza Doostmohammadian , Usman A. Khan , Mohammad Pirani , Themistoklis Charalambous