English
Related papers

Related papers: Asymptotic Integral Kernel for Ensembles of Random…

200 papers

Modern deep learning models employ considerably more parameters than required to fit the training data. Whereas conventional statistical wisdom suggests such models should drastically overfit, in practice these models generalize remarkably…

Machine Learning · Statistics 2020-08-18 Ben Adlam , Jeffrey Pennington

We study the concentration of random kernel matrices around their mean. We derive nonasymptotic exponential concentration inequalities for Lipschitz kernels assuming that the data points are independent draws from a class of multivariate…

Statistics Theory · Mathematics 2020-01-28 Arash A. Amini , Zahra S. Razaee

Kernel density estimation, a.k.a. Parzen windows, is a popular density estimation method, which can be used for outlier detection or clustering. With multivariate data, its performance is heavily reliant on the metric used within the…

Machine Learning · Computer Science 2012-12-11 Nicolas Le Roux , Francis Bach

This paper provides new uniform rate results for kernel estimators of absolutely regular stationary processes that are uniform in the bandwidth and in infinite-dimensional classes of dependent variables and regressors. Our results are…

Econometrics · Economics 2020-05-21 Juan Carlos Escanciano

We consider supervised learning problems within the positive-definite kernel framework, such as kernel ridge regression, kernel logistic regression or the support vector machine. With kernels leading to infinite-dimensional feature spaces,…

Machine Learning · Computer Science 2013-05-23 Francis Bach

The discrete kernel method was developed to estimate count data distributions, distinguishing discrete associated kernels based on their asymptotic behaviour. This study investigates the class of discrete asymmetric kernels and their…

Methodology · Statistics 2017-02-07 Tristan Senga Kiessé

We derive asymptotic normality of kernel type deconvolution estimators of the density, the distribution function at a fixed point, and of the probability of an interval. We consider the so called super smooth case where the characteristic…

Statistics Theory · Mathematics 2007-06-13 A. J. van Es , H. -W. Uh

We prove that given any $\epsilon>0$, random integral $n\times n$ matrices with independent entries that lie in any residue class modulo a prime with probability at most $1-\epsilon$ have cokernels asymptotically (as $n\rightarrow\infty$)…

Number Theory · Mathematics 2015-04-20 Melanie Matchett Wood

We study a one-parameter family of probability measures on lozenge tilings of large regular hexagons that interpolates between the uniform measure on all possible tilings and a particular fully frozen tiling. The description of the…

Mathematical Physics · Physics 2022-07-06 Christophe Charlier , Maurice Duits , Arno B. J. Kuijlaars , Jonatan Lenells

In the current work, we study the eigenvalue distribution results of a class of non-normal matrix-sequences which may be viewed as a low rank perturbation, depending on a parameter $\beta>1$, of the basic Toeplitz matrix-sequence…

Numerical Analysis · Mathematics 2024-02-08 Alec Schiavoni Piazza , David Meadon , Stefano Serra-Capizzano

Empirical observation of high dimensional phenomena, such as the double descent behaviour, has attracted a lot of interest in understanding classical techniques such as kernel methods, and their implications to explain generalization…

In this paper, we consider the problem of estimating the eigenvalues and eigenfunctions of the covariance kernel (i.e., the functional principal components) from sparse and irregularly observed longitudinal data. We approach this problem…

Methodology · Statistics 2007-10-30 Jie Peng , Debashis Paul

We obtain nonasymptotic bounds on the spectral norm of random matrices with independent entries that improve significantly on earlier results. If $X$ is the $n\times n$ symmetric matrix with $X_{ij}\sim N(0,b_{ij}^2)$, we show that…

Probability · Mathematics 2016-08-11 Afonso S. Bandeira , Ramon van Handel

We consider a fast, data-sparse directional method to realize matrix-vector products related to point evaluations of the Helmholtz kernel. The method is based on a hierarchical partitioning of the point sets and the matrix. The considered…

Numerical Analysis · Mathematics 2021-01-08 Günther Of , Raphael Watschinger

In this paper, we study the spectrum and the eigenvectors of radial kernels for mixtures of distributions in $\mathbb{R}^n$. Our approach focuses on high dimensions and relies solely on the concentration properties of the components in the…

Machine Learning · Statistics 2020-01-07 David Cohen-Steiner , Alba Chiara de Vitis

This article studies sufficient conditions on families of approximating kernels which provide $N$--term approximation errors from an associated nonlinear approximation space which match the best known orders of $N$--term wavelet expansion.…

Functional Analysis · Mathematics 2019-03-15 Keaton Hamm , Jeff Ledford

Projected gradient descent and its Riemannian variant belong to a typical class of methods for low-rank matrix estimation. This paper proposes a new Nesterov's Accelerated Riemannian Gradient algorithm by efficient orthographic retraction…

Optimization and Control · Mathematics 2023-06-05 Hongyi Li , Zhen Peng , Chengwei Pan , Di Zhao

The authors use Riemann-Hilbert methods to compute the constant that arises in the asymptotic behavior of the Airy-kernel determinant of random matrix theory.

Functional Analysis · Mathematics 2007-06-21 P. Deift , A. Its , I. Krasovsky

This article proposes a performance analysis of kernel least squares support vector machines (LS-SVMs) based on a random matrix approach, in the regime where both the dimension of data $p$ and their number $n$ grow large at the same rate.…

Machine Learning · Statistics 2016-09-09 Zhenyu Liao , Romain Couillet

In this work, we establish the asymptotic normality of the deconvolution kernel density estimator in the context of strongly mixing random fields. Only minimal conditions on the bandwidth parameter are required and a simple criterion on the…

Statistics Theory · Mathematics 2012-03-19 Ahmed El Ghini , Mohamed El Machkouri