English
Related papers

Related papers: A Spectral Analysis of Dot-product Kernels

200 papers

We precisely quantify the impact of statistical error in the quality of a numerical approximation to a random matrix eigendecomposition, and under mild conditions, we use this to introduce an optimal numerical tolerance for residual error…

We study kernel functions, and associated reproducing kernel Hilbert spaces $\mathscr{H}$ over infinite, discrete and countable sets $V$. Numerical analysis builds discrete models (e.g., finite element) for the purpose of finding…

Functional Analysis · Mathematics 2015-08-17 Palle Jorgensen , Feng Tian

Analyzing the structure of sampled features from an input data distribution is challenging when constrained by limited measurements in both the number of inputs and features. Traditional approaches often rely on the eigenvalue spectrum of…

Machine Learning · Computer Science 2025-02-11 Chanwoo Chun , SueYeon Chung , Daniel D. Lee

In this paper, we illustrate the effectiveness of reproducing kernel Hilbert space techniques in the study of composition operators. For weighted Hardy spaces on the unit disk, we characterize the composition operators whose adjoint is…

Functional Analysis · Mathematics 2026-01-28 Preeti Kumari , P. Muthukumar , Antti Rasila

We develop sampling formulas for high-dimensional functions in reproducing kernel Hilbert spaces, where we rely on irregular samples that are taken at determining sequences of data points. We place particular emphasis on sampling formulas…

Machine Learning · Computer Science 2025-04-21 Armin Iske , Lennart Ohlsen

This paper investigates the eigenvalue problem of integral operators whose kernels can be expressed as a finite sum of pairwise products of single-variable functions, making them separable. By consdiering the matrix form of the separable…

Functional Analysis · Mathematics 2025-11-20 Soma Hirai , Ryoto Watanabe , Yuki Nishida , Masashi Iwasaki

Regularity estimates for an integral operator with a symmetric continuous kernel on a convex bounded domain are derived. The covariance of a mean-square continuous random field on the domain is an example of such an operator. The estimates…

Probability · Mathematics 2022-04-25 Mihály Kovács , Annika Lang , Andreas Petersson

Identifying coherent spatiotemporal patterns generated by complex dynamical systems is a central problem in many science and engineering disciplines. Here, we combine ideas from the theory of operator-valued kernels with delay-embedding…

Data Analysis, Statistics and Probability · Physics 2018-05-24 Dimitrios Giannakis , Joanna Slawinska , Abbas Ourmazd , Zhizhen Zhao

In this paper we consider the problem of approximating vector-valued functions over a domain $\Omega$. For this purpose, we use matrix-valued reproducing kernels, which can be related to Reproducing kernel Hilbert spaces of vectorial…

Numerical Analysis · Mathematics 2019-01-11 Dominik Wittwar , Gabriele Santin , Bernard Haasdonk

We study concentration operators associated with either the discrete or the continuous Fourier transform, that is, operators that incorporate a spatial cut-off and a subsequent frequency cut-off to the Fourier inversion formula. Their…

Functional Analysis · Mathematics 2024-03-11 Felipe Marceca , José Luis Romero , Michael Speckbacher

We study the spectral behavior as the sample size $n \to +\infty$ of integral operators defined by convolution of a non-negative symmetric kernel k with respect to empirical measures $\mu_n = \frac{1}{n} \sum_{i=1}^n \delta_{X_i}$, where…

Spectral Theory · Mathematics 2026-04-13 Manuel Dias

In this paper we study the concentration properties for the eigenvalues of kernel matrices, which are central objects in a wide range of kernel methods and, more recently, in network analysis. We present a set of concentration inequalities…

Machine Learning · Statistics 2020-10-27 Ernesto Araya Valdivia

Computing eigenvalues of very large matrices is a critical task in many machine learning applications, including the evaluation of log-determinants, the trace of matrix functions, and other important metrics. As datasets continue to grow in…

Machine Learning · Statistics 2025-06-16 Siavash Ameli , Chris van der Heide , Liam Hodgkinson , Michael W. Mahoney

In this paper we consider the problems of supervised classification and regression in the case where attributes and labels are functions: a data is represented by a set of functions, and the label is also a function. We focus on the use of…

Machine Learning · Computer Science 2016-11-03 Hachem Kadri , Emmanuel Duflos , Philippe Preux , Stéphane Canu , Alain Rakotomamonjy , Julien Audiffren

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

Learning kernels in operators from data lies at the intersection of inverse problems and statistical learning, providing a powerful framework for capturing non-local dependencies in function spaces and high-dimensional settings. In contrast…

Statistics Theory · Mathematics 2025-06-24 Sichong Zhang , Xiong Wang , Fei Lu

We provide a new estimator of integral operators with smooth kernels, obtained from a set of scattered and noisy impulse responses. The proposed approach relies on the formalism of smoothing in reproducing kernel Hilbert spaces and on the…

Information Theory · Computer Science 2017-12-04 Jérémie Bigot , Paul Escande , Pierre Weiss

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

We characterize the reproducing kernel Hilbert spaces whose elements are $p$-integrable functions in terms of the boundedness of the integral operator whose kernel is the reproducing kernel. Moreover, for $p=2$ we show that the spectral…

Functional Analysis · Mathematics 2007-05-23 Claudio Carmeli , Ernesto De Vito , Alessandro Toigo

This work provides theoretical foundations for kernel methods in the hyperspherical context. Specifically, we characterise the native spaces (reproducing kernel Hilbert spaces) and the Sobolev spaces associated with kernels defined over…

Machine Learning · Statistics 2022-11-18 Simon Hubbert , Emilio Porcu , Chris. J. Oates , Mark Girolami