English
Related papers

Related papers: Reproducing Kernel Hilbert Space vs. Frame Estimat…

200 papers

This is a survey article on Mercer's Theorem in its most general form and its relations with the theory of reproducing kernel Hilbert spaces and the spectral theory of compact operators. We provide a modern introduction to the basics of the…

Functional Analysis · Mathematics 2025-12-09 Aurelian Gheondea

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Motivated by questions in quantum theory, we study Hilbert space valued Gaussian processes, and operator-valued kernels, i.e., kernels taking values in B(H) (= all bounded linear operators in a fixed Hilbert space H). We begin with a…

Functional Analysis · Mathematics 2024-08-21 Palle E. T. Jorgensen , James Tian

This work provides theoretical foundations for kernel methods in the hyperspherical context. Specifically, we characterise the native spaces (reproducing kernel Hilbert spaces) and the Sobolev spaces associated with kernels defined over…

Machine Learning · Statistics 2022-11-18 Simon Hubbert , Emilio Porcu , Chris. J. Oates , Mark Girolami

The study presents a vector-valued extension of the classical Mercer theorem within the framework of reproducing kernel Hilbert spaces defined over Kaplansky-Hilbert modules associated with the algebra of essentially bounded measurable…

Functional Analysis · Mathematics 2025-11-24 A. Arziev , K. Kudaybergenov. P. Orinbaev

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

We characterize those generating functions k that produce weighted Hardy spaces of the unit disk D supporting nontrivial Hermitian weighted composition operators. Our characterization shows that the spaces associated with the "classical…

Functional Analysis · Mathematics 2011-04-08 Paul Bourdon , Wenling Shang

We consider existence and uniqueness of symmetric approximation of frames by normalized tight frames and of symmetric orthogonalization of bases by orthonormal bases in Hilbert spaces H . More precisely, we determine whether a given frame…

Functional Analysis · Mathematics 2025-05-08 M. Frank , V. I. Paulsen , T. R. Tiballi

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

In this note we prove that the reproducing kernel of a Hilbert space satisfying the division property has integrable form, is locally of trace class, and the Hilbert space itself is a Hilbert space of holomorphic functions.

Functional Analysis · Mathematics 2018-12-10 Alexander I. Bufetov , Roman V. Romanov

We review machine learning methods employing positive definite kernels. These methods formulate learning and estimation problems in a reproducing kernel Hilbert space (RKHS) of functions defined on the data domain, expanded in terms of a…

Statistics Theory · Mathematics 2009-09-29 Thomas Hofmann , Bernhard Schölkopf , Alexander J. Smola

A weighted composition operator on a reproducing kernel Hilbert space is given by a composition, followed by a multiplication. We study unitary and co-isometric weighted composition operators on unitarily invariant spaces on the Euclidean…

Functional Analysis · Mathematics 2025-12-23 Michael Hartz , Maximilian Tornes

We use a classical characterisation to prove that functions which are bounded away from zero cannot be elements of reproducing kernel Hilbert spaces whose reproducing kernels decays to zero in a suitable way. The result is used to study…

Functional Analysis · Mathematics 2021-02-23 Toni Karvonen

We develop sampling formulas for high-dimensional functions in reproducing kernel Hilbert spaces, where we rely on irregular samples that are taken at determining sequences of data points. We place particular emphasis on sampling formulas…

Machine Learning · Computer Science 2025-04-21 Armin Iske , Lennart Ohlsen

This monograph studies the relations between two approaches using positive definite kernels: probabilistic methods using Gaussian processes, and non-probabilistic methods using reproducing kernel Hilbert spaces (RKHS). They are widely…

Machine Learning · Statistics 2025-06-24 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K. Sriperumbudur

This article studies the problem of approximating functions belonging to a Hilbert space $H_d$ with an isotropic or anisotropic Gaussian reproducing kernel, $$ K_d(\bx,\bt) = \exp\left(-\sum_{\ell=1}^d\gamma_\ell^2(x_\ell-t_\ell)^2\right) \…

Numerical Analysis · Mathematics 2015-01-16 Gregory E. Fasshauer , Fred J. Hickernell , Henryk Woźniakowski

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

Nonparametric feature selection in high-dimensional data is an important and challenging problem in statistics and machine learning fields. Most of the existing methods for feature selection focus on parametric or additive models which may…

Methodology · Statistics 2021-03-31 Hang Yu , Yuanjia Wang , Donglin Zeng

A general theory of reproducing kernels and reproducing kernel Hilbert spaces on a right quaternionic Hilbert space is presented. Positive operator valued measures and their connection to a class of generalized quaternionic coherent states…

Mathematical Physics · Physics 2017-09-11 K. Thirulogasanthar , S. Twareque Ali

It is often said that control and estimation problems are in duality. Recently, in (Aubin-Frankowski,2021), we found new reproducing kernels in Linear-Quadratic optimal control by focusing on the Hilbert space of controlled trajectories,…

Optimization and Control · Mathematics 2022-10-14 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan