English
Related papers

Related papers: Unified Native Spaces in Kernel Methods

200 papers

The main purpose of this paper is providing a systematic study and classification of non-scalar kernels for Reproducing Kernel Hilbert Spaces (RKHS), to be used in the analysis of deformation in shape spaces endowed with metrics induced by…

Functional Analysis · Mathematics 2013-09-04 Mario Micheli , Joan Alexis Glaunès

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

This monograph develops a unified, application-driven framework for kernel methods grounded in reproducing kernel Hilbert spaces (RKHS) and optimal transport (OT). Part I lays the theoretical and numerical foundations on positive-definite…

Numerical Analysis · Mathematics 2025-10-07 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

In classical frameworks as the Euclidean space, positive definite kernels as well as their analytic properties are explicitly available and can be incorporated directly in kernel-based learning algorithms. This is different if the…

Numerical Analysis · Mathematics 2023-01-18 Wolfgang Erb

In many instances one has to deal with parametric models. Such models in vector spaces are connected to a linear map. The reproducing kernel Hilbert space and affine- / linear- representations in terms of tensor products are directly…

Numerical Analysis · Mathematics 2018-11-26 Hermann G. Matthies , Roger Ohayon

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

Machine Learning · Computer Science 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

Given the reproducing kernel $k$ of the Hilbert space $\mathcal{H}_k$ we study spaces $\mathcal{H}_k(b)$ whose reproducing kernel has the form $k(1-bb^*)$, where $b$ is a row-contraction on $\mathcal{H}_k$. In terms of reproducing kernels…

Functional Analysis · Mathematics 2024-12-17 Alexandru Aleman , Frej Dahlin

Reproducing kernel Hilbert spaces (RKHSs) are key spaces for machine learning that are becoming popular also for linear system identification. In particular, the so-called stable RKHSs can be used to model absolutely summable impulse…

Machine Learning · Computer Science 2020-05-07 Mauro Bisiacco , Gianluigi Pillonetto

The use of kernel functions is a common technique to extract important features from data sets. A quantum computer can be used to estimate kernel entries as transition amplitudes of unitary circuits. Quantum kernels exist that, subject to…

In this paper we introduce a generalization of the classical $\Leb_2(\Rd)$-based Sobolev spaces with the help of a vector differential operator $\mathbf{P}$ which consists of finitely or countably many differential operators $P_n$ which…

Numerical Analysis · Mathematics 2011-09-02 Qi Ye

For the past 30 years or so, machine learning has stimulated a great deal of research in the study of approximation capabilities (expressive power) of a multitude of processes, such as approximation by shallow or deep neural networks,…

Machine Learning · Computer Science 2025-01-07 Hrushikesh Mhaskar

In this note, we compute the reproducing kernel for the RKHS of functions on $\mathbb{R}^n$ in a sufficiently high Sobolev norm.

Classical Analysis and ODEs · Mathematics 2023-07-18 Steven Rosenberg

We develop a stochastic approximation framework for learning nonlinear operators between infinite-dimensional spaces utilizing general Mercer operator-valued kernels. Our framework encompasses two key classes: (i) compact kernels, which…

Machine Learning · Statistics 2026-01-13 Jia-Qi Yang , Lei Shi

In this paper, we illustrate the effectiveness of reproducing kernel Hilbert space techniques in the study of composition operators. For weighted Hardy spaces on the unit disk, we characterize the composition operators whose adjoint is…

Functional Analysis · Mathematics 2026-01-28 Preeti Kumari , P. Muthukumar , Antti Rasila

In the paper we investigate the properties of spaces with generalized smoothness, such as Calder\'on spaces that include the classical Nikolskii-Besov spaces and many of their generalizations, and describe differential properties of…

Functional Analysis · Mathematics 2020-07-17 Elza Bakhtigareeva , Mikhail L. Goldman , Dorothee D. Haroske

The aim of the paper is to create a link between the theory of reproducing kernel Hilbert spaces (RKHS) and the notion of a unitary representation of a group or of a groupoid. More specifically, it is demonstrated on one hand, how to…

Functional Analysis · Mathematics 2021-02-22 Monika Drewnik , Tomasz Miller , Zbigniew Pasternak-Winiarski

Positive definite kernels and their associated Reproducing Kernel Hilbert Spaces provide a mathematically compelling and practically competitive framework for learning from data. In this paper we take the approximation theory point of view…

Machine Learning · Computer Science 2018-08-06 Mikhail Belkin

We derive symmetric and antisymmetric kernels by symmetrizing and antisymmetrizing conventional kernels and analyze their properties. In particular, we compute the feature space dimensions of the resulting polynomial kernels, prove that the…

Quantum Physics · Physics 2021-12-14 Stefan Klus , Patrick Gelß , Feliks Nüske , Frank Noé

We present a systematic study of the family of positive definite (p.d.) kernels with the use of their associated feature maps and feature spaces. For a fixed set $X$, generalizing Loewner, we make precise the corresponding partially ordered…

Functional Analysis · Mathematics 2025-01-22 Palle E. T. Jorgensen , James Tian

We describe those reproducing kernel Hilbert spaces of holomorphic functions on domains in ${\Bbb C}^d$ for which an analogue of the Nevanlinna-Pick theorem holds, in other words when the existence of a (possibly matrix-valued) function in…

Functional Analysis · Mathematics 2016-10-07 Jim Agler , John E. McCarthy