English
Related papers

Related papers: Generalized Mercer Kernels and Reproducing Kernel …

200 papers

We characterize the solution of a broad class of convex optimization problems that address the reconstruction of a function from a finite number of linear measurements. The underlying hypothesis is that the solution is decomposable as a…

Optimization and Control · Mathematics 2021-07-26 Michael Unser , Shayan Aziznejad

Reproducing kernel Hilbert spaces (RKHSs) are Hilbert spaces of functions where pointwise evaluation is continuous. There are known examples of RKHSs that are Banach algebras under pointwise multiplication. These examples are built from…

Functional Analysis · Mathematics 2024-02-09 Dimitrios Giannakis , Michael Montgomery

Targeting at sparse learning, we construct Banach spaces B of functions on an input space X with the properties that (1) B possesses an l1 norm in the sense that it is isometrically isomorphic to the Banach space of integrable functions on…

Machine Learning · Statistics 2015-01-16 Guohui Song , Haizhang Zhang , Fred J. Hickernell

Kernel expansions are a topic of considerable interest in machine learning, also because of their relation to the so-called feature maps introduced in machine learning. Properties of the associated basis functions and weights (corresponding…

Machine Learning · Computer Science 2024-10-03 Mauro Bisiacco , Gianluigi Pillonetto

Supervised learning in reproducing kernel Hilbert space (RKHS) and vector-valued RKHS (vvRKHS) has been investigated for more than 30 years. In this paper, we provide a new twist to this rich literature by generalizing supervised learning…

Machine Learning · Statistics 2024-06-27 Yuka Hashimoto , Masahiro Ikeda , Hachem Kadri

Reproducing kernel Hilbert spaces are uniquely characterized by their kernel, but reproducing kernel Banach spaces (RKBS) are not. However, a characterization of which RKBS admit a given kernel as reproducing kernel is lacking. This work…

Functional Analysis · Mathematics 2026-03-31 Tjeerd Jan Heeringa

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

A Hilbert space embedding for probability measures has recently been proposed, wherein any probability measure is represented as a mean element in a reproducing kernel Hilbert space (RKHS). Such an embedding has found applications in…

Machine Learning · Statistics 2010-03-04 Bharath K. Sriperumbudur , Kenji Fukumizu , Gert R. G. Lanckriet

We analyse the convergence of sampling algorithms for functions in reproducing kernel Hilbert spaces (RKHS). To this end, we discuss approximation properties of kernel regression under minimalistic assumptions on both the kernel and the…

Machine Learning · Statistics 2025-04-21 Armin Iske

Koopman and Perron-Frobenius operators for dynamical systems have been getting popular in a number of fields in science these days. Properties of the Koopman operator essentially depend on the choice of function spaces where it acts.…

Dynamical Systems · Mathematics 2024-01-29 Masahiro Ikeda , Isao Ishikawa , Corbinian Schlosser

Reproducing kernel Hilbert spaces (RKHSs) are key elements of many non-parametric tools successfully used in signal processing, statistics, and machine learning. In this work, we aim to address three issues of the classical RKHS based…

Signal Processing · Electrical Eng. & Systems 2019-05-09 Maria Peifer , Luiz. F. O. Chamon , Santiago Paternain , Alejandro Ribeiro

In a general context of positive definite kernels $k$, we develop tools and algorithms for sampling in reproducing kernel Hilbert space $\mathscr{H}$ (RKHS). With reference to these RKHSs, our results allow inference from samples; more…

Functional Analysis · Mathematics 2016-01-28 Palle Jorgensen , Feng Tian

Characterizing the function spaces defined by neural networks helps understanding the corresponding learning models and their inductive bias. While in some limits neural networks correspond to function spaces that are Hilbert spaces, these…

Machine Learning · Statistics 2025-08-22 Francesca Bartolucci , Ernesto De Vito , Lorenzo Rosasco , Stefano Vigogna

This monograph develops a unified, application-driven framework for kernel methods grounded in reproducing kernel Hilbert spaces (RKHS) and optimal transport (OT). Part I lays the theoretical and numerical foundations on positive-definite…

Numerical Analysis · Mathematics 2025-10-07 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

Kernel mean embeddings have recently attracted the attention of the machine learning community. They map measures $\mu$ from some set $M$ to functions in a reproducing kernel Hilbert space (RKHS) with kernel $k$. The RKHS distance of two…

Machine Learning · Statistics 2019-12-18 Carl-Johann Simon-Gabriel , Bernhard Schölkopf

Motivated by the need of processing functional-valued data, or more general, operatorvalued data, we introduce the notion of the operator reproducing kernel Hilbert space (ORKHS). This space admits a unique operator reproducing kernel which…

Functional Analysis · Mathematics 2016-10-23 Rui Wang , Yuesheng Xu

Kernel methods, being supported by a well-developed theory and coming with efficient algorithms, are among the most popular and successful machine learning techniques. From a mathematical point of view, these methods rest on the concept of…

Machine Learning · Statistics 2023-03-20 Christian Fiedler , Michael Herty , Michael Rom , Chiara Segala , Sebastian Trimpe

The study presents a vector-valued extension of the classical Mercer theorem within the framework of reproducing kernel Hilbert spaces defined over Kaplansky-Hilbert modules associated with the algebra of essentially bounded measurable…

Functional Analysis · Mathematics 2025-11-24 A. Arziev , K. Kudaybergenov. P. Orinbaev

Characterizing the function spaces corresponding to neural networks can provide a way to understand their properties. In this paper we discuss how the theory of reproducing kernel Banach spaces can be used to tackle this challenge. In…

Machine Learning · Statistics 2021-10-27 Francesca Bartolucci , Ernesto De Vito , Lorenzo Rosasco , Stefano Vigogna

In this paper, we define the sum of RKBSs using the characterization theorem of RKBSs and show that the sum of RKBSs is compatible with the direct sum of feature spaces. Moreover, we decompose the integral RKBS into the sum of $p$-norm…

Functional Analysis · Mathematics 2025-04-02 Seungcheol Shin , Myungjoo Kang