English
Related papers

Related papers: n-Best Kernel Approximation in Reproducing Kernel …

200 papers

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

Machine Learning · Computer Science 2022-02-09 John Paul Ryan , Anil Damle

We consider an incremental approximation method for solving variational problems in infinite-dimensional Hilbert spaces, where in each step a randomly and independently selected subproblem from an infinite collection of subproblems is…

Numerical Analysis · Mathematics 2018-03-06 Michael Griebel , Peter Oswald

We describe a method to perform functional operations on probability distributions of random variables. The method uses reproducing kernel Hilbert space representations of probability distributions, and it is applicable to all operations…

Machine Learning · Statistics 2016-09-14 Bernhard Schölkopf , Krikamol Muandet , Kenji Fukumizu , Jonas Peters

We study the recovery of multivariate functions from reproducing kernel Hilbert spaces in the uniform norm. Our main interest is to obtain preasymptotic estimates for the corresponding sampling numbers. We obtain results in terms of the…

Numerical Analysis · Mathematics 2024-10-29 Kateryna Pozharska , Tino Ullrich

Given the reproducing kernel $k$ of the Hilbert space $\mathcal{H}_k$ we study spaces $\mathcal{H}_k(b)$ whose reproducing kernel has the form $k(1-bb^*)$, where $b$ is a row-contraction on $\mathcal{H}_k$. In terms of reproducing kernels…

Functional Analysis · Mathematics 2024-12-17 Alexandru Aleman , Frej Dahlin

In this paper we introduce a reproducing kernel Hilbert space defined on $\mathbb{R}^{d+1}$ as the tensor product of a reproducing kernel defined on the unit sphere $\mathbb{S}^{d}$ in $\mathbb{R}^{d+1}$ and a reproducing kernel defined on…

Numerical Analysis · Mathematics 2015-12-24 Johann S. Brauchart , Josef Dick , Lou Fang

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

We study universal approximation of continuous functionals on compact subsets of products of Hilbert spaces. We prove that any such functional can be uniformly approximated by models that first take finitely many continuous linear…

Machine Learning · Computer Science 2026-02-04 Andrey Krylov , Maksim Penkin

In this article, we consider convergence rates in functional linear regression with functional responses, where the linear coefficient lies in a reproducing kernel Hilbert space (RKHS). Without assuming that the reproducing kernel and the…

Methodology · Statistics 2012-11-20 Heng Lian

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

This paper addresses the problem of regression to reconstruct functions, which are observed with superimposed errors at random locations. We address the problem in reproducing kernel Hilbert spaces. It is demonstrated that the estimator,…

Statistics Theory · Mathematics 2021-08-17 Paul Dommel , Alois Pichler

Kernel methods approximate nonlinear maps in a data-driven manner by projecting the target map onto a finite-dimensional Hilbert space called the solution space. Traditionally, this space is a subspace of a fixed ambient reproducing kernel…

Numerical Analysis · Mathematics 2026-01-30 Tamás Dózsa , Andrea Angino , Zoltán Szabó , József Bokor , Matthias Voigt

This paper introduces the Quantum Covariance Embedding, which embeds Positive Operator-Valued Measures into a tensor product of a Reproducing Kernel Hilbert Space and the quantum state space via a tensorized Bochner integral. This…

Statistics Theory · Mathematics 2026-05-26 Philipp Nikolas Mayer , Ho Yun

We study the recovery of functions in various norms, including $L_p$ with $1\le p\le\infty$, based on function evaluations. We obtain worst case error bounds for general classes of functions in terms of the best $L_2$-approximation from a…

Numerical Analysis · Mathematics 2025-12-23 David Krieg , Kateryna Pozharska , Mario Ullrich , Tino Ullrich

Function encoders are a recent technique that learn neural network basis functions to form compact, adaptive representations of Hilbert spaces of functions. We show that function encoders provide a principled connection to feature learning…

Machine Learning · Computer Science 2025-09-26 Su Ann Low , Quentin Rommel , Kevin S. Miller , Adam J. Thorpe , Ufuk Topcu

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

We propose a simple and effective method for designing approximation formulas for weighted analytic functions. We consider spaces of such functions according to weight functions expressing the decay properties of the functions. Then, we…

Numerical Analysis · Mathematics 2018-08-31 Ken'ichiro Tanaka , Masaaki Sugihara

Devoted to multi-task learning and structured output learning, operator-valued kernels provide a flexible tool to build vector-valued functions in the context of Reproducing Kernel Hilbert Spaces. To scale up these methods, we extend the…

Machine Learning · Computer Science 2018-05-25 Romain Brault , Florence d'Alché-Buc , Markus Heinonen

We~identify the standard weighted Bergman kernels of spaces of nearly holomorphic functions, in~the sense of Shimura, on~bounded symmetric domains. This also yields a description of the analogous kernels for spaces of…

Complex Variables · Mathematics 2023-03-07 Miroslav Engliš , El-Hassan Youssfi , Genkai Zhang

We study embeddings between reproducing kernel Hilbert spaces $H(K)$ of functions of $d \in \mathbb{N} \cup \{\infty\}$ variables. The kernels $K$ are superpositions of weighted finite tensor products of a fixed univariate kernel. The basic…

Numerical Analysis · Mathematics 2026-05-01 Michael Gnewuch , Peter Kritzer , Klaus Ritter