English
Related papers

Related papers: Lipschitz and H\"older Continuity in Reproducing K…

200 papers

Given a Banach space $E$ consisting of functions, we ask whether there exists a reproducing kernel Hilbert space $H$ with bounded kernel such that $E\subset H$. More generally, we consider the question, whether for a given Banach space…

Functional Analysis · Mathematics 2024-02-21 Max Schölpple , Ingo Steinwart

Let $\{v_n\}$ be a complete minimal system in a Hilbert space $\mathcal{H}$ and let $\{w_m\}$ be its biorthogonal system. It is well known that $\{w_m\}$ is not necessarily complete. However the situation may change if we consider systems…

Complex Variables · Mathematics 2011-12-26 Anton Baranov , Yurii Belov

We study two extension problems, and their interconnections: (i) extension of positive definite (p.d.) continuous functions defined on subsets in locally compact groups $G$; and (ii) (in case of Lie groups $G$) representations of the…

Functional Analysis · Mathematics 2014-01-22 Palle Jorgensen , Steen Pedersen , Feng Tian

In this paper, we study the asymptotic properties of regularized least squares with indefinite kernels in reproducing kernel Krein spaces (RKKS). By introducing a bounded hyper-sphere constraint to such non-convex regularized risk…

Machine Learning · Statistics 2020-11-26 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

Over the last decade, kernel methods for nonlinear processing have successfully been used in the machine learning community. The primary mathematical tool employed in these methods is the notion of the Reproducing Kernel Hilbert Space.…

Machine Learning · Computer Science 2017-04-26 Pantelis Bouboulis , Sergios Theodoridis

This note consists of two largely independent parts. In the first part we give conditions on the kernel $k: \Omega \times \Omega \rightarrow \mathbb{R}$ of a reproducing kernel Hilbert space $H$ continuously embedded via the identity…

Functional Analysis · Mathematics 2022-06-16 Marcin Wnuk

This paper studies convergence of empirical risks in reproducing kernel Hilbert spaces (RKHS). A conventional assumption in the existing research is that empirical training data do not contain any noise but this may not be satisfied in some…

Optimization and Control · Mathematics 2020-05-19 Shaoyan Guo , Huifu Xu , Liwei Zhang

We review definitions and properties of reproducing kernel Hilbert spaces attached to Gaussian variables and processes, with a view to applications in nonparametric Bayesian statistics using Gaussian priors. The rate of contraction of…

Functional Analysis · Mathematics 2008-12-18 A. W. van der Vaart , J. H. van Zanten

Motivated by multi-task machine learning with Banach spaces, we propose the notion of vector-valued reproducing kernel Banach spaces (RKBS). Basic properties of the spaces and the associated reproducing kernels are investigated. We also…

Functional Analysis · Mathematics 2012-02-20 Haizhang Zhang , Jun Zhang

To characterize the function space explored by neural networks (NNs) is an important aspect of learning theory. In this work, noticing that a multi-layer NN generates implicitly a hierarchy of reproducing kernel Hilbert spaces (RKHSs) -…

Machine Learning · Computer Science 2024-04-12 Zhengdao Chen

The present report, has been inspired by the need of the author and its colleagues to understand the underlying theory of Wirtinger's Calculus and to further extend it to include the kernel case. The aim of the present manuscript is…

Machine Learning · Computer Science 2010-06-02 P. Bouboulis

We present a simple but powerful reinterpretation of kernelized locality-sensitive hashing (KLSH), a general and popular method developed in the vision community for performing approximate nearest-neighbor searches in an arbitrary…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Ke Jiang , Qichao Que , Brian Kulis

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

This paper focuses on the use of the theory of Reproducing Kernel Hilbert Spaces in the statistical analysis of replicated point processes. We show that spatial point processes can be observed as random variables in a Reproducing Kernel…

Methodology · Statistics 2023-01-06 Amelia Simó

This paper studies the probabilistic function approximation problem over reproducing kernel Hilbert spaces. We show the existence and uniqueness of the optimizer under mild assumptions. Furthermore, we generalize the celebrated representer…

Functional Analysis · Mathematics 2025-07-16 Dongwei Chen , Kai-Hsiang Wang

Foundations of the theory of Hilbert spaces with reproducing kernels are discussed. It is demonstrated that the claims in the papers of S.Saitoh and in his book "Theory of reproducing kernels and applications, Pitman research notes, 189,…

Mathematical Physics · Physics 2007-05-23 A. G. Ramm

We propose a new data-driven approach for learning the fundamental solutions (Green's functions) of various linear partial differential equations (PDEs) given sample pairs of input-output functions. Building off the theory of functional…

Statistics Theory · Mathematics 2023-04-11 George Stepaniants

The polynomial kernels are widely used in machine learning and they are one of the default choices to develop kernel-based classification and regression models. However, they are rarely used and considered in numerical analysis due to their…

We study embeddings between reproducing kernel Hilbert spaces $H(K)$ of functions of $d \in \mathbb{N} \cup \{\infty\}$ variables. The kernels $K$ are superpositions of weighted finite tensor products of a fixed univariate kernel. The basic…

Numerical Analysis · Mathematics 2026-05-01 Michael Gnewuch , Peter Kritzer , Klaus Ritter

This monograph develops a unified, application-driven framework for kernel methods grounded in reproducing kernel Hilbert spaces (RKHS) and optimal transport (OT). Part I lays the theoretical and numerical foundations on positive-definite…

Numerical Analysis · Mathematics 2025-10-07 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov