Related papers: Deep Neural Tangent Kernel and Laplace Kernel Have…
Recent studies have reported $\textit{saturation effects}$ and $\textit{multiple descent behavior}$ in large dimensional kernel ridge regression (KRR). However, these findings are predominantly derived under restrictive settings, such as…
We introduce a scalable method to approximate the kernel of the Linearized Laplace Approximation (LLA). For this, we use a surrogate deep neural network (DNN) that learns a compact feature representation whose inner product replicates the…
Gaussian Radial Basis Function (RBF) Kernels are the most-often-employed kernels in artificial intelligence and machine learning routines for providing optimally-best results in contrast to their respective counter-parts. However, a little…
The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…
This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…
This paper proposes a method for constructing one-step prediction tubes for nonlinear systems using reproducing kernel Hilbert spaces. We approximate a bounded reproducing kernel Hilbert space (RKHS) hypothesis set by a finite-dimensional…
In this note we prove that the reproducing kernel of a Hilbert space satisfying the division property has integrable form, is locally of trace class, and the Hilbert space itself is a Hilbert space of holomorphic functions.
In this paper we consider an elliptic operator with constant coefficients and we estimate the maximal function of the tangential gradient of the kernel of the double layer potential with respect to its first variable. As a consequence, we…
Quantized neural networks have drawn a lot of attention as they reduce the space and computational complexity during the inference. Moreover, there has been folklore that quantization acts as an implicit regularizer and thus can improve the…
We introduce a projective Riesz $s$-kernel for the unit sphere $\mathbb{S}^{d-1}$ and investigate properties of $N$-point energy minimizing configurations for such a kernel. We show that these configurations, for $s$ and $N$ sufficiently…
Asymptotic expansions as well as necessary and sufficient conditions are provided for the pointwise convergence of the spherical partial integrals of the associated Fourier transforms on the real hyperbolic space. The proposed method…
We study the complex geometry of generalized Kepler manifolds, defined in Jordan theoretic terms, introduce Hilbert spaces of holomorphic functions defined by radial measures, and find the complete asymptotic expansion of the corresponding…
Constructing accurate, high dimensional molecular potential energy surfaces (PESs) for polyatomic molecules is challenging. Reproducing Kernel Hilbert space (RKHS) interpolation is an efficient way to construct such PESs. However, the…
We describe those reproducing kernel Hilbert spaces of holomorphic functions on domains in ${\Bbb C}^d$ for which an analogue of the Nevanlinna-Pick theorem holds, in other words when the existence of a (possibly matrix-valued) function in…
In this paper, we develop a generalized theory of convolutional signal processing and neural networks for Reproducing Kernel Hilbert Spaces (RKHS). Leveraging the theory of algebraic signal processing (ASP), we show that any RKHS allows the…
The neural tangent kernel (NTK) has garnered significant attention as a theoretical framework for describing the behavior of large-scale neural networks. Kernel methods are theoretically well-understood and as a result enjoy algorithmic…
Regularized kernel methods such as support vector machines (SVM) and support vector regression (SVR) constitute a broad and flexible class of methods which are theoretically well investigated and commonly used in nonparametric…
A recent breakthrough in deep learning theory shows that the training of over-parameterized deep neural networks can be characterized by a kernel function called \textit{neural tangent kernel} (NTK). However, it is known that this type of…
In this paper, we use the infamous continuous and nowhere differentiable Weierstrass function as a prototype to define a Weierstrass fractal kernel. We investigate the properties of the reproducing kernel Hilbert space (RKHS) associated…
Kernel embeddings have emerged as a powerful tool for representing probability measures in a variety of statistical inference problems. By mapping probability measures into a reproducing kernel Hilbert space (RKHS), kernel embeddings enable…