Related papers: Further properties of Gaussian Reproducing Kernel …
Statistical machine learning plays an important role in modern statistics and computer science. One main goal of statistical machine learning is to provide universally consistent algorithms, i.e., the estimator converges in probability or…
I prove that a Hilbert space has the property that each of its dense (not necessarily closed) subspaces contains an orthoormal basis if and only if it is separable.
Most of existing results on regularized system identification focus on regularized impulse response estimation. Since the impulse response model is a special case of orthonormal basis functions, it is interesting to consider if it is…
Modern datasets across many disciplines increasingly consist of time-evolving, potentially infinite-dimensional random objects, such as dynamic functional data, which are naturally modeled in Hilbert spaces. In these settings,…
We derive a new Rademacher complexity bound for deep neural networks using Koopman operators, group representations, and reproducing kernel Hilbert spaces (RKHSs). The proposed bound describes why the models with high-rank weight matrices…
We propose a vector-valued regression problem whose solution is equivalent to the reproducing kernel Hilbert space (RKHS) embedding of the Bayesian posterior distribution. This equivalence provides a new understanding of kernel Bayesian…
Based on direct integrals, a framework allowing to integrate a parametrised family of reproducing kernels with respect to some measure on the parameter space is developed. By pointwise integration, one obtains again a reproducing kernel…
This article derives an accurate, explicit, and numerically stable approximation to the kernel quadrature weights in one dimension and on tensor product grids when the kernel and integration measure are Gaussian. The approximation is based…
We analyze special classes of bi-orthogonal sets of vectors in Hilbert and in Krein spaces, and their relations with generalized Riesz systems. In this way, the notion of the first/second type sequences is introduced and studied. We also…
We present accurate upper and lower bounds for the covering numbers, with explicit constants, of the unit ball for two general classes of Reproducing Kernel Hilbert Space (RKHS) on the unit sphere of $\mathbb{R}^{d+1}$. In both classes, the…
Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions,…
In this paper we will consider, in the abstract setting of rigged Hilbert spaces, distribution valued functions and we will investigate, in particular, conditions for them to constitute a "continuous basis" for the smallest space $\mathcal…
We study the orthogonal complement of the Hilbert subspace considered by by van Eijndhoven and Meyers in [J. Math. Anal. Appl. 146 (1990), no. 1, 89--98} and associated to holomorphic Hermite polynomials. A polyanalytic orthonormal basis is…
We study reproducing kernel Hilbert spaces introduced as ranges of generalized Ces\`aro-Hardy operators, in one real variable and in one complex variable. Such spaces can be seen as formed by absolutely continuous functions on the positive…
Motivated by the abundance of functional data such as time series and images, there has been a growing interest in integrating such data into neural networks and learning maps from function spaces to R (i.e., functionals). In this paper, we…
We propose a new point of view for regularizing deep neural networks by using the norm of a reproducing kernel Hilbert space (RKHS). Even though this norm cannot be computed, it admits upper and lower approximations leading to various…
The Gaussian Lipschitz space was defined by Gatto and Urbina, by means of the Ornstein-Uhlenbeck Poisson kernel. We give a characterization of this space in terms of a combination of ordinary Lipschitz continuity conditions. The main tools…
K. It\^{o} characterised in \cite{ito} zero-mean stationary Gauss Markov-processes evolving on a class of infinite-dimensional spaces. In this work we extend the work of It\^{o} in the case of Hilbert spaces: Gauss-Markov families that are…
In this article, we consider a generalization of the conjugate Hardy $H^2$ spaces, and give some properties of the minimal norm of the generalization and some relations between the norm of the generalization and the minimal $L^2$ integrals.…
The completeness of Gaussians in a Hilbert functional space is established