English
Related papers

Related papers: Embeddings of Reproducing Kernel Hilbert Spaces wi…

200 papers

We prove that kernel covariance embeddings lead to information-theoretically perfect separation of distinct continuous probability distributions. In statistical terms, we establish that testing for the \emph{equality} of two non-atomic…

Machine Learning · Statistics 2026-05-14 Leonardo V. Santoro , Kartik G. Waghmare , Victor M. Panaretos

In this article, the reproducing kernel Hilbert space [0, 1] is employed for solving a class of third-order periodic boundary value problem by using fitted reproducing kernel algorithm. The reproducing kernel function is built to get fast…

Numerical Analysis · Mathematics 2017-04-18 Asad Freihat , Radwan Abu-Gdairi , Hammad Khalil , Eman Abuteen , Mohammed Al-Smadi , Rahmat Ali Khan

We study embedding a subset $K$ of the unit sphere to the Hamming cube $\{-1,+1\}^m$. We characterize the tradeoff between distortion and sample complexity $m$ in terms of the Gaussian width $\omega(K)$ of the set. For subspaces and several…

Machine Learning · Computer Science 2015-12-15 Samet Oymak , Ben Recht

We present hash embeddings, an efficient method for representing words in a continuous vector form. A hash embedding may be seen as an interpolation between a standard word embedding and a word embedding created using a random hash function…

Computation and Language · Computer Science 2017-09-13 Dan Svenstrup , Jonas Meinertz Hansen , Ole Winther

There exists a plethora of parametric models for positive definite kernels, and their use is ubiquitous in disciplines as diverse as statistics, machine learning, numerical analysis, and approximation theory. Usually, the kernel parameters…

Machine Learning · Statistics 2025-01-06 Xavier Emery , Emilio Porcu , Moreno Bevilacqua

We introduce a vector differential operator $\mathbf{P}$ and a vector boundary operator $\mathbf{B}$ to derive a reproducing kernel along with its associated Hilbert space which is shown to be embedded in a classical Sobolev space. This…

Numerical Analysis · Mathematics 2011-09-28 Gregory E. Fasshauer , Qi Ye

In this paper we consider the reproducing kernel thesis for boundedness and compactness for various operators on Bergman-type spaces. In particular, the results in this paper apply to the weighted Bergman space on the unit ball, the unit…

Complex Variables · Mathematics 2018-02-09 Mishko Mitkovski , Brett D. Wick

Modeling videos and image-sets as linear subspaces has proven beneficial for many visual recognition tasks. However, it also incurs challenges arising from the fact that linear subspaces do not obey Euclidean geometry, but lie on a special…

Computer Vision and Pattern Recognition · Computer Science 2014-07-07 Mehrtash T. Harandi , Mathieu Salzmann , Sadeep Jayasumana , Richard Hartley , Hongdong Li

This paper reviews the functional aspects of statistical learning theory. The main point under consideration is the nature of the hypothesis set when no prior information is available but data. Within this framework we first discuss about…

Machine Learning · Statistics 2016-11-25 Stephane Canu , Xavier Mary , Alain Rakotomamonjy

In this paper, we introduce the notion of reproducing kernel Hilbert spaces for graphs and the Gram matrices associated with them. Our aim is to investigate the Gram matrices of reproducing kernel Hilbert spaces. We provide several bounds…

Combinatorics · Mathematics 2012-12-19 Michio Seto , Sho Suda , Tetsuji Taniguchi

In this work, we analyze the learnability of reproducing kernel Hilbert spaces (RKHS) under the $L^\infty$ norm, which is critical for understanding the performance of kernel methods and random feature models in safety- and…

Machine Learning · Statistics 2023-06-06 Hongrui Chen , Jihao Long , Lei Wu

Since persistence diagrams do not admit an inner product structure, a map into a Hilbert space is needed in order to use kernel methods. It is natural to ask if such maps necessarily distort the metric on persistence diagrams. We show that…

Machine Learning · Computer Science 2020-07-31 Peter Bubenik , Alexander Wagner

This paper generalizes regularized regression problems in a hyper-reproducing kernel Hilbert space (hyper-RKHS), illustrates its utility for kernel learning and out-of-sample extensions, and proves asymptotic convergence results for the…

Machine Learning · Computer Science 2022-10-20 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

Reproducing kernel Hilbert spaces are uniquely characterized by their kernel, but reproducing kernel Banach spaces (RKBS) are not. However, a characterization of which RKBS admit a given kernel as reproducing kernel is lacking. This work…

Functional Analysis · Mathematics 2026-03-31 Tjeerd Jan Heeringa

Despite their many appealing properties, kernel methods are heavily affected by the curse of dimensionality. For instance, in the case of inner product kernels in $\mathbb{R}^d$, the Reproducing Kernel Hilbert Space (RKHS) norm is often…

Machine Learning · Computer Science 2021-11-09 Michael Celentano , Theodor Misiakiewicz , Andrea Montanari

Optimal experimental design seeks to determine the most informative allocation of experiments to infer an unknown statistical quantity. In this work, we investigate the optimal design of experiments for {\em estimation of linear functionals…

Artificial Intelligence · Computer Science 2023-01-18 Mojmír Mutný , Andreas Krause

We provide a theoretical foundation for non-parametric estimation of functions of random variables using kernel mean embeddings. We show that for any continuous function $f$, consistent estimators of the mean embedding of a random variable…

Machine Learning · Statistics 2018-06-04 Carl-Johann Simon-Gabriel , Adam Ścibior , Ilya Tolstikhin , Bernhard Schölkopf

Generalizing previous work of Iwaniec, Luo, and Sarnak (2000), we use information from one-level density theorems to estimate the proportion of non-vanishing of $L$-functions in a family at a low-lying height on the critical line (measured…

Number Theory · Mathematics 2022-10-17 Emanuel Carneiro , Andrés Chirre , Micah B. Milinovich

The role of kernels is central to machine learning. Motivated by the importance of power-law distributions in statistical modeling, in this paper, we propose the notion of power-law kernels to investigate power-laws in learning problem. We…

Machine Learning · Computer Science 2013-04-02 Debarghya Ghoshdastidar , Ambedkar Dukkipati

Function values are, in some sense, "almost as good" as general linear information for $L_2$-approximation (optimal recovery, data assimilation) of functions from a reproducing kernel Hilbert space. This was recently proved by new upper…

Numerical Analysis · Mathematics 2022-03-23 Aicke Hinrichs , David Krieg , Erich Novak , Jan Vybiral