English
Related papers

Related papers: Universal kernels via harmonic analysis on Riemann…

200 papers

We develop a framework for function classes generated by parametric ridge kernels: one-dimensional kernels composed with affine projections and averaged over a parameter measure. The induced kernels are positive definite, and the resulting…

Functional Analysis · Mathematics 2025-08-26 James Tian

A Hilbert space embedding of a distribution---in short, a kernel mean embedding---has recently emerged as a powerful tool for machine learning and inference. The basic idea behind this framework is to map distributions into a reproducing…

Machine Learning · Statistics 2020-12-15 Krikamol Muandet , Kenji Fukumizu , Bharath Sriperumbudur , Bernhard Schölkopf

We give a new proof of universality properties in the bulk of spectrum of the hermitian matrix models, assuming that the potential that determines the model is globally $C^{2}$ and locally $C^{3}$ function (see Theorem \ref{t:U.t1}). The…

Mathematical Physics · Physics 2009-11-13 L. Pastur , M. Shcherbina

Various methods in statistical learning build on kernels considered in reproducing kernel Hilbert spaces. In applications, the kernel is often selected based on characteristics of the problem and the data. This kernel is then employed to…

Machine Learning · Statistics 2024-03-12 Paul Dommel , Alois Pichler

Strictly proper kernel scores are well-known tool in probabilistic forecasting, while characteristic kernels have been extensively investigated in the machine learning literature. We first show that both notions coincide, so that insights…

Functional Analysis · Mathematics 2017-12-15 Ingo Steinwart , Johanna F. Ziegel

This paper describes the concepts of Universal/ Integrally Strictly Positive Definite/ $C_{0}$-Universal for the Gaussian kernel on a Hilbert space. As a consequence we obtain a similar characterization for an important family of kernels…

Functional Analysis · Mathematics 2021-02-02 Jean Carlo Guella

Kernel methods are powerful machine learning techniques which implement generic non-linear functions to solve complex tasks in a simple way. They Have a solid mathematical background and exhibit excellent performance in practice. However,…

Machine Learning · Computer Science 2021-01-27 J. Emmanuel Johnson , Valero Laparra , Adrián Pérez-Suay , Miguel D. Mahecha , Gustau Camps-Valls

Positive definite kernels and their associated Reproducing Kernel Hilbert Spaces provide a mathematically compelling and practically competitive framework for learning from data. In this paper we take the approximation theory point of view…

Machine Learning · Computer Science 2018-08-06 Mikhail Belkin

The use of kernel functions is a common technique to extract important features from data sets. A quantum computer can be used to estimate kernel entries as transition amplitudes of unitary circuits. Quantum kernels exist that, subject to…

Representing images by compact codes has proven beneficial for many visual recognition tasks. Most existing techniques, however, perform this coding step directly in image feature space, where the distributions of the different classes are…

Computer Vision and Pattern Recognition · Computer Science 2014-09-02 Mehrtash Harandi , Mathieu Salzmann

Kernel theorems, in general, provide a convenient representation of bounded linear operators. For the operator acting on a concrete function space, this means that its action on any element of the space can be expressed as a generalised…

Functional Analysis · Mathematics 2024-05-22 Dimitri Bytchenkoff , Michael Speckbacher , Peter Balazs

We consider the problem of learning regression functions from pairwise data when there exists prior knowledge that the relation to be learned is symmetric or anti-symmetric. Such prior knowledge is commonly enforced by symmetrizing or…

Machine Learning · Computer Science 2015-06-22 Tapio Pahikkala , Markus Viljanen , Antti Airola , Willem Waegeman

We consider a kernel based harmonic analysis of "boundary," and boundary representations. Our setting is general: certain classes of positive definite kernels. Our theorems extend (and are motivated by) results and notions from classical…

Functional Analysis · Mathematics 2016-11-15 Palle Jorgensen , Feng Tian

Kernel mean embeddings are a popular tool that consists in representing probability measures by their infinite-dimensional mean embeddings in a reproducing kernel Hilbert space. When the kernel is characteristic, mean embeddings can be used…

Machine Learning · Computer Science 2021-06-29 Boris Muzellec , Francis Bach , Alessandro Rudi

Quantum kernel methods, i.e., kernel methods with quantum kernels, offer distinct advantages as a hybrid quantum-classical approach to quantum machine learning (QML), including applicability to Noisy Intermediate-Scale Quantum (NISQ)…

Quantum Physics · Physics 2022-11-29 Daniel T. Chang

In this paper we combine the theory of reproducing kernel Hilbert spaces with the field of collocation methods to solve boundary value problems with special emphasis on reproducing property of kernels. From the reproducing property of…

Numerical Analysis · Mathematics 2019-03-26 Babak Azarnavid , Mahdi Emamjome , Mohammad Nabati , Saeid Abbasbandy

Approximating non-linear kernels using feature maps has gained a lot of interest in recent years due to applications in reducing training and testing times of SVM classifiers and other kernel based learning algorithms. We extend this line…

Machine Learning · Computer Science 2015-03-20 Purushottam Kar , Harish Karnick

The paper studies strictly positive definite kernels on compact Riemannian manifolds. We state new conditions to ensure strict positive definiteness for general kernels and kernels with certain convolutional structure. We also state…

Numerical Analysis · Mathematics 2023-01-20 Jean Carlo Guella , Janin Jäger

Hilbertian kernel methods and their positive semidefinite kernels have been extensively used in various fields of applied mathematics and machine learning, owing to their several equivalent characterizations. We here unveil an analogy with…

Functional Analysis · Mathematics 2023-01-10 Pierre-Cyril Aubin-Frankowski , Stéphane Gaubert

Given only information in the form of similarity triplets "Object A is more similar to object B than to object C" about a data set, we propose two ways of defining a kernel function on the data set. While previous approaches construct a…

Machine Learning · Statistics 2017-10-31 Matthäus Kleindessner , Ulrike von Luxburg