English
Related papers

Related papers: Universality, Characteristic Kernels and RKHS Embe…

200 papers

We connect shift-invariant characteristic kernels to infinitely divisible distributions on $\mathbb{R}^{d}$. Characteristic kernels play an important role in machine learning applications with their kernel means to distinguish any two…

Machine Learning · Statistics 2016-10-26 Yu Nishiyama , Kenji Fukumizu

In this paper we deal with the problem of testing for the equality of $k$ probability distributions defined on $(\mathcal{X},\mathcal{B})$, where $\mathcal{X}$ is a metric space and $\mathcal{B}$ is the corresponding Borel $\sigma$-field.…

Statistics Theory · Mathematics 2018-12-04 Armando Sosthene Kali Balogoun , Guy Martial Nkiet , Carlos Ogouyandjou

We present accurate upper and lower bounds for the covering numbers, with explicit constants, of the unit ball for two general classes of Reproducing Kernel Hilbert Space (RKHS) on the unit sphere of $\mathbb{R}^{d+1}$. In both classes, the…

Functional Analysis · Mathematics 2026-01-29 T. Jordão , K. Gonzalez

Proximities are at the heart of almost all machine learning methods. If the input data are given as numerical vectors of equal lengths, euclidean distance, or a Hilbertian inner product is frequently used in modeling algorithms. In a more…

Machine Learning · Computer Science 2020-09-01 Maximilian Münch , Michiel Straat , Michael Biehl , Frank-Michael Schleif

This article presents a quantum computing approach to designing of similarity measures and kernels for classification of stochastic symbolic time series. In the area of machine learning, kernels are important components of various…

Quantum Physics · Physics 2025-06-10 Vanio Markov , Vladimir Rastunkov , Daniel Fry

Quantum kernels quantify similarity between data points by measuring the inner product between quantum states, computed through quantum circuit measurements. By embedding data into quantum systems, quantum kernel feature maps, that may be…

Quantum Physics · Physics 2025-03-24 Joachim Tomasi , Sandrine Anthoine , Hachem Kadri

Recently, some works have suggested methods to combine variational probabilistic inference with Monte Carlo sampling. One promising approach is via local optimal transport. In this approach, a gradient steepest descent method based on local…

Machine Learning · Statistics 2019-01-30 Manuel Pulido , Peter Jan vanLeeuwen , Derek J. Posselt

The ability to measure differences in collected data is of fundamental importance for quantitative science and machine learning, motivating the establishment of metrics grounded in physical principles. In this study, we focus on the…

Fluid Dynamics · Physics 2024-08-30 Samuel E. Otto , Cassio M. Oishi , Fabio Amaral , Steven L. Brunton , J. Nathan Kutz

We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive…

Statistics Theory · Mathematics 2012-11-13 Ming Yuan , T. Tony Cai

Kernel methods give powerful, flexible, and theoretically grounded approaches to solving many problems in machine learning. The standard approach, however, requires pairwise evaluations of a kernel function, which can lead to scalability…

Machine Learning · Computer Science 2021-04-08 Danica J. Sutherland , Jeff Schneider

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

Since persistence diagrams do not admit an inner product structure, a map into a Hilbert space is needed in order to use kernel methods. It is natural to ask if such maps necessarily distort the metric on persistence diagrams. We show that…

Machine Learning · Computer Science 2020-07-31 Peter Bubenik , Alexander Wagner

The fields of signal processing and information theory have evolved with the goal of developing formulations to extract intrinsic information from limited amount of data. When one considers the modeling of unpredictably varying processes…

Signal Processing · Electrical Eng. & Systems 2019-05-07 Rishabh Singh , Jose C. Principe

This survey is an introduction to positive definite kernels and the set of methods they have inspired in the machine learning literature, namely kernel methods. We first discuss some properties of positive definite kernels as well as…

Machine Learning · Statistics 2009-12-04 Marco Cuturi

This article studies global testing of the slope function in functional linear regression model in the framework of reproducing kernel Hilbert space. We propose a new testing statistic based on smoothness regularization estimators. The…

Statistics Theory · Mathematics 2021-10-13 Jianjun Xu , Wenquan Cui

The X-ray transform is one of the most fundamental integral operators in image processing and reconstruction. In this article, we revisit the formalism of the X-ray transform by considering it as an operator between Reproducing Kernel…

Functional Analysis · Mathematics 2024-06-26 Ho Yun , Victor M. Panaretos

This monograph studies the relations between two approaches using positive definite kernels: probabilistic methods using Gaussian processes, and non-probabilistic methods using reproducing kernel Hilbert spaces (RKHS). They are widely…

Machine Learning · Statistics 2025-06-24 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K. Sriperumbudur

Supervised learning in reproducing kernel Hilbert space (RKHS) and vector-valued RKHS (vvRKHS) has been investigated for more than 30 years. In this paper, we provide a new twist to this rich literature by generalizing supervised learning…

Machine Learning · Statistics 2024-06-27 Yuka Hashimoto , Masahiro Ikeda , Hachem Kadri

Motivated by the abundance of functional data such as time series and images, there has been a growing interest in integrating such data into neural networks and learning maps from function spaces to R (i.e., functionals). In this paper, we…

Machine Learning · Statistics 2024-03-20 Tian-Yi Zhou , Namjoon Suh , Guang Cheng , Xiaoming Huo

If $\Lambda $ is a measure space, $u:\Lambda ^{m}\rightarrow \Bbb{R}$ is a given function and $N\geq m,$ the function $U(x_{1},...,x_{N})=\left( \begin{array}{l} N \\ m \end{array} \right) ^{-1}\sum_{1\leq i_{1}<\cdots <i_{m}\leq…

Functional Analysis · Mathematics 2015-01-14 Irina Navrotskaya , Patrick J. Rabier