English
Related papers

Related papers: Strictly proper kernel scores and characteristic k…

200 papers

Interpolation and approximation of functionals with conditionally positive definite kernels is considered on sets of centers that are not determining for polynomials. It is shown that polynomial consistency is sufficient in order to define…

Numerical Analysis · Mathematics 2025-08-26 Oleg Davydov

In this paper we show that the strictly positive definite matrix valued isotropic kernels in the circle and the real dot product kernels in Euclidean spaces are not well behaved with respect to its scalar valued projections. We generalize…

Classical Analysis and ODEs · Mathematics 2022-12-01 Jean Carlo Guella

The problem of classification in machine learning has often been approached in terms of function approximation. In this paper, we propose an alternative approach for classification in arbitrary compact metric spaces which, in theory, yields…

Machine Learning · Computer Science 2026-03-26 H. N. Mhaskar , Ryan O'Dowd

In this article we study the field of Hilbertian metrics and positive definit (pd) kernels on probability measures, they have a real interest in kernel methods. Firstly we will make a study based on the Alpha-Beta-divergence to have a…

Methodology · Statistics 2018-09-18 Mactar Ndaw , Macoumba Ndour , Papa Ngom

We provide a characterization for the continuous positive definite kernels on $\mathbb R^d$ that are invariant to linear isometries, i.e. invariant under the orthogonal group $O(d)$. Furthermore, we provide necessary and sufficient…

Statistics Theory · Mathematics 2025-06-30 Felix Benning , Max David Schölpple

In spatial statistics and machine learning, the kernel matrix plays a pivotal role in prediction, classification, and maximum likelihood estimation. A thorough examination reveals that for large sample sizes, the kernel matrix becomes…

Machine Learning · Statistics 2023-11-07 Hao Zhang

Similarity plays a fundamental role in many areas, including data mining, machine learning, statistics and various applied domains. Inspired by the success of ensemble methods and the flexibility of trees, we propose to learn a similarity…

Machine Learning · Computer Science 2019-08-29 Donghui Yan , Songxiang Gu , Ying Xu , Zhiwei Qin

Kernel mean embeddings have recently attracted the attention of the machine learning community. They map measures $\mu$ from some set $M$ to functions in a reproducing kernel Hilbert space (RKHS) with kernel $k$. The RKHS distance of two…

Machine Learning · Statistics 2019-12-18 Carl-Johann Simon-Gabriel , Bernhard Schölkopf

Kernel approximation methods create explicit, low-dimensional kernel feature maps to deal with the high computational and memory complexity of standard techniques. This work studies a supervised kernel learning methodology to optimize such…

Machine Learning · Computer Science 2020-02-17 Mert Al , Zejiang Hou , Sun-Yuan Kung

Approximating non-linear kernels using feature maps has gained a lot of interest in recent years due to applications in reducing training and testing times of SVM classifiers and other kernel based learning algorithms. We extend this line…

Machine Learning · Computer Science 2015-03-20 Purushottam Kar , Harish Karnick

The kernel exponential family is a rich class of distributions, which can be fit efficiently and with statistical guarantees by score matching. Being required to choose a priori a simple kernel such as the Gaussian, however, limits its…

Machine Learning · Statistics 2021-01-15 Li Wenliang , Danica J. Sutherland , Heiko Strathmann , Arthur Gretton

The kernel trick concept, formulated as an inner product in a feature space, facilitates powerful extensions to many well-known algorithms. While the kernel matrix involves inner products in the feature space, the sample covariance matrix…

Computation · Statistics 2017-07-20 Tomer Lancewicki

Predictions are often probabilities; e.g., a prediction could be for precipitation tomorrow, but with only a 30% chance. Given such probabilistic predictions together with the actual outcomes, "reliability diagrams" help detect and diagnose…

Statistics Theory · Mathematics 2022-11-15 Imanol Arrieta-Ibarra , Paman Gujral , Jonathan Tannen , Mark Tygert , Cherie Xu

Many contemporary statistical learning methods assume a Euclidean feature space. This paper presents a method for defining similarity based on hyperspherical geometry and shows that it often improves the performance of support vector…

Machine Learning · Statistics 2018-08-07 Chenchao Zhao , Jun S. Song

We consider a kernel based harmonic analysis of "boundary," and boundary representations. Our setting is general: certain classes of positive definite kernels. Our theorems extend (and are motivated by) results and notions from classical…

Functional Analysis · Mathematics 2016-11-15 Palle Jorgensen , Feng Tian

We study the statistical-computational trade-offs for learning with exact invariances (or symmetries) using kernel regression. Traditional methods, such as data augmentation, group averaging, canonicalization, and frame-averaging, either…

Machine Learning · Computer Science 2026-02-05 Ashkan Soleymani , Behrooz Tahmasebi , Stefanie Jegelka , Patrick Jaillet

The paper studies strictly positive definite kernels on compact Riemannian manifolds. We state new conditions to ensure strict positive definiteness for general kernels and kernels with certain convolutional structure. We also state…

Numerical Analysis · Mathematics 2023-01-20 Jean Carlo Guella , Janin Jäger

Exact sequences are a well known notion in homological algebra. We investigate here the more vague properties of 'homotopical exactness', appearing for instance in the fibre or cofibre sequence of a map. Such notions of exactness can be…

Algebraic Topology · Mathematics 2016-09-07 Marco Grandis

Feature maps associated with positive definite kernels play a central role in kernel methods and learning theory, where regularity properties such as Lipschitz continuity are closely related to robustness and stability guarantees. Despite…

Machine Learning · Statistics 2026-04-06 Justin Reverdi , Sixin Zhang , Fabrice Gamboa , Serge Gratton

For two decades, reproducing kernels and their associated discrepancies have facilitated elegant theoretical analyses in the setting of quasi Monte Carlo. These same tools are now receiving interest in statistics and related fields, as…

Methodology · Statistics 2023-08-24 Chris. J. Oates