English
Related papers

Related papers: Hilbert space embeddings and metrics on probabilit…

200 papers

Reproducing kernel Hilbert spaces (RKHSs) are key spaces for machine learning that are becoming popular also for linear system identification. In particular, the so-called stable RKHSs can be used to model absolutely summable impulse…

Machine Learning · Computer Science 2020-05-07 Mauro Bisiacco , Gianluigi Pillonetto

In this paper, we study the statistical and geometrical properties of the Kullback-Leibler divergence with kernel covariance operators (KKL) introduced by Bach [2022]. Unlike the classical Kullback-Leibler (KL) divergence that involves…

Machine Learning · Statistics 2025-03-12 Clémentine Chazal , Anna Korba , Francis Bach

The distribution regression problem encompasses many important statistics and machine learning tasks, and arises in a large range of applications. Among various existing approaches to tackle this problem, kernel methods have become a method…

Statistics Theory · Mathematics 2025-09-22 François Bachoc , Louis Béthune , Alberto González-Sanz , Jean-Michel Loubes

Regularity estimates for an integral operator with a symmetric continuous kernel on a convex bounded domain are derived. The covariance of a mean-square continuous random field on the domain is an example of such an operator. The estimates…

Probability · Mathematics 2022-04-25 Mihály Kovács , Annika Lang , Andreas Petersson

It is known that the membership in a given reproducing kernel Hilbert space (RKHS) of the samples of a Gaussian process $X$ is controlled by a certain nuclear dominance condition. However, it is less clear how to identify a "small" set of…

Probability · Mathematics 2022-03-16 Toni Karvonen

This article studies global testing of the slope function in functional linear regression model in the framework of reproducing kernel Hilbert space. We propose a new testing statistic based on smoothness regularization estimators. The…

Statistics Theory · Mathematics 2021-10-13 Jianjun Xu , Wenquan Cui

We propose a framework for analyzing and comparing distributions, allowing us to design statistical tests to determine if two samples are drawn from different distributions. Our test statistic is the largest difference in expectations over…

Machine Learning · Computer Science 2008-05-16 Arthur Gretton , Karsten Borgwardt , Malte J. Rasch , Bernhard Scholkopf , Alexander J. Smola

This paper is concerned with testing normality in a Hilbert space based on the maximum mean discrepancy. Specifically, we discuss the behavior of the test from two standpoints: asymptotics and practical aspects. Asymptotic normality of the…

Statistics Theory · Mathematics 2019-02-12 Natsumi Makigusa , Kanta Naito

We describe a method to perform functional operations on probability distributions of random variables. The method uses reproducing kernel Hilbert space representations of probability distributions, and it is applicable to all operations…

Machine Learning · Statistics 2016-09-14 Bernhard Schölkopf , Krikamol Muandet , Kenji Fukumizu , Jonas Peters

We propose a class of nonparametric two-sample tests with a cost linear in the sample size. Two tests are given, both based on an ensemble of distances between analytic functions representing each of the distributions. The first test uses…

Machine Learning · Statistics 2015-06-16 Kacper Chwialkowski , Aaditya Ramdas , Dino Sejdinovic , Arthur Gretton

The study presents a vector-valued extension of the classical Mercer theorem within the framework of reproducing kernel Hilbert spaces defined over Kaplansky-Hilbert modules associated with the algebra of essentially bounded measurable…

Functional Analysis · Mathematics 2025-11-24 A. Arziev , K. Kudaybergenov. P. Orinbaev

We propose a new metric between probability measures on a compact metric space that mirrors the Riemannian manifold-like structure of quadratic optimal transport but includes entropic regularization. Its metric tensor is given by the…

Optimization and Control · Mathematics 2025-09-22 Hugo Lavenant , Jonas Luckhardt , Gilles Mordant , Bernhard Schmitzer , Luca Tamanini

A new kind of symmetry behaviour introduced as partialPT-symmetry is investigated in a typical Fock space setting understood as a Reproducing Kernel Hilbert Space (RKHS). The same kind of symmetry is understood for a nonhermitian…

Mathematical Physics · Physics 2021-09-15 Arindam Chakraborty

A nonparametric approach for policy learning for POMDPs is proposed. The approach represents distributions over the states, observations, and actions as embeddings in feature spaces, which are reproducing kernel Hilbert spaces.…

Machine Learning · Computer Science 2012-10-19 Yu Nishiyama , Abdeslam Boularias , Arthur Gretton , Kenji Fukumizu

Compositional data, such as human gut microbiomes, consist of non-negative variables whose only the relative values to other variables are available. Analyzing compositional data such as human gut microbiomes needs a careful treatment of…

Machine Learning · Statistics 2022-05-04 Binglin Li , Jeongyoun Ahn

The problem of estimating the kernel mean in a reproducing kernel Hilbert space (RKHS) is central to kernel methods in that it is used by classical approaches (e.g., when centering a kernel PCA matrix), and it also forms the core inference…

Machine Learning · Statistics 2014-11-05 Krikamol Muandet , Bharath Sriperumbudur , Bernhard Schölkopf

In the absence of a satisfactory interpretation of quantum theory, physical law lacks physical basis. This paper reviews the orthodox, or Dirac-von Neumann interpretation, and makes explicit that Hilbert space describes propositions about…

General Physics · Physics 2019-08-20 Charles Francis

We present an embedding of stochastic optimal control problems, of the so called path integral form, into reproducing kernel Hilbert spaces. Using consistent, sample based estimates of the embedding leads to a model free, non-parametric…

Machine Learning · Computer Science 2012-08-14 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

Kernel mean embedding is a useful tool to represent and compare probability measures. Despite its usefulness, kernel mean embedding considers infinite-dimensional features, which are challenging to handle in the context of differentially…

Machine Learning · Computer Science 2022-06-24 Margarita Vinaroz , Mohammad-Amin Charusaie , Frederik Harder , Kamil Adamczewski , Mijung Park

This survey is an introduction to positive definite kernels and the set of methods they have inspired in the machine learning literature, namely kernel methods. We first discuss some properties of positive definite kernels as well as…

Machine Learning · Statistics 2009-12-04 Marco Cuturi