English
Related papers

Related papers: Hypothesis testing using pairwise distances and as…

200 papers

Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddings of distributions…

Machine Learning · Statistics 2026-05-05 Peter Moskvichev , Siu Lun Chau , Dino Sejdinovic

Distances between probability distributions that take into account the geometry of their sample space,like the Wasserstein or the Maximum Mean Discrepancy (MMD) distances have received a lot of attention in machine learning as they can, for…

Machine Learning · Computer Science 2020-04-29 Gaëtan Hadjeres , Frank Nielsen

We consider the problem of clustering a sample of probability distributions from a random distribution on $\mathbb R^p$. Our proposed partitioning method makes use of a symmetric, positive-definite kernel $k$ and its associated reproducing…

Machine Learning · Statistics 2025-09-23 Amparo Baíllo , Jose R. Berrendero , Martín Sánchez-Signorini

These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing…

This monograph develops a unified, application-driven framework for kernel methods grounded in reproducing kernel Hilbert spaces (RKHS) and optimal transport (OT). Part I lays the theoretical and numerical foundations on positive-definite…

Numerical Analysis · Mathematics 2025-10-07 Philippe G. LeFloch , Jean-Marc Mercier , Shohruh Miryusupov

Kernel-based testing has revolutionized the field of non-parametric tests through the embedding of distributions in an RKHS. This strategy has proven to be powerful and flexible, yet its applicability has been limited to the standard…

Methodology · Statistics 2024-11-28 Anthony Ozier-Lafontaine , Polina Arsenteva , Franck Picard , Bertrand Michel

The distribution regression problem encompasses many important statistics and machine learning tasks, and arises in a large range of applications. Among various existing approaches to tackle this problem, kernel methods have become a method…

Statistics Theory · Mathematics 2025-09-22 François Bachoc , Louis Béthune , Alberto González-Sanz , Jean-Michel Loubes

This paper explores methods for estimating or approximating the total variation distance and the chi-squared divergence of probability measures within topological sample spaces, using independent and identically distributed samples. Our…

Information Theory · Computer Science 2023-12-20 Chong Xiao Wang , Wee Peng Tay

Optimal transport distances, otherwise known as Wasserstein distances, have recently drawn ample attention in computer vision and machine learning as a powerful discrepancy measure for probability distributions. The recent developments on…

Machine Learning · Computer Science 2015-11-11 Soheil Kolouri , Yang Zou , Gustavo K. Rohde

We introduce kernel integrated $R^2$, a new measure of statistical dependence that combines the local normalization principle of the recently introduced integrated $R^2$ with the flexibility of reproducing kernel Hilbert spaces (RKHSs). The…

Machine Learning · Statistics 2026-02-27 Pouya Roudaki , Shakeel Gavioli-Akilagun , Florian Kalinke , Mona Azadkia , Zoltán Szabó

The two-sample hypothesis testing problem is studied for the challenging scenario of high dimensional data sets with small sample sizes. We show that the two-sample hypothesis testing problem can be posed as a one-class set classification…

Machine Learning · Statistics 2017-11-15 Hamed Masnadi-Shirazi

The performance of adaptive estimators that employ embedding in reproducing kernel Hilbert spaces (RKHS) depends on the choice of the location of basis kernel centers. Parameter convergence and error approximation rates depend on where and…

Systems and Control · Electrical Eng. & Systems 2020-09-08 Sai Tej Paruchuri , Jia Guo , Andrew Kurdila

We introduce a general non-parametric independence test between right-censored survival times and covariates, which may be multivariate. Our test statistic has a dual interpretation, first in terms of the supremum of a potentially infinite…

Methodology · Statistics 2021-11-23 Tamara Fernandez , Arthur Gretton , David Rindt , Dino Sejdinovic

This is a tutorial and survey paper on kernels, kernel methods, and related fields. We start with reviewing the history of kernels in functional analysis and machine learning. Then, Mercer kernel, Hilbert and Banach spaces, Reproducing…

Machine Learning · Statistics 2021-06-17 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

We propose a framework to construct practical kernel-based two-sample tests from the family of $f$-divergences. The test statistic is computed from the witness function of a regularized variational representation of the divergence, which we…

Machine Learning · Statistics 2026-01-28 Mónica Ribero , Antonin Schrab , Arthur Gretton

Weighted log-rank tests are arguably the most widely used tests by practitioners for the two-sample problem in the context of right-censored data. Many approaches have been considered to make weighted log-rank tests more robust against a…

Methodology · Statistics 2020-05-01 Tamara Fernandez , Nicolas Rivera

This article presents a quantum computing approach to designing of similarity measures and kernels for classification of stochastic symbolic time series. In the area of machine learning, kernels are important components of various…

Quantum Physics · Physics 2025-06-10 Vanio Markov , Vladimir Rastunkov , Daniel Fry

We propose a novel kernel-based two-sample test that leverages the spectral decomposition of the maximum mean discrepancy (MMD) statistic to identify and utilize well-estimated directional components in reproducing kernel Hilbert space…

Methodology · Statistics 2025-08-21 Rui Cui , Yuhao Li , Xiaojun Song

Kernel mean embeddings, a widely used technique in machine learning, map probability distributions to elements of a reproducing kernel Hilbert space (RKHS). For supervised learning problems, where input-output pairs are observed, the…

Machine Learning · Statistics 2024-10-24 Ambrus Tamás , Balázs Csanád Csáji

In this paper we deal with the problem of testing for the equality of $k$ probability distributions defined on $(\mathcal{X},\mathcal{B})$, where $\mathcal{X}$ is a metric space and $\mathcal{B}$ is the corresponding Borel $\sigma$-field.…

Statistics Theory · Mathematics 2018-12-04 Armando Sosthene Kali Balogoun , Guy Martial Nkiet , Carlos Ogouyandjou