English
Related papers

Related papers: Characteristic and Universal Tensor Product Kernel…

200 papers

Kernel discrepancies are a powerful tool for analyzing worst-case errors in quasi-Monte Carlo (QMC) methods. Building on recent advances in optimizing such discrepancy measures, we extend the subset selection problem to the setting of…

Machine Learning · Statistics 2025-11-05 Deyao Chen , François Clément , Carola Doerr , Nathan Kirk

Motivated by the increasing use of kernel-based metrics for high-dimensional and large-scale data, we study the asymptotic behavior of kernel two-sample tests when the dimension and sample sizes both diverge to infinity. We focus on the…

Statistics Theory · Mathematics 2024-10-31 Jian Yan , Xianyang Zhang

In nonparametric independence testing, we observe i.i.d.\ data $\{(X_i,Y_i)\}_{i=1}^n$, where $X \in \mathcal{X}, Y \in \mathcal{Y}$ lie in any general spaces, and we wish to test the null that $X$ is independent of $Y$. Modern test…

Methodology · Statistics 2022-12-20 Shubhanshu Shekhar , Ilmun Kim , Aaditya Ramdas

Mean embeddings provide an extremely flexible and powerful tool in machine learning and statistics to represent probability distributions and define a semi-metric (MMD, maximum mean discrepancy; also called N-distance or energy distance),…

Machine Learning · Statistics 2019-05-17 Matthieu Lerasle , Zoltan Szabo , Timothee Mathieu , Guillaume Lecue

Likelihood-free inference methods typically make use of a distance between simulated and real data. A common example is the maximum mean discrepancy (MMD), which has previously been used for approximate Bayesian computation, minimum…

Methodology · Statistics 2023-05-11 Ayush Bharti , Masha Naslidnyk , Oscar Key , Samuel Kaski , François-Xavier Briol

The Hilbert--Schmidt Independence Criterion (HSIC) is a popular measure of the dependency between two random variables. The statistic dHSIC is an extension of HSIC that can be used to test joint independence of $d$ random variables. Such…

Statistics Theory · Mathematics 2020-05-15 David Rindt , Dino Sejdinovic , David Steinsaltz

We study the maximum mean discrepancy (MMD) in the context of critical transitions modelled by fast-slow stochastic dynamical systems. We establish a new link between the dynamical theory of critical transitions with the statistical aspects…

Pattern Formation and Solitons · Physics 2019-01-30 Boumediene Hamzi , Christian Kuehn , Sameh Mohamed

Existing two-sample testing techniques, particularly those based on choosing a kernel for the Maximum Mean Discrepancy (MMD), often assume equal sample sizes from the two distributions. Applying these methods in practice can require…

Machine Learning · Statistics 2025-12-17 Aaron Wei , Milad Jalali , Danica J. Sutherland

This paper presents a novel approach to measuring statistical dependence between two random processes (r.p.) using a positive-definite function called the Normalized Cross Density (NCD). NCD is derived directly from the probability density…

Machine Learning · Computer Science 2024-02-22 Bo Hu , Jose C. Principe

We introduce two novel non-parametric statistical hypothesis tests. The first test, called the relative test of dependency, enables us to determine whether one source variable is significantly more dependent on a first target variable or a…

Artificial Intelligence · Computer Science 2016-11-18 Wacha Bounliphone , Eugene Belilovsky , Arthur Tenenhaus , Ioannis Antonoglou , Arthur Gretton , Matthew B. Blashcko

We provide a unifying framework linking two classes of statistics used in two-sample and independence testing: on the one hand, the energy distances and distance covariances from the statistics literature; on the other, distances between…

Machine Learning · Computer Science 2015-03-20 Dino Sejdinovic , Arthur Gretton , Bharath Sriperumbudur , Kenji Fukumizu

We propose a method to optimize the representation and distinguishability of samples from two probability distributions, by maximizing the estimated power of a statistical test based on the maximum mean discrepancy (MMD). This optimized MMD…

We characterize the asymptotic performance of nonparametric goodness of fit testing. The exponential decay rate of the type-II error probability is used as the asymptotic performance metric, and a test is optimal if it achieves the maximum…

Machine Learning · Statistics 2019-03-19 Shengyu Zhu , Biao Chen , Pengfei Yang , Zhitang Chen

We establish quantitative rates of convergence for the empirical estimation of probability measures by means of the Maximum Mean Discrepancy (MMD) with power kernel $K_q(x,y) = -|x-y|^q$, $q \in (0,2)$. The resulting discrepancy is the…

Probability · Mathematics 2026-05-19 Francesco Colasanto , Matteo Focardi , Massimo Fornasier , Francesco Mattesini

Bias evaluation is fundamental to trustworthy AI, both in terms of checking data quality and in terms of checking the outputs of AI systems. In testing data quality, for example, one may study the distance of a given dataset, viewed as a…

Machine Learning · Computer Science 2025-06-12 Jiří Němeček , Mark Kozdoba , Illia Kryvoviaz , Tomáš Pevný , Jakub Mareček

This paper presents a new efficient black-box attribution method based on Hilbert-Schmidt Independence Criterion (HSIC), a dependence measure based on Reproducing Kernel Hilbert Spaces (RKHS). HSIC measures the dependence between regions of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Paul Novello , Thomas Fel , David Vigouroux

We are interested in mesh-free formulas based on the Monte-Carlo methodology for the approximation of multi-dimensional integrals, and we investigate their accuracy when the functions belong to a reproducing-kernel space. A kernel typically…

Analysis of PDEs · Mathematics 2020-08-26 Philippe G. LeFloch , Jean-Marc Mercier

Kernel Stein discrepancy (KSD) is a widely used kernel-based measure of discrepancy between probability measures. It is often employed in the scenario where a user has a collection of samples from a candidate probability measure and wishes…

Statistics Theory · Mathematics 2025-02-13 George Wynne , Mikołaj Kasprzak , Andrew B. Duncan

Detecting changes is of fundamental importance when analyzing data streams and has many applications, e.g., in predictive maintenance, fraud detection, or medicine. A principled approach to detect changes is to compare the distributions of…

Machine Learning · Computer Science 2025-02-13 Florian Kalinke , Marco Heyden , Georg Gntuni , Edouard Fouché , Klemens Böhm

We propose a nonparametric two-sample test procedure based on Maximum Mean Discrepancy (MMD) for testing the hypothesis that two samples of functions have the same underlying distribution, using kernels defined on function spaces. This…

Statistics Theory · Mathematics 2020-10-20 George Wynne , Andrew B. Duncan
‹ Prev 1 3 4 5 6 7 10 Next ›