English
Related papers

Related papers: A Uniform Concentration Inequality for Kernel-Base…

200 papers

This paper characterizes the maximum mean discrepancies (MMD) that metrize the weak convergence of probability measures for a wide class of kernels. More precisely, we prove that, on a locally compact, non-compact, Hausdorff space, the MMD…

Machine Learning · Computer Science 2021-09-06 Carl-Johann Simon-Gabriel , Alessandro Barp , Bernhard Schölkopf , Lester Mackey

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…

Several emerging post-Bayesian methods target a probability distribution for which an entropy-regularised variational objective is minimised. This increased flexibility introduces a computational challenge, as one loses access to an…

Computation · Statistics 2025-12-17 Clémentine Chazal , Heishiro Kanagawa , Zheyang Shen , Anna Korba , Chris. J. Oates

We characterize the asymptotic performance of nonparametric goodness of fit testing. The exponential decay rate of the type-II error probability is used as the asymptotic performance metric, and a test is optimal if it achieves the maximum…

Machine Learning · Statistics 2019-03-19 Shengyu Zhu , Biao Chen , Pengfei Yang , Zhitang Chen

This paper is motivated by addressing open questions in distributionally robust chance-constrained programs (DRCCP) using the popular Wasserstein ambiguity sets. Specifically, the computational techniques for those programs typically place…

Optimization and Control · Mathematics 2022-04-26 Yassine Nemmour , Heiner Kremer , Bernhard Schölkopf , Jia-Jie Zhu

In this paper, we bound the error induced by using a weighted skeletonization of two data sets for computing a two sample test with kernel maximum mean discrepancy. The error is quantified in terms of the speed in which heat diffuses from…

Machine Learning · Statistics 2018-12-12 Alexander Cloninger

Kernel Stein discrepancies (KSDs) measure the quality of a distributional approximation and can be computed even when the target density has an intractable normalizing constant. Notable applications include the diagnosis of approximate MCMC…

Machine Learning · Statistics 2025-06-24 Heishiro Kanagawa , Alessandro Barp , Arthur Gretton , Lester Mackey

In order to fully utilize "big data", it is often required to use "big models". Such models tend to grow with the complexity and size of the training data, and do not make strong parametric assumptions upfront on the nature of the…

Machine Learning · Statistics 2015-04-17 Vikas Sindhwani , Haim Avron

The purpose of unconditional text generation is to train a model with real sentences, then generate novel sentences of the same quality and diversity as the training data. However, when different metrics are used for comparing the methods…

Computation and Language · Computer Science 2020-07-03 Ping Cai , Xingyuan Chen , Peng Jin , Hongjun Wang , Tianrui Li

We characterize the asymptotic performance of nonparametric one- and two-sample testing. The exponential decay rate or error exponent of the type-II error probability is used as the asymptotic performance metric, and an optimal test…

Information Theory · Computer Science 2021-02-08 Shengyu Zhu , Biao Chen , Zhitang Chen , Pengfei Yang

We provide a unified framework for independence and mean independence tests based on the Hilbert-Schmidt independence criterion, extending some previous results in the literature to hold in general topological spaces. We also present a…

Methodology · Statistics 2026-05-01 Daniel Diz-Castro , Manuel Febrero-Bande , Wenceslao González-Manteiga

We present simple, user-friendly bounds for the expected operator norm of a random kernel matrix under general conditions on the kernel function $k(\cdot,\cdot)$. Our approach uses decoupling results for U-statistics and the non-commutative…

Machine Learning · Statistics 2025-11-07 Chiraag Kaushik , Justin Romberg , Vidya Muthukumar

Computing the similarity between two probability distributions is a recurring theme across control. We introduce a unified family of distances between the probability distributions of two random variables that is based on the discrepancy…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Alexandros E. Tzikas , Arec Jamgochian , Nazim Kemal Ure , Mykel J. Kochenderfer , Stephen P. Boyd

We establish quantitative rates of convergence for the empirical estimation of probability measures by means of the Maximum Mean Discrepancy (MMD) with power kernel $K_q(x,y) = -|x-y|^q$, $q \in (0,2)$. The resulting discrepancy is the…

Probability · Mathematics 2026-05-19 Francesco Colasanto , Matteo Focardi , Massimo Fornasier , Francesco Mattesini

Regression tasks, notably in safety-critical domains, require proper uncertainty quantification, yet the literature remains largely classification-focused. In this light, we introduce a family of measures for total, aleatoric, and epistemic…

Machine Learning · Computer Science 2025-10-30 Christopher Bülte , Yusuf Sale , Gitta Kutyniok , Eyke Hüllermeier

The main objective of the Multiple Kernel k-Means (MKKM) algorithm is to extract non-linear information and achieve optimal clustering by optimizing base kernel matrices. Current methods enhance information diversity and reduce redundancy…

Machine Learning · Computer Science 2024-03-07 Rina Su , Yu Guo , Caiying Wu , Qiyu Jin , Tieyong Zeng

We are interested in the kernel of one-dimensional diffusion equations with continuous coefficients as evaluated by means of explicit discretization schemes of uniform step $h>0$ in the limit as $h\to0$. We consider both semidiscrete…

Numerical Analysis · Mathematics 2007-11-02 Claudio Albanese

Several statistical approaches based on reproducing kernels have been proposed to detect abrupt changes arising in the full distribution of the observations and not only in the mean or variance. Some of these approaches enjoy good…

Statistics Theory · Mathematics 2017-10-13 Alain Celisse , Guillemette Marot , Morgane Pierre-Jean , Guillem Rigaill

For two decades, reproducing kernels and their associated discrepancies have facilitated elegant theoretical analyses in the setting of quasi Monte Carlo. These same tools are now receiving interest in statistics and related fields, as…

Methodology · Statistics 2023-08-24 Chris. J. Oates

This article presents a general framework for the transport of probability measures towards minimum divergence generative modeling and sampling using ordinary differential equations (ODEs) and Reproducing Kernel Hilbert Spaces (RKHSs),…

Machine Learning · Statistics 2024-02-14 Biraj Pandey , Bamdad Hosseini , Pau Batlle , Houman Owhadi