English
Related papers

Related papers: A Kernel Stein Test for Comparing Latent Variable …

200 papers

Much of machine learning relies on comparing distributions with discrepancy measures. Stein's method creates discrepancy measures between two distributions that require only the unnormalized density of one and samples from the other. Stein…

Machine Learning · Statistics 2020-07-21 Raghav Singhal , Xintian Han , Saad Lahlou , Rajesh Ranganath

Kernel methods underpin many of the most successful approaches in data science and statistics, and they allow representing probability measures as elements of a reproducing kernel Hilbert space without loss of information. Recently, the…

Machine Learning · Statistics 2025-03-19 Florian Kalinke , Zoltan Szabo , Bharath K. Sriperumbudur

We address the problem of non-parametric multiple model comparison: given $l$ candidate models, decide whether each candidate is as good as the best one(s) or worse than it. We propose two statistical tests, each controlling a different…

Machine Learning · Computer Science 2019-10-29 Jen Ning Lim , Makoto Yamada , Bernhard Schölkopf , Wittawat Jitkrittum

Maximum mean discrepancies (MMDs) like the kernel Stein discrepancy (KSD) have grown central to a wide range of applications, including hypothesis testing, sampler selection, distribution approximation, and variational inference. In each…

Machine Learning · Statistics 2025-03-26 Alessandro Barp , Carl-Johann Simon-Gabriel , Mark Girolami , Lester Mackey

Complex data are often represented as a graph, which in turn can often be viewed as a realisation of a random graph, such as an inhomogeneous random graph model (IRG). For general fast goodness-of-fit tests in high dimensions, kernelised…

Machine Learning · Statistics 2026-04-02 Anum Fatima , Gesine Reinert

We introduce a kernel-based goodness-of-fit test for censored data, where observations may be missing in random time intervals: a common occurrence in clinical trials and industrial life-testing. The test statistic is straightforward to…

Methodology · Statistics 2018-10-11 Tamara Fernández , Arthur Gretton

Kernel Stein discrepancies (KSDs) have emerged as a powerful tool for quantifying goodness-of-fit over the last decade, featuring numerous successful applications. To the best of our knowledge, all existing KSD estimators with known rate…

Machine Learning · Statistics 2026-03-31 Jose Cribeiro-Ramallo , Agnideep Aich , Florian Kalinke , Ashit Baran Aich , Zoltán Szabó

Goodness-of-fit (GoF) tests are fundamental for assessing model adequacy. Score-based tests are appealing because they require fitting the model only once under the null. However, extending them to powerful nonparametric alternatives is…

Machine Learning · Statistics 2026-02-24 Zhihan Huang , Ziang Niu

We propose two nonparametric statistical tests of goodness of fit for conditional distributions: given a conditional probability density function $p(y|x)$ and a joint sample, decide whether the sample is drawn from $p(y|x)r_x(x)$ for some…

Machine Learning · Statistics 2020-07-01 Wittawat Jitkrittum , Heishiro Kanagawa , Bernhard Schölkopf

Kernel Stein discrepancies (KSDs) measure the quality of a distributional approximation and can be computed even when the target density has an intractable normalizing constant. Notable applications include the diagnosis of approximate MCMC…

Machine Learning · Statistics 2025-06-24 Heishiro Kanagawa , Alessandro Barp , Arthur Gretton , Lester Mackey

Distributional comparison is a fundamental problem in statistical data analysis with numerous applications in a variety of scientific and engineering fields. Numerous methods exist for distributional comparison but kernel Stein's method has…

Statistics Theory · Mathematics 2025-06-12 Xiaoda Qu , Baba C. Vemuri

In the statistical literature, as well as in artificial intelligence and machine learning, measures of discrepancy between two probability distributions are largely used to develop measures of goodness-of-fit. We concentrate on quadratic…

Methodology · Statistics 2025-10-01 Marianthi Markatou , Giovanni Saraceno

Kernel Stein discrepancy (KSD) is among the most popular goodness-of-fit (GoF) measures on general domains with a large number of successful deployments. One of the main applications of KSD is in constructing powerful GoF tests. However,…

Machine Learning · Statistics 2026-05-26 Florian Kalinke , Zoltán Szabó , Bharath K. Sriperumbudur

Among dissimilarities between probability distributions, the Kernel Stein Discrepancy (KSD) has received much interest recently. We investigate the properties of its Wasserstein gradient flow to approximate a target probability distribution…

Machine Learning · Statistics 2021-05-24 Anna Korba , Pierre-Cyril Aubin-Frankowski , Szymon Majewski , Pierre Ablin

In many fields, data appears in the form of direction (unit vector) and usual statistical procedures are not applicable to such directional data. In this study, we propose non-parametric goodness-of-fit testing procedures for general…

Methodology · Statistics 2020-02-18 Wenkai Xu , Takeru Matsuda

In this paper, we study the strong consistency of a bias reduced kernel density estimator and derive a strongly con- sistent Kullback-Leibler divergence (KLD) estimator. As application, we formulate a goodness-of-fit test and an…

Methodology · Statistics 2018-05-21 Papa Ngom , Freedath Djibril Moussa , Jean de Dieu Nkurunziza

Given $M \geq 2$ distributions defined on a general measurable space, we introduce a nonparametric (kernel) measure of multi-sample dissimilarity (KMD) -- a parameter that quantifies the difference between the $M$ distributions. The…

Statistics Theory · Mathematics 2022-10-18 Zhen Huang , Bodhisattva Sen

Computable Stein discrepancies have been deployed for a variety of applications, ranging from sampler selection in posterior inference to approximate Bayesian inference to goodness-of-fit testing. Existing convergence-determining Stein…

Machine Learning · Statistics 2021-10-12 Jonathan H. Huggins , Lester Mackey

We consider the variable selection problem for two-sample tests, aiming to select the most informative variables to determine whether two collections of samples follow the same distribution. To address this, we propose a novel framework…

Machine Learning · Statistics 2024-12-23 Jie Wang , Santanu S. Dey , Yao Xie

A new goodness-of-fit test for normality in high-dimension (and Reproducing Kernel Hilbert Space) is proposed. It shares common ideas with the Maximum Mean Discrepancy (MMD) it outperforms both in terms of computation time and applicability…

Statistics Theory · Mathematics 2014-04-14 Jérémie Kellner , Alain Celisse