English
Related papers

Related papers: Standardisation-function Kernel Stein Discrepancy:…

200 papers

We explore the minimax optimality of goodness-of-fit tests on general domains using the kernelized Stein discrepancy (KSD). The KSD framework offers a flexible approach for goodness-of-fit testing, avoiding strong distributional…

Statistics Theory · Mathematics 2025-01-24 Omar Hagrass , Bharath Sriperumbudur , Krishnakumar Balasubramanian

Kernel Stein discrepancy (KSD) is a widely used kernel-based measure of discrepancy between probability measures. It is often employed in the scenario where a user has a collection of samples from a candidate probability measure and wishes…

Statistics Theory · Mathematics 2025-02-13 George Wynne , Mikołaj Kasprzak , Andrew B. Duncan

We propose a goodness-of-fit measure for probability densities modeling observations with varying dimensionality, such as text documents of differing lengths or variable-length sequences. The proposed measure is an instance of the kernel…

Machine Learning · Statistics 2023-07-14 Jerome Baum , Heishiro Kanagawa , Arthur Gretton

Kernelized Stein discrepancy (KSD) is a score-based discrepancy widely used in goodness-of-fit tests. It can be applied even when the target distribution has an unknown normalising factor, such as in Bayesian analysis. We show theoretically…

Machine Learning · Statistics 2023-06-06 Xing Liu , Andrew B. Duncan , Axel Gandy

Kernelized Stein discrepancy (KSD), though being extensively used in goodness-of-fit tests and model learning, suffers from the curse-of-dimensionality. We address this issue by proposing the sliced Stein discrepancy and its scalable and…

Machine Learning · Computer Science 2021-03-18 Wenbo Gong , Yingzhen Li , José Miguel Hernández-Lobato

Goodness-of-fit (GoF) tests are fundamental for assessing model adequacy. Score-based tests are appealing because they require fitting the model only once under the null. However, extending them to powerful nonparametric alternatives is…

Machine Learning · Statistics 2026-02-24 Zhihan Huang , Ziang Niu

We propose a kernel-based nonparametric test of relative goodness of fit, where the goal is to compare two models, both of which may have unobserved latent variables, such that the marginal distribution of the observed variables is…

Machine Learning · Statistics 2023-05-10 Heishiro Kanagawa , Wittawat Jitkrittum , Lester Mackey , Kenji Fukumizu , Arthur Gretton

We investigate properties of goodness-of-fit tests based on the Kernel Stein Discrepancy (KSD). We introduce a strategy to construct a test, called KSDAgg, which aggregates multiple tests with different kernels. KSDAgg avoids splitting the…

Machine Learning · Statistics 2023-12-22 Antonin Schrab , Benjamin Guedj , Arthur Gretton

Kernel methods underpin many of the most successful approaches in data science and statistics, and they allow representing probability measures as elements of a reproducing kernel Hilbert space without loss of information. Recently, the…

Machine Learning · Statistics 2025-03-19 Florian Kalinke , Zoltan Szabo , Bharath K. Sriperumbudur

Much of machine learning relies on comparing distributions with discrepancy measures. Stein's method creates discrepancy measures between two distributions that require only the unnormalized density of one and samples from the other. Stein…

Machine Learning · Statistics 2020-07-21 Raghav Singhal , Xintian Han , Saad Lahlou , Rajesh Ranganath

In many fields, data appears in the form of direction (unit vector) and usual statistical procedures are not applicable to such directional data. In this study, we propose non-parametric goodness-of-fit testing procedures for general…

Methodology · Statistics 2020-02-18 Wenkai Xu , Takeru Matsuda

Kernel Stein discrepancy (KSD) is among the most popular goodness-of-fit (GoF) measures on general domains with a large number of successful deployments. One of the main applications of KSD is in constructing powerful GoF tests. However,…

Machine Learning · Statistics 2026-05-26 Florian Kalinke , Zoltán Szabó , Bharath K. Sriperumbudur

Goodness-of-fit testing is often criticized for its lack of practical relevance: since ``all models are wrong'', the null hypothesis that the data conform to our model is ultimately always rejected as the sample size grows. Despite this,…

Machine Learning · Statistics 2025-10-24 Xing Liu , François-Xavier Briol

We introduce the Kernel Calibration Conditional Stein Discrepancy test (KCCSD test), a non-parametric, kernel-based test for assessing the calibration of probabilistic models with well-defined scores. In contrast to previous methods, our…

Machine Learning · Statistics 2025-10-17 Pierre Glaser , David Widmann , Fredrik Lindsten , Arthur Gretton

Among dissimilarities between probability distributions, the Kernel Stein Discrepancy (KSD) has received much interest recently. We investigate the properties of its Wasserstein gradient flow to approximate a target probability distribution…

Machine Learning · Statistics 2021-05-24 Anna Korba , Pierre-Cyril Aubin-Frankowski , Szymon Majewski , Pierre Ablin

We propose a novel method for measuring the discrepancy between a set of samples and a desired posterior distribution for Bayesian inference. Classical methods for assessing sample quality like the effective sample size are not appropriate…

Machine Learning · Statistics 2026-05-01 Narayan Srinivasan , Matthew Sutton , Christopher Drovandi , Leah F South

We present a sequential version of the kernelized Stein discrepancy goodness-of-fit test, which allows for conducting goodness-of-fit tests for unnormalized densities that are continuously monitored and adaptively stopped. That is, the…

Machine Learning · Statistics 2025-04-18 Diego Martinez-Taboada , Aaditya Ramdas

The widespread adoption of the \emph{maximum mean discrepancy} (MMD) in goodness-of-fit testing has spurred extensive research on its statistical performance. However, recent studies indicate that the inherent structure of MMD may constrain…

Methodology · Statistics 2025-11-11 Shiwei Sang , Shao-Bo Lin , Xuehu Zhu

Sliced Stein discrepancy (SSD) and its kernelized variants have demonstrated promising successes in goodness-of-fit tests and model learning in high dimensions. Despite their theoretical elegance, their empirical performance depends…

Machine Learning · Computer Science 2021-07-22 Wenbo Gong , Kaibo Zhang , Yingzhen Li , José Miguel Hernández-Lobato

Stein variational gradient descent (SVGD) and its variants have shown promising successes in approximate inference for complex distributions. In practice, we notice that the kernel used in SVGD-based methods has a decisive effect on the…

Machine Learning · Computer Science 2022-11-29 Qingzhong Ai , Shiyu Liu , Lirong He , Zenglin Xu
‹ Prev 1 2 3 10 Next ›