English
Related papers

Related papers: Spectral Regularized Kernel Goodness-of-Fit Tests

200 papers

Kernelized Stein discrepancy (KSD) is a score-based discrepancy widely used in goodness-of-fit tests. It can be applied even when the target distribution has an unknown normalising factor, such as in Bayesian analysis. We show theoretically…

Machine Learning · Statistics 2023-06-06 Xing Liu , Andrew B. Duncan , Axel Gandy

Kernel Stein discrepancies (KSDs) have emerged as a powerful tool for quantifying goodness-of-fit over the last decade, featuring numerous successful applications. To the best of our knowledge, all existing KSD estimators with known rate…

Machine Learning · Statistics 2026-03-31 Jose Cribeiro-Ramallo , Agnideep Aich , Florian Kalinke , Ashit Baran Aich , Zoltán Szabó

We propose a new one-sample test for normality in a Reproducing Kernel Hilbert Space (RKHS). Namely, we test the null-hypothesis of belonging to a given family of Gaussian distributions. Hence our procedure may be applied either to test…

Statistics Theory · Mathematics 2015-07-13 Jérémie Kellner , Alain Celisse

We propose Sobolev-regularized Maximum Mean Discrepancy (SrMMD) gradient flow, a regularized variant of maximum mean discrepancy (MMD) gradient flow based on a gradient penalty on the witness function. The proposed regularization mitigates…

Machine Learning · Computer Science 2026-05-13 Chenyang Tian , Bharath K. Sriperumbudur , Arthur Gretton , Zonghao Chen

We propose a novel kernel-based two-sample test that leverages the spectral decomposition of the maximum mean discrepancy (MMD) statistic to identify and utilize well-estimated directional components in reproducing kernel Hilbert space…

Methodology · Statistics 2025-08-21 Rui Cui , Yuhao Li , Xiaojun Song

This paper provides a unifying view of optimal kernel hypothesis testing across the MMD two-sample, HSIC independence, and KSD goodness-of-fit frameworks. Minimax optimal separation rates in the kernel and $L^2$ metrics are presented, with…

Machine Learning · Statistics 2025-12-30 Antonin Schrab

The kernel two-sample test based on the maximum mean discrepancy (MMD) is one of the most popular methods for detecting differences between two distributions over general metric spaces. In this paper we propose a method to boost the power…

Methodology · Statistics 2024-09-06 Anirban Chatterjee , Bhaswar B. Bhattacharya

Likelihood-free inference methods typically make use of a distance between simulated and real data. A common example is the maximum mean discrepancy (MMD), which has previously been used for approximate Bayesian computation, minimum…

Methodology · Statistics 2023-05-11 Ayush Bharti , Masha Naslidnyk , Oscar Key , Samuel Kaski , François-Xavier Briol

Nonparametric tests via kernel embedding of distributions have witnessed a great deal of practical successes in recent years. However, statistical properties of these tests are largely unknown beyond consistency against a fixed alternative.…

Statistics Theory · Mathematics 2019-09-10 Tong Li , Ming Yuan

Modern data analyses frequently encounter settings where samples of variables are contaminated by measurement error. Ignoring measurement noise can substantially degrade statistical inference, while existing correction techniques are often…

Methodology · Statistics 2026-04-15 Ritwik Vashistha , Jeff M. Phillips , Abhra Sarkar , Arya Farahi

Distributionally robust optimization (DRO) has attracted attention in machine learning due to its connections to regularization, generalization, and robustness. Existing work has considered uncertainty sets based on phi-divergences and…

Machine Learning · Computer Science 2019-05-28 Matthew Staib , Stefanie Jegelka

The Maximum Mean Discrepancy (MMD) is a widely used multivariate distance metric for two-sample testing. The standard MMD test statistic has an intractable null distribution typically requiring costly resampling or permutation approaches…

Methodology · Statistics 2026-02-24 Anirban Chatterjee , Aaditya Ramdas

Kernel embeddings of distributions and the Maximum Mean Discrepancy (MMD), the resulting distance between distributions, are useful tools for fully nonparametric two-sample testing and learning on distributions. However, it is rarely that…

Machine Learning · Statistics 2017-11-07 Ho Chung Leon Law , Christopher Yau , Dino Sejdinovic

We propose a novel adaptive test of goodness-of-fit, with computational cost linear in the number of samples. We learn the test features that best indicate the differences between observed samples and a reference model, by minimizing the…

Machine Learning · Statistics 2017-10-25 Wittawat Jitkrittum , Wenkai Xu , Zoltan Szabo , Kenji Fukumizu , Arthur Gretton

Conditional Maximum Mean Discrepancy (CMMD) can capture the discrepancy between conditional distributions by drawing support from nonlinear kernel functions, thus it has been successfully used for pattern classification. However, CMMD does…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Chuan-Xian Ren , Pengfei Ge , Dao-Qing Dai , Hong Yan

As modern precision cosmological measurements continue to show agreement with the broad features of the standard $\Lambda$-Cold Dark Matter ($\Lambda$CDM) cosmological model, we are increasingly motivated to look for small departures from…

Cosmology and Nongalactic Astrophysics · Physics 2017-05-11 Andrew Arrasmith , Brent Follin , Ethan Anderes , Lloyd Knox

Representing, comparing, and measuring the distance between probability distributions is a key task in computational statistics and machine learning. The choice of representation and the associated distance determine properties of the…

Machine Learning · Statistics 2026-02-26 Masha Naslidnyk

There exist some testing procedures based on the maximum mean discrepancy (MMD) to address the challenge of model specification. However, they ignore the presence of estimated parameters in the case of composite null hypotheses. In this…

Methodology · Statistics 2024-12-10 Florian Brück , Jean-David Fermanian , Aleksey Min

We propose kernel-type smoothed Kolmogorov-Smirnov and Cram\'{e}r-von Mises tests for data on general interval, using bijective transformations. Though not as severe as in the kernel density estimation, utilizing naive kernel method…

Methodology · Statistics 2020-05-29 Rizky Reza Fauzi , Yoshihiko Maesono

We consider the goodness-of-fit testing problem of distinguishing whether the data are drawn from a specified distribution, versus a composite alternative separated from the null in the total variation metric. In the discrete case, we…

Statistics Theory · Mathematics 2017-07-03 Sivaraman Balakrishnan , Larry Wasserman