English
Related papers

Related papers: A KL-divergence based test for elliptical distribu…

200 papers

Elliptically symmetric distributions are a classic example of a semiparametric model where the location vector and the scatter matrix (or a parameterization of them) are the two finite-dimensional parameters of interest, while the density…

Statistics Theory · Mathematics 2026-03-18 Stefano Fortunati , Jean-Pierre Delmas , Esa Ollila

By subjecting a dynamical system to a series of short pulses and varying several time delays we can obtain multidimensional characteristic measures of the system. Multidimensional Kullback-Leibler response function (KLRF), which are based…

Statistical Mechanics · Physics 2010-03-24 Saar Rahav , Shaul Mukamel

This work builds a unified framework for the study of quadratic form distance measures as they are used in assessing the goodness of fit of models. Many important procedures have this structure, but the theory for these methods is dispersed…

Statistics Theory · Mathematics 2008-12-18 Bruce G. Lindsay , Marianthi Markatou , Surajit Ray , Ke Yang , Shu-Chuan Chen

In this paper, we consider the symmetric KL-divergence between the sum of independent variables and a Gaussian distribution, and obtain a convergence rates of order $O\left( \frac{\ln n}{\sqrt{n}}\right)$. The proof is based on Stein's…

Probability · Mathematics 2024-08-20 Liu-Quan Yao , Song-Hao Liu

In the statistical literature, as well as in artificial intelligence and machine learning, measures of discrepancy between two probability distributions are largely used to develop measures of goodness-of-fit. We concentrate on quadratic…

Methodology · Statistics 2025-10-01 Marianthi Markatou , Giovanni Saraceno

We consider the closeness testing problem for discrete distributions. The goal is to distinguish whether two samples are drawn from the same unspecified distribution, or whether their respective distributions are separated in $L_1$-norm. In…

Statistics Theory · Mathematics 2021-01-20 Joseph Lam-Weil , Alexandra Carpentier , Bharath K. Sriperumbudur

Estimating entropy and mutual information consistently is important for many machine learning applications. The Kozachenko-Leonenko (KL) estimator (Kozachenko & Leonenko, 1987) is a widely used nonparametric estimator for the entropy of…

Statistics Theory · Mathematics 2016-07-22 Shashank Singh , Barnabás Póczos

High-dimensional k-sample comparison is a common applied problem. We construct a class of easy-to-implement nonparametric distribution-free tests based on new tools and unexplored connections with spectral graph theory. The test is shown to…

Methodology · Statistics 2019-08-12 Subhadeep , Mukhopadhyay , Kaijun Wang

We motivate and describe a method based on fits with polynomials to test the smoothness of differential distributions. As a demonstration, we apply the method to several measurements of inclusive jet double-differential cross section in the…

High Energy Physics - Phenomenology · Physics 2022-12-23 Patrick L. S. Connor , Radek Žlebčík

We propose a framework to construct practical kernel-based two-sample tests from the family of $f$-divergences. The test statistic is computed from the witness function of a regularized variational representation of the divergence, which we…

Machine Learning · Statistics 2026-01-28 Mónica Ribero , Antonin Schrab , Arthur Gretton

The exploration of associations between random objects with complex geometric structures has catalyzed the development of various novel statistical tests encompassing distance-based and kernel-based statistics. These methods have various…

Methodology · Statistics 2024-10-28 Zhe Gao , Roulin Wang , Xueqin Wang , Heping Zhang

Testing the equality of two conditional distributions is crucial in various modern applications, including transfer learning and causal inference. Despite its importance, this fundamental problem has received surprisingly little attention…

Methodology · Statistics 2025-09-04 Jian Yan , Zhuoxi Li , Xianyang Zhang

Many high-dimensional hypothesis tests aim to globally examine marginal or low-dimensional features of a high-dimensional joint distribution, such as testing of mean vectors, covariance matrices and regression coefficients. This paper…

Statistics Theory · Mathematics 2020-02-04 Yinqiu He , Gongjun Xu , Chong Wu , Wei Pan

The paper presents new metrics to quantify and test for (i) the equality of distributions and (ii) the independence between two high-dimensional random vectors. We show that the energy distance based on the usual Euclidean distance cannot…

Methodology · Statistics 2019-10-01 Shubhadeep Chakraborty , Xianyang Zhang

We consider the problem of testing whether two finite-dimensional random dot product graphs have generating latent positions that are independently drawn from the same distribution, or distributions that are related via scaling or…

Statistics Theory · Mathematics 2015-11-13 Minh Tang , Avanti Athreya , Daniel L. Sussman , Vince Lyzinski , Carey E. Priebe

Heteroskedastic errors can lead to inaccurate statistical conclusions if they are not properly handled. We introduce a test for heteroskedasticity for the nonparametric regression model with multiple covariates. It is based on a suitable…

Methodology · Statistics 2018-02-21 Justin Chown , Ursula U. Müller

We provide a unifying framework linking two classes of statistics used in two-sample and independence testing: on the one hand, the energy distances and distance covariances from the statistics literature; on the other, distances between…

Machine Learning · Computer Science 2015-03-20 Dino Sejdinovic , Arthur Gretton , Bharath Sriperumbudur , Kenji Fukumizu

The paper aims at finding widely and smoothly defined nonparametric location and scatter functionals. As a convenient vehicle, maximum likelihood estimation of the location vector m and scatter matrix S of an elliptically symmetric t…

Statistics Theory · Mathematics 2009-03-20 R. M. Dudley , Sergiy Sidenko , Zuoqin Wang

We study sequences of scaled edge-corrected empirical (generalized) K-functions (modifying Ripley's K-function) each of them constructed from a single observation of a $d$-dimensional fourth-order stationary point process in a sampling…

Statistics Theory · Mathematics 2017-06-06 Lothar Heinrich

The Bayesian nonparametric inference and Dirichlet process are popular tools in statistical methodologies. In this paper, we employ the Dirichlet process in hypothesis testing to propose a Bayesian nonparametric chi-squared goodness-of-fit…

Statistics Theory · Mathematics 2016-06-20 Reyhaneh Hosseini , Mahmoud Zarepour