English
Related papers

Related papers: Empirical estimation of entropy functionals with c…

200 papers

We provide finite-sample analysis of a general framework for using k-nearest neighbor statistics to estimate functionals of a nonparametric continuous probability density, including entropies and divergences. Rather than plugging a…

Statistics Theory · Mathematics 2016-08-23 Shashank Singh , Barnabás Póczos

Entropy-type integral functionals of densities are widely used in mathematical statistics, information theory, and computer science. Examples include measures of closeness between distributions (e.g., density power divergence) and…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Oleg Seleznjev

The problem of accurate nonparametric estimation of distributional functionals (integral functionals of one or more probability distributions) has received recent interest due to their wide applicability in signal processing, information…

Information Theory · Computer Science 2017-07-12 Kevin R. Moon , Kumar Sricharan , Alfred O. Hero

A non-parametric k-nearest neighbour based entropy estimator is proposed. It improves on the classical Kozachenko-Leonenko estimator by considering non-uniform probability densities in the region of k-nearest neighbours around each sample…

Information Theory · Computer Science 2016-01-27 Damiano Lombardi , Sanjay Pant

The problem of estimation of density functionals like entropy and mutual information has received much attention in the statistics and information theory communities. A large class of estimators of functionals of the probability density…

Statistics Theory · Mathematics 2013-03-05 Kumar Sricharan , Dennis Wei , Alfred O. Hero

Estimating expected polynomials of density functions from samples is a basic problem with numerous applications in statistics and information theory. Although kernel density estimators are widely used in practice for such functional…

Information Theory · Computer Science 2017-02-13 Weihao Gao , Sewoong Oh , Pramod Viswanath

A class of estimators of the R\'{e}nyi and Tsallis entropies of an unknown distribution $f$ in $\mathbb{R}^m$ is presented. These estimators are based on the $k$th nearest-neighbor distances computed from a sample of $N$ i.i.d. vectors with…

Statistics Theory · Mathematics 2012-11-16 Nikolai Leonenko , Luc Pronzato , Vippal Savani

Probabilistic k-nearest neighbour (PKNN) classification has been introduced to improve the performance of original k-nearest neighbour (KNN) classification algorithm by explicitly modelling uncertainty in the classification of each feature…

Machine Learning · Computer Science 2013-05-07 Ji Won Yoon , Nial Friel

We introduce the Binless Multidimensional Thermodynamic Integration (BMTI) method for nonparametric, robust, and data-efficient density estimation. BMTI estimates the logarithm of the density by initially computing log-density differences…

Machine Learning · Statistics 2026-05-18 Matteo Carli , Alex Rodriguez , Alessandro Laio , Aldo Glielmo

In the present paper, we derive Berry-Esseen bounds for the estimation of diversity indices on countable alphabets. A general non-asymptotic convergence rate is established for the plug-in estimator of a wide class of indices, including…

Probability · Mathematics 2026-04-14 Zhen Hong Yu , Yu Miao

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

We consider the problem of estimating smooth integrated functionals of a monotone nonincreasing density $f$ on $[0,\infty)$ using the nonparametric maximum likelihood based plug-in estimator. We find the exact asymptotic distribution of…

Statistics Theory · Mathematics 2019-04-16 Rajarshi Mukherjee , Bodhisattva Sen

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…

comp-gas · Physics 2008-02-03 David H. Wolpert , David R. Wolf

In this research work, a total of 45 different estimators of the Shannon differential entropy were reviewed. The estimators were mainly based on three classes, namely: window size spacings, kernel density estimation (KDE) and k-nearest…

Methodology · Statistics 2024-07-01 Mbanefo S. Madukaife , Ho Dang Phuc

We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…

Statistical Mechanics · Physics 2009-11-10 Alexander Kraskov , Harald Stoegbauer , Peter Grassberger

A new approach to $L_2$-consistent estimation of a general density functional using $k$-nearest neighbor distances is proposed, where the functional under consideration is in the form of the expectation of some function $f$ of the densities…

Statistics Theory · Mathematics 2022-03-14 J. Jon Ryu , Shouvik Ganguly , Young-Han Kim , Yung-Kyun Noh , Daniel D. Lee

Nonparametric estimation of mutual information is used in a wide range of scientific problems to quantify dependence between variables. The k-nearest neighbor (knn) methods are consistent, and therefore expected to work well for large…

Statistics Theory · Mathematics 2018-04-18 Warren M. Lord , Jie Sun , Erik M. Bollt

Estimation of Shannon and R\'enyi entropies of unknown discrete distributions is a fundamental problem in statistical property testing and an active research topic in both theoretical computer science and information theory. Tight bounds on…

Quantum Physics · Physics 2023-07-19 Tongyang Li , Xiaodi Wu

We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…

Machine Learning · Statistics 2010-10-27 Dávid Pál , Barnabás Póczos , Csaba Szepesvári

In this paper, we study estimation of certain integral functionals of one or two densities with samples from stationary m-dependent sequences. We consider two types of U-statistic estimators for these functionals that are functions of the…

Statistics Theory · Mathematics 2013-09-20 David Källberg , Oleg Seleznjev
‹ Prev 1 2 3 10 Next ›