English
Related papers

Related papers: On the Kozachenko-Leonenko entropy estimator

200 papers

Many statistical procedures, including goodness-of-fit tests and methods for independent component analysis, rely critically on the estimation of the entropy of a distribution. In this paper, we seek entropy estimators that are efficient…

Statistics Theory · Mathematics 2017-06-23 Thomas B. Berrett , Richard J. Samworth , Ming Yuan

In this manuscript we discuss the effectiveness of the Kozachenko-Leonenko entropy estimator when generalised to cope with entropic forms customarily applied to study systems evincing asymptotic scale invariance and dependence (either…

Information Theory · Computer Science 2010-01-04 Silvio M. Duarte Queiros

A non-parametric k-nearest neighbour based entropy estimator is proposed. It improves on the classical Kozachenko-Leonenko estimator by considering non-uniform probability densities in the region of k-nearest neighbours around each sample…

Information Theory · Computer Science 2016-01-27 Damiano Lombardi , Sanjay Pant

The behavior of the Kozachenko - Leonenko estimates for the (differential) Shannon entropy is studied when the number of i.i.d. vector-valued observations tends to infinity. The asymptotic unbiasedness and L^2-consistency of the estimates…

Statistics Theory · Mathematics 2018-01-09 Alexander Bulinski , Denis Dimitrov

Estimating entropy and mutual information consistently is important for many machine learning applications. The Kozachenko-Leonenko (KL) estimator (Kozachenko & Leonenko, 1987) is a widely used nonparametric estimator for the entropy of…

Statistics Theory · Mathematics 2016-07-22 Shashank Singh , Barnabás Póczos

Entropy estimation, due in part to its connection with mutual information, has seen considerable use in the study of time series data including causality detection and information flow. In many cases, the entropy is estimated using…

Statistics Theory · Mathematics 2019-08-06 Alexander L Young , David B Dunson

The conditional mutual information quantifies the conditional dependence of two random variables. It has numerous applications; it forms, for example, part of the definition of transfer entropy, a common measure of the causal relationship…

Information Theory · Computer Science 2024-04-15 Jake Witter , Conor Houghton

The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…

Statistics Theory · Mathematics 2018-04-25 Alexander Bulinski , Alexey Kozhevin

In the paper, we introduce the maximum entropy estimator based on 2-dimensional empirical distribution of the observation sequence of hidden Markov model , when the sample size is big: in that case computing the maximum likelihood estimator…

Statistics Theory · Mathematics 2023-03-16 Shulan Hu , Xinyu Wang , Liming Wu

Intrinsic dimension and differential entropy estimators are studied in this paper, including their systematic bias. A pragmatic approach for joint estimation and bias correction of these two fundamental measures is proposed. Shared steps on…

Machine Learning · Statistics 2020-05-01 Jugurta Montalvão , Jânio Canuto , Luiz Miranda

Entropy estimation is of practical importance in information theory and statistical science. Many existing entropy estimators suffer from fast growing estimation bias with respect to dimensionality, rendering them unsuitable for…

Information Theory · Computer Science 2023-08-22 Ziqiao Ao , Jinglai Li

Central limit theorems (CLTs) for high-dimensional random vectors with dimension possibly growing with the sample size have received a lot of attention in the recent times. Chernozhukov et al. (2017) proved a Berry--Esseen type result for…

Statistics Theory · Mathematics 2019-06-26 Arun Kumar Kuchibhotla , Somabha Mukherjee , Debapratim Banerjee

We introduce a notion of a point-wise entropy of measures (i.e local entropy) called neutralized local entropy, and compare it with the Brin-Katok local entropy. We show that the neutralized local entropy coincides with Brin-Katok local…

Dynamical Systems · Mathematics 2023-07-31 Snir Ben Ovadia , Federico Rodriguez-Hertz

This paper defines and discusses the dimension notion of topological slow entropy of any subset for Z^d actions. Also, the notion of measure-theoretic slow entropy for Z^d actions is presented, which is modified from Brin and Katok [2].…

Dynamical Systems · Mathematics 2011-11-28 De-Peng Kong , Er-Cai Chen

We obtain bounds on fluctuations of two entropy estimators for a class of one-dimensional Gibbs measures on the full shift. They are the consequence of a general exponential inequality for Lipschitz functions of n variables. The first…

Dynamical Systems · Mathematics 2015-05-27 J. -R. Chazottes , C. Maldonado

We revisit the problem of the estimation of the differential entropy $H(f)$ of a random vector $X$ in $R^d$ with density $f$, assuming that $H(f)$ exists and is finite. In this note, we study the consistency of the popular nearest neighbor…

Statistics Theory · Mathematics 2021-02-26 Luc Devroye , László Györfi

Estimators for mutual information are typically biased. However, in the case of the Kozachenko-Leonenko estimator for metric spaces, a type of nearest neighbour estimator, it is possible to calculate the bias explicitly.

Information Theory · Computer Science 2021-05-19 Jake Witter , Conor Houghton

We present an analytical-numerical method providing robust upper estimates for the topological entropy or, more generally, uniform volume growth exponents of differentiable mappings. By introducing varying metrics, we simplify the analysis…

Dynamical Systems · Mathematics 2025-03-17 Mikhail Anikushin , Andrey Romanov

This paper develops the process of using Richardson Extrapolation to improve the Kernel Density Estimation method, resulting in a more accurate (lower Mean Squared Error) estimate of a probability density function for a distribution of data…

Probability · Mathematics 2018-12-21 Ruben G. Ascoli

Wide conditions are provided to guarantee asymptotic unbiasedness and L^2-consistency of the introduced estimates of the Kullback-Leibler divergence for probability measures in R^d having densities w.r.t. the Lebesgue measure. These…

Statistics Theory · Mathematics 2019-07-02 Alexander Bulinski , Denis Dimitrov
‹ Prev 1 2 3 10 Next ›