English
Related papers

Related papers: A note on entropy estimation

200 papers

This note shows how to apply the James-Stein estimator to the case of entropic uncertainty relations of more than two observables. A better result is found compared to applying the ordinary estimator and we find a more optimal model…

Quantum Physics · Physics 2017-02-09 Mark Stander

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. This problem is magnified in high-dimensional settings where the number of variables $p$ diverges with the sample size $n$, as well…

Statistics Theory · Mathematics 2020-02-21 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

We reply to the Comment by Jizba and Korbel [arXiv:1905.00729v1] by first pointing out that the Schur-concavity proposed by them falls short of identifying the correct intervals of normalization for the optimum probability distribution even…

Statistical Mechanics · Physics 2019-08-28 Thomas Oikonomou , G. Baris Bagci

In systematic reviews and meta-analysis, researchers often pool the results of the sample mean and standard deviation from a set of similar clinical trials. A number of the trials, however, reported the study using the median, the minimum…

Methodology · Statistics 2016-10-06 Xiang Wan , Wenqian Wang , Jiming Liu , Tiejun Tong

Modified estimators for the contribution rates of population eigenvalues are given under an elliptically contoured distribution. These estimators decrease the bias of the classical estimator, i.e. the sample contribution rates. The…

Statistics Theory · Mathematics 2012-03-22 Yo Sheena

In this paper, the authors first provide an overview of two major developments on complex survey data analysis: the empirical likelihood methods and statistical inference with non-probability survey samples, and highlight the important…

Methodology · Statistics 2025-08-14 Yilin Chen , Pengfei Li , J. N. K. Rao , Changbao Wu

The entropy power inequality (EPI) provides lower bounds on the differential entropy of the sum of two independent real-valued random variables in terms of the individual entropies. Versions of the EPI for discrete random variables have…

Information Theory · Computer Science 2013-01-18 Saeid Haghighatshoar , Emmanuel Abbe , Emre Telatar

Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation T_a. That is, if X and Y are independent random variables on Z_+ with ultra-log-concave…

Information Theory · Computer Science 2009-09-24 Yaming Yu , Oliver Johnson

With recent advances in high throughput technology, researchers often find themselves running a large number of hypothesis tests (thousands+) and esti- mating a large number of effect-sizes. Generally there is particular interest in those…

Machine Learning · Statistics 2013-11-18 Noah Simon , Richard Simon

This paper derives an objective Bayesian "prior" based on considerations of entropy/information. By this means, it produces a quantitative measure of goodness of fit (the "H-statistic") that balances higher likelihood against the number of…

Astrophysics · Physics 2008-11-26 Rafael D. Sorkin

Multiple importance sampling estimators are widely used for computing intractable constants due to its reliability and robustness. The celebrated balance heuristic estimator belongs to this class of methods and has proved very successful in…

Computation · Statistics 2019-09-05 Felipe J Medina-Aguayo , Richard G Everitt

We explore a supervised machine learning approach to estimate the entanglement entropy of multi-qubit systems from few experimental samples. We put a particular focus on estimating both aleatoric and epistemic uncertainty of the network's…

Quantum Physics · Physics 2024-01-04 Maximilian Rieger , Moritz Reh , Martin Gärttner

Small systems consisting of a few particles are increasingly technologically relevant. In such systems, an intense debate in microcanonical statistical mechanics has been about the correctness of Boltzmann's surface entropy versus Gibbs'…

Statistical Mechanics · Physics 2024-09-20 Ananth Govind Rajan

The decay of large-scale anisotropies in small-scale turbulent flow is investigated. By introducing two different kinds of estimators we discuss the relation between the presence of a hierarchy for the isotropic and the anisotropic scaling…

Chaotic Dynamics · Physics 2009-10-31 L. Biferale , M. Vergassola

Minimum divergence estimators provide a natural choice of estimators in a statistical inference problem. Different properties of various families of these divergence measures such as Hellinger distance, power divergence, density power…

Statistics Theory · Mathematics 2025-07-08 Subhrajyoty Roy , Supratik Basu , Abhik Ghosh , Ayanendranath Basu

Quantiles can represent key operational and business metrics, but the computational challenges associated with inference has hampered their adoption in online experimentation. One-sample confidence intervals are trivial to construct;…

Methodology · Statistics 2024-08-02 Evan Miller

Two sequential estimators are proposed for the odds p/(1-p) and log odds log(p/(1-p)) respectively, using independent Bernoulli random variables with parameter p as inputs. The estimators are unbiased, and guarantee that the variance of the…

Statistics Theory · Mathematics 2025-01-07 Luis Mendo

We present a procedure for effective estimation of entropy and mutual information from small-sample data, and apply it to the problem of inferring high-dimensional gene association networks. Specifically, we develop a James-Stein-type…

Machine Learning · Statistics 2009-08-08 Jean Hausser , Korbinian Strimmer

Ensuring a satisfactory statistical convergence of anharmonic thermodynamic properties requires sampling of many atomic configurations, however the methods to obtain those necessarily produce correlated samples, thereby reducing the…

Statistical Mechanics · Physics 2022-06-07 Erki Metsanurk

Widely used methods for analyzing missing data can be biased in small samples. To understand these biases, we evaluate in detail the situation where a small univariate normal sample, with values missing at random, is analyzed using either…

Statistics Theory · Mathematics 2017-03-27 Paul T. von Hippel