English
Related papers

Related papers: Statistical Inference for R\'enyi Entropy Function…

200 papers

Estimating statistical properties is fundamental in statistics and computer science. In this paper, we propose a unified quantum algorithm framework for estimating properties of discrete probability distributions, with estimating R\'enyi…

Quantum Physics · Physics 2024-04-04 Xinzhao Wang , Shengyu Zhang , Tongyang Li

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…

comp-gas · Physics 2008-02-03 David R. Wolf , David H. Wolpert

We discuss some properties of the generalized entropies, called Renyi entropies and their application to the case of continuous distributions. In particular it is shown that these measures of complexity can be divergent, however, their…

Disordered Systems and Neural Networks · Physics 2007-05-23 I. Varga , J. Pipek

In statistical analysis, quantifying uncertainties through measures such as entropy, extropy, varentropy, and varextropy is of fundamental importance for understanding distribution functions. This paper investigates several properties of…

Statistics Theory · Mathematics 2025-01-28 Santosh Kumar Chaudhary , Nitin Gupta

Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…

Quantum Physics · Physics 2023-05-30 Alexey E. Rastegin

Entanglement criteria for an $n$-partite quantum system with continuous variables are formulated in terms of R\'{e}nyi entropies. R\'{e}nyi entropies are widely used as a good information measure due to many nice properties. Derived…

Quantum Physics · Physics 2017-05-22 Alexey E. Rastegin

Distributions of abundances or frequencies play an important role in many fields of science, from biology to sociology, as does the R\'enyi entropy, which measures the diversity of a statistical ensemble. We derive a mathematical relation…

Populations and Evolution · Quantitative Biology 2016-12-26 Thierry Mora , Aleksandra M. Walczak

The universal typical-signal estimators of entropy and cross entropy based on the asymptotics of recurrence and waiting times play an important role in information theory. Building on their construction, we introduce and study universal…

Mathematical Physics · Physics 2023-06-07 Giampaolo Cristadoro , Mirko Degli Esposti , Vojkan Jakšić , Renaud Raquépas

For certain families of finite quantum graphs, we study the question of how eigenfunctions are distributed over the graph. To characterize properties of the distribution, generalized entropies of the R\'{e}nyi and Tsallis types are…

Mathematical Physics · Physics 2017-05-22 Alexey E. Rastegin

In this paper, we study estimation of certain integral functionals of one or two densities with samples from stationary m-dependent sequences. We consider two types of U-statistic estimators for these functionals that are functions of the…

Statistics Theory · Mathematics 2013-09-20 David Källberg , Oleg Seleznjev

In this paper we study certain properties of R\'{e}nyi entropy functionals $H_\alpha(\mathcal{P})$ on the space of probability distributions over $\mathbb{Z}_+$. Primarily, continuity and convergence issues are addressed. Some properties…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

Entropy is a measure of self-information which is used to quantify losses. Entropy was developed in thermodynamics, but is also used to compare probabilities based on their deviating information content. Corresponding model uncertainty is…

Probability · Mathematics 2018-01-23 Alois Pichler , Ruben Schlotter

We compute R\'enyi entropies for the statistics of a noisy simultaneous observation of two complementary observables in two-dimensional quantum systems. The relative amount of uncertainty between two states depends on the uncertainty…

Quantum Physics · Physics 2015-11-17 Alfredo Luis , Gustavo Martín Bosyk , Mariela Portesi

R\'enyi entropy is an important measure in the context of information theory as a generalization of Shannon entropy. This information measure was often used for uncertainty quantification of dynamical behaviour of stochastic processes. In…

Statistics Theory · Mathematics 2025-10-28 Salah H. Abid , Uday J. Quaez , Javier E. Contreras-Reyescor

We discuss the properties of invariant measures corresponding to iterated function systems (IFSs) with place-dependent probabilities and compute their Renyi entropies, generalized dimensions, and multifractal spectra. It is shown that with…

chao-dyn · Physics 2009-10-31 Wojciech Slomczynski , Jaroslaw Kwapien , Karol Zyczkowski

We consider the two-dimensional (2d) Ising model on a infinitely long cylinder and study the probabilities $p_i$ to observe a given spin configuration $i$ along a circular section of the cylinder. These probabilities also occur as…

Strongly Correlated Electrons · Physics 2010-11-02 Jean-Marie Stéphan , Grégoire Misguich , Vincent Pasquier

Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…

Computer Vision and Pattern Recognition · Computer Science 2014-05-25 Dr. S. K. Katiyar , Arun P. V.

New class of reference distribution functions for numerical approximation of the solution of the Fokker-Planck equations associated to the charged particle dynamics in tokamak are studied. The reference distribution functions are obtained…

Statistical Mechanics · Physics 2016-11-22 György Steinbrecher , Giorgio Sonnino , Nicolae Pometescu

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal