English
Related papers

Related papers: Some results concerning maximum Renyi entropy dist…

200 papers

In this paper, following standard arguments, the maximum Renyi entropy problem for the weighted case is analyzed. We verify that under some constrains on weight function, the Student-r and Student-t distributions maximize the weighted Renyi…

Information Theory · Computer Science 2015-10-27 Salimeh Yasaei Sekeh

The Renyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or…

Quantum Physics · Physics 2014-01-28 Martin Müller-Lennert , Frédéric Dupuis , Oleg Szehr , Serge Fehr , Marco Tomamichel

The Renyi distribution ensuring the maximum of a Renyi entropy is investigated for a particular case of a power--law Hamiltonian. Both Lagrange parameters, $\alpha$ and $\beta$ can be excluded. It is found that $\beta$ does not depend on a…

Statistical Mechanics · Physics 2009-11-10 A. G. Bashkirov

The Renyi entropy with a free Renyi parameter $q$ is the most justified form of information entropy, and the Tsallis entropy may be regarded as a linear approximation to the Renyi entropy when $q\simeq 1$. When $q\to 1$, both entropies go…

Statistical Mechanics · Physics 2007-05-23 Andrei G. Bashkirov

In this paper the author analyses the weighted Renyi entropy in order to derive several inequalities in weighted case. Furthermore, using the proposed notions $\alpha$-th generalized derivation and ($\alpha$; p)-th weighted Fisher…

Information Theory · Computer Science 2015-10-16 Salimeh Yasaei Sekeh

We give a new proof of the theorems on the maximum entropy principle in Tsallis statistics. That is, we show that the $q$-canonical distribution attains the maximum value of the Tsallis entropy, subject to the constraint on the…

Statistical Mechanics · Physics 2015-05-14 Shigeru Furuichi

Shannon and Renyi entropies are quantitative measures of uncertainty in a data set. They are developed by Renyi in the context of entropy theory. These measures have been studied in the case of the multivariate t-distributions. We extend…

Statistics Theory · Mathematics 2019-01-31 Salah H. Abid , Uday J. Quaez

The equilibrium distributions of probabilities providing maximality of Renyi and Tsallis entropies are rederived. New S-forms of them are found which are normalised with corresponding entropies in contrast to the usual Z-forms normalised…

Statistical Mechanics · Physics 2007-05-23 A. G. Bashkirov

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability…

In this paper, we prove that the Renyi entropy of linearly normalized partial maxima of independent and identically distributed random variables is convergent to the corresponding limit Renyi entropy when the linearly normalized partial…

Other Statistics · Statistics 2014-04-23 Ali Saeb

We discuss basic statistical properties of systems with multifractal structure. This is possible by extending the notion of the usual Gibbs--Shannon entropy into more general framework - Renyi's information entropy. We address the…

Statistical Mechanics · Physics 2007-05-23 Petr Jizba , Toshihico Arimitsu

The de Bruijn identity states that Fisher information is equal to a half of the time-derivative of Shannon differential entropy along heat flow. In the same spirit, a generalized version of Fisher information, which we term the…

Information Theory · Computer Science 2025-06-12 Hao Wu , Lei Yu

In this paper we revisit the Bialynicki-Birula & Mycielski uncertainty principle and its cases of equality. This Shannon entropic version of the well-known Heisenberg uncertainty principle can be used when dealing with variables that admit…

Probability · Mathematics 2014-06-23 S. Zozor , C. Vignat

The Renyi entropy coprises a group of data estimates that sums up the well-known Shannon entropy, acquiring a considerable lot of its properties. It appears as unqualified and restrictive entropy, relative entropy, or common data, and has…

General Relativity and Quantum Cosmology · Physics 2023-02-01 H. R. Fazlollahi

The quantum Renyi relative entropies play a prominent role in quantum information theory, finding applications in characterizing error exponents and strong converse exponents for quantum hypothesis testing and quantum communication theory.…

Quantum Physics · Physics 2018-07-26 Kaushik P. Seshadreesan , Ludovico Lami , Mark M. Wilde

Taking into account extremum of a Helmholtz free energy in the equilibrium state of a thermodynamic system the Renyi entropy is derived from the Boltzmann entropy by the same way as the Helmholtz free energy from the Hamiltonian. The…

Statistical Mechanics · Physics 2007-05-23 A. G. Bashkirov

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…

Information Theory · Computer Science 2016-11-17 Olivier Rioul

In the present paper, we would like to draw attention to a possible generalized Fisher information that fits well in the formalism of nonextensive thermostatistics. This generalized Fisher information is defined for densities on…

Mathematical Physics · Physics 2013-01-18 J. -F. Bercher

We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies…

Metric Geometry · Mathematics 2020-12-17 Tom Leinster , Emily Roff

Max stable laws are limit laws of linearly normalized partial maxima of independent identically distributed random variables. Saeb (2014) proves that the Renyi entropy of order b (b > 1) of linear normalized maximum of iid random variables…

Statistics Theory · Mathematics 2024-06-04 Ali Saeb
‹ Prev 1 2 3 10 Next ›