English
Related papers

Related papers: A step beyond Tsallis and Renyi entropies

200 papers

We address an information-theoretic approach to noise and disturbance in quantum measurements. Properties of corresponding probability distributions are characterized by means of both the R\'{e}nyi and Tsallis entropies. Related…

Quantum Physics · Physics 2016-03-03 Alexey E. Rastegin

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

Statistical Mechanics · Physics 2011-10-25 B. H. Lavenda

The Shannon entropy is a widely used summary statistic, for example, network traffic measurement, anomaly detection, neural computations, spike trains, etc. This study focuses on estimating Shannon entropy of data streams. It is known that…

Data Structures and Algorithms · Computer Science 2009-10-09 Ping Li

The increased uncertainty and complexity of nonlinear systems have motivated investigators to consider generalized approaches to defining an entropy function. New insights are achieved by defining the average uncertainty in the probability…

Statistics Theory · Mathematics 2025-11-25 Kenric P. Nelson , Sabir Umarov , Mark A. Kon

Several years ago, it has been discussed that non-logarithmic entropies such as the Tsallis q-entropy cannot be applied to systems with continuous variables. Now, in their recent paper [Phys. Rev. E 97, 012104 (2018)], Oikonomou and Bagci…

Statistical Mechanics · Physics 2018-06-13 Congjie Ou , Sumiyoshi Abe

Statistical formulations of thermodynamic entropy, such as those by Boltzmann and Gibbs, were originally developed for classical systems and are well understood in that context. However, the foundational aspects of quantum statistical…

Quantum Physics · Physics 2025-10-08 Smitarani Mishra , Shaon Sahoo

In this short paper, we establish a variational expression of the Tsallis relative entropy. In addition, we derive a generalized thermodynamic inequality and a generalized Peierls-Bogoliubov inequality. Finally we give a generalized…

Statistical Mechanics · Physics 2010-01-10 Shigeru Furuichi

Tsallis entropy is a generalized diversity index first derived in Patil and Taillie (1982) and then rediscovered in community ecology by Keylock (2005). Bayesian nonparametric estimation of Shannon entropy and Simpson's diversity under…

Statistics Theory · Mathematics 2014-11-26 Annalisa Cerquetti

Quantum information measures such as the entropy and the mutual information find applications in physics, e.g., as correlation measures. Generalizing such measures based on the R\'enyi entropies is expected to enhance their scope in…

Quantum Physics · Physics 2015-04-10 Mario Berta , Kaushik P. Seshadreesan , Mark M. Wilde

We show that in the continuum limit, the average spectrum method (ASM) is equivalent to maximizing R\'enyi entropies of order $\eta$, of which Shannon entropy is the special case $\eta=1$. The order of R\'enyi entropy is determined by the…

Strongly Correlated Electrons · Physics 2023-07-24 Khaldoon Ghanem , Erik Koch

We consider the generalized differential entropy of normalized sums of independent and identically distributed (IID) continuous random variables. We prove that the R\'{e}nyi entropy and Tsallis entropy of order $\alpha\ (\alpha>0)$ of the…

Information Theory · Computer Science 2011-06-20 Hongfei Cui , Jianqiang Sun , Yiming Ding

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is…

Data Analysis, Statistics and Probability · Physics 2007-10-24 Peter Sunehag

The proper way of averaging is an important question with regards to Tsallis' Thermostatistics. Three different procedures have been thus far employed in the pertinent literature. The third one, i.e., the Tsallis-Mendes-Plastino (TMP)…

Data Analysis, Statistics and Probability · Physics 2009-11-06 S. Martinez , F. Nicolas , F. Pennini , A. Plastino

Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a…

Quantum Physics · Physics 2017-01-04 Mirjam Weilenmann , Lea Krämer , Philippe Faist , Renato Renner

The entropy shows an unavoidable tendency of disorder in thermostatistics according to the second thermodynamics law. This provides a minimization entropy principle for quantum thermostatistics with the von Neumann entropy and nonextensive…

Quantum Physics · Physics 2021-04-09 M. X. Luo , X. Wang

Many common probability distributions in statistics like the Gaussian, multinomial, Beta or Gamma distributions can be studied under the unified framework of exponential families. In this paper, we prove that both R\'enyi and Tsallis…

Information Theory · Computer Science 2012-02-01 Frank Nielsen , Richard Nock

A formal correspondence between the q-distribution obtained from the Tsallis entropy and non-maxwellian distributions obtained from the Boltzmann-Gibbs entropy is afforded.

Quantum Physics · Physics 2009-11-13 N. G. de Almeida

Plastino, Rocca and Pennini [Phys. Rev. E \textbf{94} (2016) 012145] recently stated that the R\'enyi entropy is not suitable for thermodynamics by using functional calculus, since it leads to anomalous results unlike the Tsallis entropy.…

Statistical Mechanics · Physics 2017-11-29 Thomas Oikonomou , G. Baris Bagci

Divergences often play important roles for study in information science so that it is indispensable to investigate their fundamental properties. There is also a mathematical significance of such results. In this paper, we introduce some…

Statistical Mechanics · Physics 2011-10-19 S. Furuichi , F. -C. Mitroi

The general formalisms of the $q$-dual statistics, the Boltzmann-Gibbs statistics, and three versions of the Tsallis statistics known as Tsallis-1, Tsallis-2, and Tsallis-3 statistics have been considered in the canonical ensemble. We have…

Statistical Mechanics · Physics 2021-12-08 A. S. Parvan