English
Related papers

Related papers: A two-parameter entropy and its fundamental proper…

200 papers

The uniqueness theorem for a two-parameter extended relative entropy is proven. This result extends our previous one, the uniqueness theorem for a one-parameter extended relative entropy, to a two-parameter case. In addition, the properties…

Statistical Mechanics · Physics 2010-12-30 Shigeru Furuichi

A new method is proposed for analyzing complexity and studying the information in random geometric networks using Tsallis entropy tool. Tsallis entropy of the ensemble of random geometric networks is calculated based on the components of…

Statistical Mechanics · Physics 2025-02-20 O. K. Kazemi , S. M. Taheri

We demonstrate and discuss the process of gaining information and show an example in which some specific way of gaining information about an object results in the Tsallis form of entropy rather than in the Shannon one.

Statistical Mechanics · Physics 2009-11-13 Grzegorz Wilk , Zbigniew Wlodarczyk

As additivity is a characteristic property of the classical information measure, Shannon entropy, pseudo-additivity is a characteristic property of Tsallis entropy. Renyi generalized Shannon entropy by means of Kolmogorov-Nagumo averages,…

Mathematical Physics · Physics 2007-05-23 Ambedkar Dukkipati , M. Narsimha Murty , Shalabh Bhatnagar

We study the properties of Tsallis entropy and Shannon entropy from the point of view of algorithmic randomness. In algorithmic information theory, there are two equivalent ways to define the program-size complexity K(s) of a given finite…

Information Theory · Computer Science 2019-09-04 Kohtaro Tadaki

Tsallis relative operator entropy was defined as a parametric extension of relative operator entropy and the generalized Shannon inequalities were shown in the previous paper. After the review of some fundamental properties of Tsallis…

Functional Analysis · Mathematics 2010-01-10 Shigeru Furuichi , Kenjiro Yanagi , Ken Kuriyama

In this paper we remark that Shannon entropy can be expressed as a function of the self-information (i.e. the logarithm) and the inverse of the Lambert $W$ function. It means that we consider that Shannon entropy has the trace form: $-k…

Statistical Mechanics · Physics 2019-07-05 Laurent Truffet

Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…

Quantum Physics · Physics 2023-05-30 Alexey E. Rastegin

The Shannon-Khinchin axioms for the ordinary information entropy are generalized in a natural way to the nonextensive systems based on the concept of nonextensive conditional entropy, and a complete proof of the uniqueness theorem for the…

Statistical Mechanics · Physics 2009-10-31 Sumiyoshi Abe

A consistent generalization of statistical mechanics is obtained by applying the maximum entropy principle to a trace-form entropy and by requiring that physically motivated mathematical properties are preserved. The emerging…

Statistical Mechanics · Physics 2009-11-10 G. Kaniadakis , M. Lissia , A. M. Scarfone

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

Wada and Suyari proposed a two-parameter generalization of Shannon-Khinchin axioms (TGSK axioms) [T. Wada and H. Suyari, Physics Letters A, 368(3)]. We derive a new class of entropies which differs from Wada-Suyari's class by fixing the…

Mathematical Physics · Physics 2013-01-30 Velimir M. Ilic , Edin H. Mulalic , Miomir S. Stankovic

Tsallis entropy is a useful one-parameter generalization of the standard von Neumann entropy in information theory. We study the variance of Tsallis entropy of bipartite quantum systems in a random pure state. The main result is an exact…

Mathematical Physics · Physics 2022-02-16 Lu Wei

The structure entropy is one of the most important parameters to describe the structure property of the complex networks. Most of the existing struc- ture entropies are based on the degree or the betweenness centrality. In order to describe…

Social and Information Networks · Computer Science 2014-11-25 Qi Zhang , Xi Lu , Meizhu Li , Yong Deng , Sankaran Mahadevan

We study an entropy measure for quantum systems that generalizes the von Neumann entropy as well as its classical counterpart, the Gibbs or Shannon entropy. The entropy measure is based on hypothesis testing and has an elegant formulation…

Quantum Physics · Physics 2014-02-19 F. Dupuis , L. Kraemer , P. Faist , J. M. Renes , R. Renner

The entropy of a graph is an information-theoretic quantity which expresses the complexity of a graph \cite{DM1,M}. After Shannon introduced the definition of entropy to information and communication, many generalizations of the entropy…

Combinatorics · Mathematics 2014-11-26 Xueliang Li , Zhongmei Qin , Meiqin Wei , Ivan Gutman , Matthias Dehmer

There are no universally accepted definitions of R\'enyi conditional entropy and R\'enyi mutual information, although motivated by different applications, several definitions have been proposed in the literature. In this paper, we consider…

Information Theory · Computer Science 2025-11-05 Shi-Bing Li , Ke Li , Lei Yu

The paper extends the analysis of the entropies of the Poisson distribution with parameter $\lambda$. It demonstrates that the Tsallis and Sharma-Mittal entropies exhibit monotonic behavior with respect to $\lambda$, whereas two generalized…

Probability · Mathematics 2024-11-27 Dmitri Finkelshtein , Anatoliy Malyarenko , Yuliya Mishura , Kostiantyn Ralchenko

We discuss two families of two-parameter entropies and divergences, derived from the standard R\'enyi and Tsallis entropies and divergences. These divergences and entropies are found as divergences or entropies of escort distributions.…

Mathematical Physics · Physics 2011-09-16 J. -F. Bercher