English
Related papers

Related papers: The Tsallis entropy and the Shannon entropy of a u…

200 papers

Algorithmic entropy and Shannon entropy are two conceptually different information measures, as the former is based on size of programs and the later in probability distributions. However, it is known that, for any recursive probability…

Information Theory · Computer Science 2010-06-03 Andreia Teixeira , Andre Souto , Armando Matos , Luis Antunes

A new method is proposed for analyzing complexity and studying the information in random geometric networks using Tsallis entropy tool. Tsallis entropy of the ensemble of random geometric networks is calculated based on the components of…

Statistical Mechanics · Physics 2025-02-20 O. K. Kazemi , S. M. Taheri

This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…

Mathematical Physics · Physics 2024-05-02 Supriyo Dutta , Shigeru Furuichi , Partha Guha

Tsallis entropy is a useful one-parameter generalization of the standard von Neumann entropy in information theory. We study the variance of Tsallis entropy of bipartite quantum systems in a random pure state. The main result is an exact…

Mathematical Physics · Physics 2022-02-16 Lu Wei

We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…

Information Theory · Computer Science 2024-11-26 Iryna Bodnarchuk , Yuliya Mishura , Kostiantyn Ralchenko

Whereas Shannon entropy is related to the growth rate of multinomial coefficients, we show that the quadratic entropy (Tsallis 2-entropy) is connected to their $q$-deformation; when $q$ is a prime power, these $q$-multinomial coefficients…

Mathematical Physics · Physics 2020-03-27 Juan Pablo Vigneaux

Probability theory is fundamental for modeling uncertainty, with traditional probabilities being real and non-negative. Complex probability extends this concept by allowing complex-valued probabilities, opening new avenues for analysis in…

Information Theory · Computer Science 2025-03-07 Chan Li , Hejun Xu , Zhu Cao

The field of information science has greatly developed, and applications in various fields have emerged. In this paper, we evaluated the coding system in the theory of Tsallis entropy for transmission of messages and aimed to formulate the…

Molecular Networks · Quantitative Biology 2017-12-13 Tatsuaki Tsuruyama

We present a very simple method for the calculation of Shannon, Fisher, Onicescu and Tsallis entropies in atoms, as well as SDL and LMC complexity measures, as functions of the atomic number Z. Fractional occupation probabilities of…

Quantum Physics · Physics 2015-05-13 C. P. Panos , N. S. Nikolaidis , K. Ch. Chatzisavvas , C. C. Tsouros

How complex of the complex networks has attracted many researchers to explore it. The entropy is an useful method to describe the degree of the $complex$ of the complex networks. In this paper, a new method which is based on the Tsallis…

Social and Information Networks · Computer Science 2015-01-29 Qi Zhang , Meizhu Li , Yong Deng , Sankaran Mahadevan

There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the…

Information Theory · Computer Science 2017-08-22 John C. Baez , Tobias Fritz , Tom Leinster

E.T. Jaynes, originator of the maximum entropy interpretation of statistical mechanics, emphasized that there is an inevitable trade-off between the conflicting requirements of robustness and accuracy for any inferencing algorithm. This is…

Information Theory · Computer Science 2014-04-24 Kenric P. Nelson , Brian J. Scannell , Herbert Landau

Quantum entropy and skew information play important roles in quantum information science. They are defined by the trace of the positive operators so that the trace inequalities often have important roles to develop the mathematical theory…

Functional Analysis · Mathematics 2010-08-23 Shigeru Furuichi

An axiomatic foundation regarding the entropy for complex systems is established. Missing from decades of research was the requirement that entropy must measure the uncertainty at the informational scale of the maximizing distribution,…

Statistical Mechanics · Physics 2026-05-29 Kenric P. Nelson

We first show how a new definition of entropy, which is intuitively very simple, as a divergence in cluster-size space, leads to a generalized form that is nonextensive for correlated units, but coincides exactly with the conventional one…

Disordered Systems and Neural Networks · Physics 2007-11-20 Fariel Shafee

The increased uncertainty and complexity of nonlinear systems have motivated investigators to consider generalized approaches to defining an entropy function. New insights are achieved by defining the average uncertainty in the probability…

Statistics Theory · Mathematics 2025-11-25 Kenric P. Nelson , Sabir Umarov , Mark A. Kon

We consider a probability distribution depending on a real parameter $x$. As functions of $x$, the R\'enyi entropy and the Tsallis entropy can be expressed in terms of the associated index of coincidence $S(x)$. We establish recurrence…

Classical Analysis and ODEs · Mathematics 2019-10-31 Alexandra Maduta , Diana Otrocol , Ioan Rasa

In this paper, we consider the information content of maximum ranked set sampling procedure with unequal samples (MRSSU) in terms of Tsallis entropy which is a nonadditive generalization of Shannon entropy. We obtain several results of…

Statistics Theory · Mathematics 2020-11-04 S. Tahmasebi , M. Longobardi , M. R. Kazemi , M. Alizadeh

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is…

Data Analysis, Statistics and Probability · Physics 2007-10-24 Peter Sunehag

We present a near-optimal quantum algorithm, up to logarithmic factors, for estimating the Shannon entropy in the quantum probability oracle model. Our approach combines the singular value separation algorithm with quantum amplitude…

Quantum Physics · Physics 2026-02-03 Myeongjin Shin , Kabgyun Jeong
‹ Prev 1 2 3 10 Next ›