English
Related papers

Related papers: Entropy functions and functional equations

200 papers

Tsallis relative operator entropy was defined as a parametric extension of relative operator entropy and the generalized Shannon inequalities were shown in the previous paper. After the review of some fundamental properties of Tsallis…

Functional Analysis · Mathematics 2010-01-10 Shigeru Furuichi , Kenjiro Yanagi , Ken Kuriyama

A number of inequalities for the weighted entropies is proposed, mirroring properties of a standard (Shannon) entropy and related quantities.

Information Theory · Computer Science 2015-10-12 Yuri Suhov , Salimeh Yasaei Sekeh

The equilibrium distributions of probabilities providing maximality of Renyi and Tsallis entropies are rederived. New S-forms of them are found which are normalised with corresponding entropies in contrast to the usual Z-forms normalised…

Statistical Mechanics · Physics 2007-05-23 A. G. Bashkirov

Tsallis relative operator entropy is defined and then its properties are given. Shannon inequality and its reverse one in Hilbert space operators derived by T.Furuta \cite{Fu:par} are extended in terms of the parameter of the Tsallis…

Functional Analysis · Mathematics 2007-05-23 Kenjiro Yanagi , Ken Kuriyama , Shigeru Furuichi

We consider the problem of defining free energy and other thermodynamic functions when the entropy is given as a general function of the probablity distribution, including that for non extensive forms. We find that the free energy, which is…

Statistical Mechanics · Physics 2007-11-07 Fariel Shafee

This article is a continuation of my paper [arxiv: 1409.1015v2]. R\'enyi and Tsallis entropies are associated to positive linear operators and properties of some functions related to these entropies are investigated.

Classical Analysis and ODEs · Mathematics 2014-12-17 Ioan Raşa

We consider a probability distribution depending on a real parameter $x$. As functions of $x$, the R\'enyi entropy and the Tsallis entropy can be expressed in terms of the associated index of coincidence $S(x)$. We establish recurrence…

Classical Analysis and ODEs · Mathematics 2019-10-31 Alexandra Maduta , Diana Otrocol , Ioan Rasa

We determine a general link between two different solutions of the MaxEnt variational problem, namely, the ones that correspond to using either Shannon's or Tsallis' entropies in the concomitant variational problem. It is shown that the two…

Statistics Theory · Mathematics 2015-06-03 E. Rufeil Fiori , A. Plastino

Tsallis and R\'{e}nyi entropy measures are two possible different generalizations of the Boltzmann-Gibbs entropy (or Shannon's information) but are not generalizations of each others. It is however the Sharma-Mittal measure, which was…

Statistical Mechanics · Physics 2014-10-13 Marco Masi

We generalize the completely monotone conjecture ([CG15]) from Shannon entropy to the Tsallis entropy up for orders up to at least four. To this end, we employ the algorithm ([J\"un16, JM06a]) which employs the technique of systematic…

Analysis of PDEs · Mathematics 2022-12-20 Li-Chang Hung

Within a framework of utmost generality, we show that the entropy maximization procedure with linear constraints uniquely leads to the Shannon-Boltzmann-Gibbs entropy. Therefore, the use of this procedure with linear constraints should not…

Statistical Mechanics · Physics 2018-05-01 Thomas Oikonomou , G. Baris Bagci

We study the regularity of solutions of functional equations of a generalized mean value type. In this paper we give sufficient conditions for the regularity by using hypoellipticity which is a concept of the theory of partial differential…

funct-an · Mathematics 2016-08-31 A. Tsutsumi , S. Haruki

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay

Shannon entropy for discrete distributions is a fundamental and widely used concept, but its continuous analogue, known as differential entropy, lacks essential properties such as positivity and compatibility with the discrete case. In this…

Probability · Mathematics 2025-08-07 Yuliya Mishura , Kostiantyn Ralchenko

In this research paper, it is proved that an approximation to Gibbs-Shannon entropy measure naturally leads to Tsallis entropy for the real parameter q =2 . Several interesting measures based on the input as well as output of a discrete…

Information Theory · Computer Science 2012-01-06 Garimella Rama Murthy

In this paper, I expand Shannon's definition of entropy into a new form of entropy that allows integration of information from different random events. Shannon's notion of entropy is a special case of my more general definition of entropy.…

Machine Learning · Computer Science 2008-11-04 Stefan Jaeger

It is shown that the Renyi entropy is as stable as the Tsallis entropy at least for Abe-Lesche counterexamples.

Statistical Mechanics · Physics 2009-11-10 Andrei G. Bashkirov

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

Statistical Mechanics · Physics 2011-10-25 B. H. Lavenda

The paper deals with the generalization of both Boltzmann entropy and distribution in the light of most-probable interpretation of statistical equilibrium. The statistical analysis of the generalized entropy and distribution leads to some…

Quantum Physics · Physics 2009-11-13 C. G. Chakrabarti , Indranil Chakrabarty

Shannon's entropy and other entropy-based concepts are derived from the new, more general concept of relative divergence of one "grading' function on a linearly ordered set from another such function. The definition of relative divergence…

Probability · Mathematics 2019-03-14 Alexander Dukhovny