English
Related papers

Related papers: What do generalized entropies look like? An axioma…

200 papers

Algorithmic entropy and Shannon entropy are two conceptually different information measures, as the former is based on size of programs and the later in probability distributions. However, it is known that, for any recursive probability…

Information Theory · Computer Science 2010-06-03 Andreia Teixeira , Andre Souto , Armando Matos , Luis Antunes

The generalized entropic measure, which is optimized by a given arbitrary distribution under the constraints on normalization of the distribution and the finite ordinary expectation value of a physical random quantity, is considered and its…

Statistical Mechanics · Physics 2009-11-10 Sumiyoshi Abe , G. Kaniadakis , A. M. Scarfone

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

Stochastic thermodynamics extends classical thermodynamics to small systems in contact with one or more heat baths. It can account for the effects of thermal fluctuations and describe systems far from thermodynamic equilibrium. A basic…

Statistical Mechanics · Physics 2018-01-04 Momčilo Gavrilov , Raphaël Chétrite , John Bechhoefer

A generalization of the entropy production rate is proposed $\Pi_q$ in non-equilibrium systems by extending the formalism of classical stochastic thermodynamics to regimes with non-Gaussian fluctuations. Through the R\'enyi entropy $S_q$ ,…

Statistical Mechanics · Physics 2025-10-02 J. M. Nieto-Villar , R. Mansilla , I. Santamaria-Holek

Even if a probability distribution is properly normalizable, its associated Shannon (or von Neumann) entropy can easily be infinite. We carefully analyze conditions under which this phenomenon can occur. Roughly speaking, this happens when…

Statistical Mechanics · Physics 2013-04-04 Valentina Baccetti , Matt Visser

The pathway model of Mathai (2005) is shown to be inferable from the maximization of a certain generalized entropy measure. This entropy is a variant of the generalized entropy of order 'alpha', considered in Mathai and Rathie (1975), and…

Statistical Mechanics · Physics 2009-11-11 A. M. Mathai , H. J. Haubold

It is shown that the standard expression for the information entropy, originally due to Shannon, is only valid for a particular set of states. For the general case of statistical mechanics, one needs to include an additional term in the…

Statistical Mechanics · Physics 2012-09-26 Phil Attard

A measure of how sensitive the entanglement entropy is in a quantum system, has been proposed and its information geometric origin is discussed. It has been demonstrated for two exactly solvable spin systems, that thermodynamic criticality…

Statistical Mechanics · Physics 2025-10-02 Pritam Sarkar

Probability distributions having power-law tails are observed in a broad range of social, economic, and biological systems. We describe here a potentially useful common framework. We derive distribution functions $\{p_k\}$ for situations in…

Physics and Society · Physics 2015-01-07 Jack Peterson , Purushottam D. Dixit , Ken A. Dill

Experimental and theoretical results about entropy limits for macroscopic and single-particle systems are reviewed. It is clarified when it is possible to speak about a quantum of entropy, given by the Boltzmann constant k, and about a…

Quantum Physics · Physics 2023-11-06 Uwe Hohm , Christoph Schiller

Ergodicity, this is to say, dynamics whose time averages coincide with ensemble averages, naturally leads to Boltzmann-Gibbs (BG) statistical mechanics, hence to standard thermodynamics. This formalism has been at the basis of an enormous…

Statistical Mechanics · Physics 2009-11-10 Constantino Tsallis , Celia Anteneodo , Lisa Borland , Roberto Osorio

We consider an isomorphism invariant for measure-preserving systems - types of generalized entropy convergence rates. We show the connections of this invariant with the types of Shannon entropy convergence rates. In the case when they…

Dynamical Systems · Mathematics 2013-09-25 Fryderyk Falniowski

In this Thesis, several results in quantum information theory are collected, most of which use entropy as the main mathematical tool. *While a direct generalization of the Shannon entropy to density matrices, the von Neumann entropy behaves…

Quantum Physics · Physics 2018-10-25 Christian Majenz

We define the class of multivariate group entropies as a novel set of information - theoretical measures, which extends significantly the family of group entropies. We propose new examples related to the "super-exponential" universality…

Mathematical Physics · Physics 2020-12-03 Piergiulio Tempesta

We describe in detail two numerical simulation methods valid to study systems whose thermostatistics is described by generalized entropies, such as Tsallis. The methods are useful for applications to non-trivial interacting systems with a…

Statistical Mechanics · Physics 2009-10-31 R. Salazar , R. Toral

We present a comparative analysis of the plethora of nonextensive and/or nonadditive entropies which go beyond the standard Boltzmann-Gibbs formulation. After defining the basic notions of additivity, extensivity, and composability, we…

General Relativity and Quantum Cosmology · Physics 2024-09-30 Mariusz P. Dabrowski

Tsallis has suggested a nonextensive generalization of the Boltzmann-Gibbs entropy, the maximization of which gives a generalized canonical distribution under special constraints. In this brief report we show that the generalized canonical…

Statistical Mechanics · Physics 2021-04-28 Brian R. La Cour , William C. Schieve

In many applications, the probability density function is subject to experimental errors. In this work the continuos dependence of a class of generalized entropies on the experimental errors is studied. This class includes the C. Shannon,…

Data Analysis, Statistics and Probability · Physics 2016-05-20 György Steinbrecher , Giorgio Sonnino

We introduce a nonextensive entropic measure $S_{\chi}$ that grows like $N^{\chi}$, where $N$ is the size of the system under consideration. This kind of nonextensivity arises in a natural way in some $N$-body systems endowed with…

Statistical Mechanics · Physics 2009-10-31 R. Salazar , A. R. Plastino , R. Toral