English
Related papers

Related papers: An overview of generalized entropic forms

200 papers

The formalism of statistical mechanics can be generalized by starting from more general measures of information than the Shannon entropy and maximizing those subject to suitable constraints. We discuss some of the most important examples of…

Statistical Mechanics · Physics 2015-05-13 Christian Beck

Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…

Data Analysis, Statistics and Probability · Physics 2026-04-20 Andrea Somazzi , Diego Garlaschelli

A consistent generalization of statistical mechanics is obtained by applying the maximum entropy principle to a trace-form entropy and by requiring that physically motivated mathematical properties are preserved. The emerging…

Statistical Mechanics · Physics 2009-11-10 G. Kaniadakis , M. Lissia , A. M. Scarfone

Shannon and Khinchin showed that assuming four information theoretic axioms the entropy must be of Boltzmann-Gibbs type, $S=-\sum_i p_i \log p_i$. Here we note that in physical systems one of these axioms may be violated. For non-ergodic…

Statistical Mechanics · Physics 2015-03-19 Stefan Thurner , Rudolf Hanel

The notion of entropy is ubiquitous both in natural and social sciences. In the last two decades, a considerable effort has been devoted to the study of new entropic forms, which generalize the standard Boltzmann-Gibbs (BG) entropy and are…

Mathematical Physics · Physics 2015-10-15 Piergiulio Tempesta

This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…

Mathematical Physics · Physics 2024-05-02 Supriyo Dutta , Shigeru Furuichi , Partha Guha

Using the generalized entropies which depend on two parameters we propose a set of quantitative characteristics derived from the Information Geometry based on these entropies. Our aim, at this stage, is modest, as we are first constructing…

Mathematical Physics · Physics 2018-02-14 Demetris P. K. Ghikas , Fotios Oikonomou

Shannon entropy ($S$), R{\'e}nyi entropy ($R$), Tsallis entropy ($T$), Fisher information ($I$) and Onicescu energy ($E$) have been explored extensively in both \emph{free} H atom (FHA) and \emph{confined} H atom (CHA). For a given quantum…

Quantum Physics · Physics 2019-04-05 Neetik Mukherjee , Amlan K. Roy

Systems with a long-term stationary state that possess as a spatio-temporally fluctuation quantity $\beta$ can be described by a superposition of several statistics, a "super statistics". We consider first, the Gamma, log-normal and…

Statistical Mechanics · Physics 2015-06-05 O. Obregón , A. Gil-Villegas

In the past over two decades, very fruitful results have been obtained in information theory in the study of the Shannon entropy. This study has led to the discovery of a new class of constraints on the Shannon entropy called…

Information Theory · Computer Science 2025-03-07 Raymond W. Yeung

Entropies are fundamental measures of uncertainty with central importance in information theory and statistics and applications across all the quantitative sciences. Under a natural set of operational axioms, the most general form of…

Information Theory · Computer Science 2026-02-02 Roberto Rubboli , Erkka Haapasalo , Marco Tomamichel

We shall prove that the celebrated R\'enyi entropy is the first example of a new family of infinitely many multi-parametric entropies. We shall call them the $Z$-entropies. Each of them, under suitable hypotheses, generalizes the celebrated…

Mathematical Physics · Physics 2017-02-07 Piergiulio Tempesta

Since its origin in the thermodynamics of the 19th century, the concept of entropy has also permeated other fields of physics and mathematics, such as Classical and Quantum Statistical Mechanics, Information Theory, Probability Theory,…

Machine Learning · Statistics 2025-03-06 Salomé A. Sepúveda Fontaine , José M. Amigó

We extend the Hanel and Thurner asymptotic analysis to both extensive and non-extensive entropies on the basis of a wide class of entropic forms. The procedure is known to be capable to classify multiple entropy measures in terms of their…

Statistical Mechanics · Physics 2020-02-21 Nana Cabo Bizet , Jesus Fuentes , Octavio Obregon

A two parameter generalization of Boltzmann-Gibbs-Shannon entropy based on natural logarithm is introduced. The generalization of the Shannon-Kinchinn axioms corresponding to the two parameter entropy is proposed and verified. We present…

Statistical Mechanics · Physics 2013-03-08 R. Chandrashekar , C. Ravikumar , J. Segar

We consider the Shannon-Khinchin axiomatic systems for the characterization of generalized entropies such as Sharma-Mital and Frank-Daffertshofer entropy. We provide the generalization of Shannon-Khinchin axioms and give the corresponding…

Mathematical Physics · Physics 2015-06-17 Velimir M. Ilic , Miomir S. Stankovic

The classical Maximum-Entropy Principle (MEP) based on Shannon entropy is widely used to construct least-biased probability distributions from partial information. However, the Shore-Johnson axioms that single out the Shannon functional…

Methodology · Statistics 2025-11-03 Giuseppe M. Ferro , Edwin T. Pos , Andrea Somazzi

Superstatistics describes statistical systems that behave like superpositions of different inverse temperatures $\beta$, so that the probability distribution is $p(\epsilon_i) \propto \int_{0}^{\infty} f(\beta) e^{-\beta \epsilon_i}d\beta$,…

Statistical Mechanics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We study an entropy measure for quantum systems that generalizes the von Neumann entropy as well as its classical counterpart, the Gibbs or Shannon entropy. The entropy measure is based on hypothesis testing and has an elegant formulation…

Quantum Physics · Physics 2014-02-19 F. Dupuis , L. Kraemer , P. Faist , J. M. Renes , R. Renner

The statistical proprieties of complex systems can differ deeply for those of classical systems governed by Boltzmann-Gibbs entropy. In particular, the probability distribution function observed in several complex systems shows a power law…

Statistical Mechanics · Physics 2016-08-31 A. M. Scarfone
‹ Prev 1 2 3 10 Next ›