English
Related papers

Related papers: Numerical Stability of Generalized Entropies

200 papers

The Kolmogorov-Sinai entropy in the sense of Tsallis under Bernoulli shifts was obtained by Meson and Vericat [J. Math. Phys. 37, 4480(1996)]. In this paper, we propose a revised generalized Kolmogorov-Sinai-q entropy under Markov shifts.…

Chaotic Dynamics · Physics 2007-05-23 Qiang Liu , Shou-Li Peng

We consider Shannon entropy, Fisher information, R\'enyi entropy, and Tsallis entropy to study the quantum droplet phase in Bose-Einstein condensates. In the beyond mean-field description, the Gross-Pitaevskii equation with Lee-Huang-Yang…

Quantum Gases · Physics 2024-10-04 Sk Siddik , Golam Ali Sekh

Two families of dependence measures between random variables are introduced. They are based on the R\'enyi divergence of order $\alpha$ and the relative $\alpha$-entropy, respectively, and both dependence measures reduce to Shannon's mutual…

Information Theory · Computer Science 2019-08-22 Amos Lapidoth , Christoph Pfister

We present a path toward determining the statistical origin of the thermodynamic limit for systems with long-range interactions. We assume throughout that the systems under consideration have thermodynamic properties given by the Tsallis…

Statistical Mechanics · Physics 2015-06-18 Nikos Kalogeropoulos

Quite general, analytical (both exact and approximate) forms for discrete probability distributions (PD's) that maximize Tsallis entropy for a fixed variance are here investigated. They apply, for instance, in a wide variety of scenarios in…

Statistical Mechanics · Physics 2009-11-11 C. Vignat , A. Plastino

We propose a generalized entropy maximization procedure, which takes into account the generalized averaging procedures and information gain definitions underlying the generalized entropies. This novel generalized procedure is then applied…

Statistical Mechanics · Physics 2015-05-13 G. Baris Bagci , Ugur Tirnakli

The Boltzmann--Gibbs entropy is a functional on the space of probability measures. When a state space is countable, one characterization of the Boltzmann--Gibbs entropy is given by the Shannon--Khinchin axioms, which consist of continuity,…

Mathematical Physics · Physics 2021-11-03 Asuka Takatsu

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

For statistical systems that violate one of the four Shannon-Khinchin axioms, entropy takes a more general form than the Boltzmann-Gibbs entropy. The framework of superstatistics allows one to formulate a maximum entropy principle with…

Classical Physics · Physics 2012-11-13 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We consider the concept of generalized measure-theoretic entropy, where instead of the Shannon entropy function we consider an arbitrary concave function defined on the unit interval, vanishing in the origin. Under mild assumptions on this…

Dynamical Systems · Mathematics 2014-08-21 Fryderyk Falniowski

We study the continuity property of the generalized entropy as a function of the underlying probability distribution, defined with an action space and a loss function, and use this property to answer the basic questions in statistical…

Machine Learning · Computer Science 2022-01-04 Aolin Xu

We extend the Hanel and Thurner asymptotic analysis to both extensive and non-extensive entropies on the basis of a wide class of entropic forms. The procedure is known to be capable to classify multiple entropy measures in terms of their…

Statistical Mechanics · Physics 2020-02-21 Nana Cabo Bizet , Jesus Fuentes , Octavio Obregon

We explore a possible application of the additive generalization of the Boltzmann-Gibbs-Shannon entropy proposed in [A.N. Gorban, I.V. Karlin, Phys. Rev. E, 67:016104 (2003)] to fully developed turbulence. The predicted probability…

Fluid Dynamics · Physics 2007-05-23 Patrick Ilg , Iliya V. Karlin , Alexander N. Gorban

The pathway model of Mathai (2005) is shown to be inferable from the maximization of a certain generalized entropy measure. This entropy is a variant of the generalized entropy of order 'alpha', considered in Mathai and Rathie (1975), and…

Statistical Mechanics · Physics 2009-11-11 A. M. Mathai , H. J. Haubold

We consider a family of probability distributions depending on a real parameter and including the binomial, Poisson and negative binomial distributions. The corresponding index of coincidence satisfies a Heun differential equation and is a…

Classical Analysis and ODEs · Mathematics 2018-01-17 Adina Barar , Gabriela Raluca Mocanu , Ioan Rasa

Tsallis has suggested a nonextensive generalization of the Boltzmann-Gibbs entropy, the maximization of which gives a generalized canonical distribution under special constraints. In this brief report we show that the generalized canonical…

Statistical Mechanics · Physics 2021-04-28 Brian R. La Cour , William C. Schieve

Entropy and its various generalizations are important in many fields, including mathematical statistics, communication theory, physics and computer science, for characterizing the amount of information associated with a probability…

We present the characterization of the Nath, R\'enyi and Havrda-Charv\'at-Tsallis entropies under the assumption that they are analytic function with respect to the distribution dimension, unlike the the previous characterizations, which…

Information Theory · Computer Science 2013-11-05 Velimir M. Ilic , Miomir S. Stankovic

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

Statistical Mechanics · Physics 2011-10-25 B. H. Lavenda

Tsallis relative operator entropy is defined and then its properties are given. Shannon inequality and its reverse one in Hilbert space operators derived by T.Furuta \cite{Fu:par} are extended in terms of the parameter of the Tsallis…

Functional Analysis · Mathematics 2007-05-23 Kenjiro Yanagi , Ken Kuriyama , Shigeru Furuichi