English
Related papers

Related papers: A note on bounded entropies

200 papers

This paper addresses the correspondence between linear inequalities of Shannon entropy and differential entropy for sums of independent group-valued random variables. We show that any balanced (with the sum of coefficients being zero)…

Information Theory · Computer Science 2016-09-12 Ashok Vardhan Makkuva , Yihong Wu

We explore consequences of a hyperbolic metric induced by the composition property of the Harvda-Charvat/Dar\'{o}czy/Cressie-Read/Tsallis entropy. We address the special case of systems described by small deviations of the non-extensive…

Statistical Mechanics · Physics 2014-05-27 Nikos Kalogeropoulos

The paper introduces nonadditivity parameter transformation group induced by Tsallis entropy. We discuss simple physical applications of a system in the contact with finite heat bath or with temperature fluctuations. With help of the…

Mathematical Physics · Physics 2017-11-13 Jan Korbel

Several years ago, it has been discussed that non-logarithmic entropies such as the Tsallis q-entropy cannot be applied to systems with continuous variables. Now, in their recent paper [Phys. Rev. E 97, 012104 (2018)], Oikonomou and Bagci…

Statistical Mechanics · Physics 2018-06-13 Congjie Ou , Sumiyoshi Abe

We introduce a new isomorphism-invariant notion of entropy for measure preserving actions of arbitrary countable groups on probability spaces, which we call orbital Rokhlin entropy. It employs Danilenko's orbital approach to entropy of a…

Dynamical Systems · Mathematics 2019-03-14 Amos Nevo , Felix Pogorzelski

A new method is proposed for analyzing complexity and studying the information in random geometric networks using Tsallis entropy tool. Tsallis entropy of the ensemble of random geometric networks is calculated based on the components of…

Statistical Mechanics · Physics 2025-02-20 O. K. Kazemi , S. M. Taheri

We introduce the algebraic entropy for endomorphisms of arbitrary abelian groups, appropriately modifying existing notions of entropy. The basic properties of the algebraic entropy are given, as well as various examples. The main result of…

Group Theory · Mathematics 2016-05-04 Dikran Dikranjan , Anna Giordano Bruno

Generalizing the group structure of the Euclidean space, we construct a Riemannian metric on the deformed set \ $\mathbb{R}^n_q$ \ induced by the Tsallis entropy composition property. We show that the Tsallis entropy is a "hyperbolic…

Mathematical Physics · Physics 2015-06-03 Nikos Kalogeropoulos

By replacing linear averaging in Shannon entropy with Kolmogorov-Nagumo average (KN-averages) or quasilinear mean and further imposing the additivity constraint, R\'{e}nyi proposed the first formal generalization of Shannon entropy. Using…

Information Theory · Computer Science 2007-07-13 Ambedkar Dukkipati , M. Narasimha Murty , Shalabh Bhatnagar

We propose a new way of defining entropy of a system, which gives a general form which may be nonextensive as Tsallis entropy, but is linearly dependent on component entropies, like Renyi entropy, which is extensive. This entropy has a…

Adaptation and Self-Organizing Systems · Physics 2007-10-11 Fariel Shafee

Based on the form invariance of the structures given by Khinchin's axiomatic foundations of information theory and the pseudoadditivity of the Tsallis entropy indexed by q, the concept of conditional entropy is generalized to the case of…

Quantum Physics · Physics 2009-11-06 Sumiyoshi Abe , A. K. Rajagopal

We address an idea of applying generalized entropies in counting problems. First, we consider some entropic properties that are essential for such purposes. Using the $\alpha$-entropies of Tsallis-Havrda-Charv\'{a}t type, we derive several…

Combinatorics · Mathematics 2017-01-02 Alexey E. Rastegin

We have presented a new axiomatic derivation of Shannon Entropy for a discrete probability distribution on the basis of the postulates of additivity and concavity of the entropy function.We have then modified shannon entropy to take account…

Quantum Physics · Physics 2007-05-23 C. G. Chakrabarti , Indranil Chakrabarty

Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…

Data Analysis, Statistics and Probability · Physics 2026-04-20 Andrea Somazzi , Diego Garlaschelli

Shannon's entropy is one of the building blocks of information theory and an essential aspect of Machine Learning methods (e.g., Random Forests). Yet, it is only finitely defined for distributions with fast decaying tails on a countable…

Statistics Theory · Mathematics 2022-05-25 Jialin Zhang , Jingyi Shi

The aim of this paper is to discuss new results concerning some kinds of parametric extended entropies and divergences. As a result of our studies for mathematical properties on entropy and divergence, we give new bounds for the Tsallis…

Information Theory · Computer Science 2019-07-24 Shigeru Furuichi , Nicuşor Minculete

Starting with the additivity condition for Lyapunov functions of master equation, we derive a one-parametric family of entropy functions which may be appropriate for a description of certain effects of finiteness of statistical systems, in…

Statistical Mechanics · Physics 2009-11-07 Alexander N. Gorban , Iliya V. Karlin

The additivity with respect to exact sequences is notoriously a fundamental property of the algebraic entropy of group endomorphisms. It was proved for abelian groups by deeply exploiting their structure. On the other hand, a solvable…

Group Theory · Mathematics 2020-01-09 Anna Giordano Bruno , Flavio Salizzoni

Tsallis' non-extensive entropy is extended to incorporate the dependence on affinities between the microstates of a system. At the core of our construction of the extended entropy ($\mathcal{H}$) is the concept of the effective number of…

Quantitative Methods · Quantitative Biology 2022-02-08 Keisuke Okamura

Numerical experiments support the interesting conjecture that statistical methods be applicable not only to fully-chaotic systems, but also at the edge of chaos by using Tsallis' generalizations of the standard exponential and entropy. In…

Statistical Mechanics · Physics 2017-08-23 Marcello Lissia , Massimo Coraddu , Roberto Tonelli