English
Related papers

Related papers: An overview of generalized entropic forms

200 papers

In the world of generalized entropies---which, for example, play a role in physical systems with sub- and super-exponential phasespace growth per degree of freedom---there are two ways for implementing constraints in the maximum entropy…

Mathematical Physics · Physics 2019-02-20 Jan Korbel , Rudolf Hanel , Stefan Thurner

In this paper, we present some results on information, complexity and entropy as defined below and we discuss their relations with the Kolmogorov-Sinai entropy which is the most important invariant of a dynamical system. These results have…

Dynamical Systems · Mathematics 2019-08-17 Vieri Benci , Claudio Bonanno , Stefano Galatolo , Giulia Menconi , Federico Ponchio

A general investigation is made into the intrinsic Riemannian geometry for complex systems, from the perspective of statistical mechanics. The entropic formulation of statistical mechanics is the ingredient which enables a connection…

Statistical Mechanics · Physics 2010-08-18 B. N. Tiwari , Vinod Chandra , Subhashish Banerjee

In this paper we compute the leading correction to the bipartite entanglement entropy at large sub-system size, in integrable quantum field theories with diagonal scattering matrices. We find a remarkably universal result, depending only on…

High Energy Physics - Theory · Physics 2011-01-27 J. L. Cardy , O. A. Castro-Alvaredo , B. Doyon

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

The Kolmogorov-Sinai entropy in the sense of Tsallis under Bernoulli shifts was obtained by Meson and Vericat [J. Math. Phys. 37, 4480(1996)]. In this paper, we propose a revised generalized Kolmogorov-Sinai-q entropy under Markov shifts.…

Chaotic Dynamics · Physics 2007-05-23 Qiang Liu , Shou-Li Peng

We describe five types of results concerning information and concentration of discrete random variables, and relationships between them, motivated by their counterparts in the continuous case. The results we consider are information…

Probability · Mathematics 2017-04-25 Oliver Johnson

The notion of entropy appears in many fields and this paper is a survey about entropies in several branches of Mathematics. We are mainly concerned with the topological and the algebraic entropy in the context of continuous endomorphisms of…

General Topology · Mathematics 2013-08-20 Dikran Dikranjan , Anna Giordano Bruno

Entropy estimation is of practical importance in information theory and statistical science. Many existing entropy estimators suffer from fast growing estimation bias with respect to dimensionality, rendering them unsuitable for…

Information Theory · Computer Science 2023-08-22 Ziqiao Ao , Jinglai Li

The paper suggests the concepts of an upper entropy and a lower entropy. We propose a new axiomatic definition, namely, upper entropy axioms, inspired by axioms of metric spaces, and also formulate lower entropy axioms. We also develop weak…

Probability · Mathematics 2015-06-22 Jin-Li Guo , Qi Suo

We propose a new type of entropic descriptor that is able to quantify the statistical complexity (a measure of complex behaviour) by taking simultaneously into account the average departures of a system's entropy S from both its maximum…

Statistical Mechanics · Physics 2015-05-13 R. Piasecki , A. Plastino

We propose a number of concepts and properties related to `weighted' statistical inference where the observed data are classified in accordance with a `value' of a sample string. The motivation comes from the concepts of weighted…

Statistics Theory · Mathematics 2024-07-31 Mark Kelbert , Yuri Suhov

In information theory, one major goal is to find useful functions that summarize the amount of information contained in the interaction of several random variables. Specifically, one can ask how the classical Shannon entropy, mutual…

Information Theory · Computer Science 2025-02-14 Leon Lang , Pierre Baudot , Rick Quax , Patrick Forré

The entropy of a graph is an information-theoretic quantity which expresses the complexity of a graph \cite{DM1,M}. After Shannon introduced the definition of entropy to information and communication, many generalizations of the entropy…

Combinatorics · Mathematics 2014-11-26 Xueliang Li , Zhongmei Qin , Meiqin Wei , Ivan Gutman , Matthias Dehmer

The concept of entropy, firstly introduced in information theory, rapidly became popular in many applied sciences via Shannon's formula to measure the degree of heterogeneity among observations. A rather recent research field aims at…

Methodology · Statistics 2017-03-20 Linda Altieri , Daniela Cocchi , Giulia Roli

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

This thesis consolidates, improves and extends the smooth entropy framework for non-asymptotic information theory and cryptography. We investigate the conditional min- and max-entropy for quantum states, generalizations of classical R\'enyi…

Quantum Physics · Physics 2015-03-20 Marco Tomamichel

We present a quantum version of the generalized $(h,\phi)$-entropies, introduced by Salicr\'u \textit{et al.} for the study of classical probability distributions. We establish their basic properties, and show that already known quantum…

Quantum Physics · Physics 2016-07-27 G. M. Bosyk , S. Zozor , F. Holik , M. Portesi , P. W. Lamberti

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

In this paper we advance the entropy theory of discrete nonautonomous dynamical systems that was initiated by Kolyada and Snoha in 1996. The first part of the paper is devoted to the measure-theoretic entropy theory of general topological…

Dynamical Systems · Mathematics 2015-07-31 Christoph Kawan , Yuri Latushkin