English
Related papers

Related papers: Generalized statistical complexity and Fisher-Reny…

200 papers

We discuss a basic thermodynamic properties of systems with multifractal structure. This is possible by extending the notion of Gibbs-Shannon's entropy into more general framework - Renyi's information entropy. We show a connection of…

Statistical Mechanics · Physics 2009-11-07 Petr Jizba , Toshihico Arimitsu

In many applications, the probability density function is subject to experimental errors. In this work the continuos dependence of a class of generalized entropies on the experimental errors is studied. This class includes the C. Shannon,…

Data Analysis, Statistics and Probability · Physics 2016-05-20 György Steinbrecher , Giorgio Sonnino

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

This paper studies the complexity of estimating Renyi divergences of discrete distributions: $p$ observed from samples and the baseline distribution $q$ known \emph{a priori}. Extending the results of Acharya et al. (SODA'15) on estimating…

Information Theory · Computer Science 2017-02-09 Maciej Skorski

The Shannon entropy, the desequilibrium and their generalizations (R\'enyi and Tsallis entropies) of the three-dimensional single-particle systems in a spherically-symmetric potential $V(r)$ can be decomposed into angular and radial parts.…

Quantum Physics · Physics 2017-01-17 J. S. Dehesa , I. V. Toranzo , D. Puertas-Centeno

Entropy is being used in physics, mathematics, informatics and in related areas to describe equilibration, dissipation, maximal probability states and optimal compression of information. The Gini index on the other hand is an established…

Physics and Society · Physics 2023-07-19 Tamás S. Biró , Zoltán Néda

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

A general investigation is made into the intrinsic Riemannian geometry for complex systems, from the perspective of statistical mechanics. The entropic formulation of statistical mechanics is the ingredient which enables a connection…

Statistical Mechanics · Physics 2010-08-18 B. N. Tiwari , Vinod Chandra , Subhashish Banerjee

We discuss basic statistical properties of systems with multifractal structure. This is possible by extending the notion of the usual Gibbs--Shannon entropy into more general framework - Renyi's information entropy. We address the…

Statistical Mechanics · Physics 2007-05-23 Petr Jizba , Toshihico Arimitsu

The entropy of probability distribution defined by Shannon has several extensions. R\'enyi entropy is one of the general extensions of Shannon entropy and is widely used in engineering, physics, and so on. On the other hand, the quantum…

Mathematical Physics · Physics 2019-09-04 Farrukh Mukhamedov , Kyouhei Ohmura , Noboru Watanabe

It is shown that R\'enyi statistics provides a plausible basis to describe the hadron distributions measured in high energy particle interactions. Generalized Boltzmann and gamma distributions obtained by maximization of R\'enyi entropy…

High Energy Physics - Phenomenology · Physics 2007-05-23 A. Kropivnitskaya , A. Rostovtsev

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

A measure called Physical Complexity is established and calculated for a population of sequences, based on statistical physics, automata theory, and information theory. It is a measure of the quantity of information in an organism's genome.…

Biological Physics · Physics 2011-12-02 Gerard Briscoe , Philippe De Wilde

The generalization of the Zubarev nonequilibrium statistical operator method for the case of Renyi statistics is proposed when the relevant statistical operator (or distribution function) is obtained based on the principle of maximum for…

Statistical Mechanics · Physics 2011-01-11 B. Markiv , R. Tokarchuk , P. Kostrobij , M. Tokarchuk

Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…

Disordered Systems and Neural Networks · Physics 2025-08-27 Nina Javerzat , Eric Bertin , Misaki Ozawa

Numerous entropy-type characteristics (functionals) generalizing R\'enyi entropy are widely used in mathematical statistics, physics, information theory, and signal processing for characterizing uncertainty in probability distributions and…

Statistics Theory · Mathematics 2011-03-28 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

A consistent generalization of statistical mechanics is obtained by applying the maximum entropy principle to a trace-form entropy and by requiring that physically motivated mathematical properties are preserved. The emerging…

Statistical Mechanics · Physics 2009-11-10 G. Kaniadakis , M. Lissia , A. M. Scarfone

When at equilibrium, large-scale systems obey conventional thermodynamics because they belong to microscopic configurations (or states) that are typical. Crucially, the typical states usually represent only a small fraction of the total…

Statistical Mechanics · Physics 2025-01-14 Bernat Corominas-Murtra , Rudolf Hanel , Petr Jizba

R\'enyi complexity ratio of two density functions is introduced for three and multidimensional quantum systems. Localization property of several density functions are defined and five theorems about near continuous property of R\'enyi…

Mathematical Physics · Physics 2021-06-29 Debraj Nath

Entropy is a fundamental concept in equilibrium statistical mechanics, yet its origin in the non-equilibrium dynamics of isolated quantum systems is not fully understood. A strong consensus is emerging around the idea that the stationary…

Statistical Mechanics · Physics 2017-09-20 Vincenzo Alba , Pasquale Calabrese