English
Related papers

Related papers: Complete monotonicity of some entropies

200 papers

The increased uncertainty and complexity of nonlinear systems have motivated investigators to consider generalized approaches to defining an entropy function. New insights are achieved by defining the average uncertainty in the probability…

Statistics Theory · Mathematics 2025-11-25 Kenric P. Nelson , Sabir Umarov , Mark A. Kon

Recent theoretical developments revived the interest in charged particle multiplicities and their wide-spread parametrization, the negative binomial distribution (NBD). The central observable of the studies is the Shannon entropy of the…

High Energy Physics - Phenomenology · Physics 2026-05-19 Sándor Lökös

Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…

Data Analysis, Statistics and Probability · Physics 2026-04-20 Andrea Somazzi , Diego Garlaschelli

In this work we determine and discuss the entropic uncertainty measures of Shannon type for all the discrete stationary states of the multidimensional harmonic systems directly in terms of the states' hyperquantum numbers, the…

Quantum Physics · Physics 2018-12-19 I. V. Toranzo , J. S. Dehesa

The Sharma-Mittal entropies generalize the celebrated Shannon, R\'enyi and Tsallis entropies. We report a closed-form formula for the Sharma-Mittal entropies and relative entropies for arbitrary exponential family distributions. We…

Information Theory · Computer Science 2021-04-29 Frank Nielsen , Richard Nock

In many applications, the probability density function is subject to experimental errors. In this work the continuos dependence of a class of generalized entropies on the experimental errors is studied. This class includes the C. Shannon,…

Data Analysis, Statistics and Probability · Physics 2016-05-20 György Steinbrecher , Giorgio Sonnino

We calculate explicit formulae for the Shannon entropies of several families of tailored random graph ensembles for which no such formulae were as yet available, in leading orders in the system size. These include bipartite graph ensembles…

Disordered Systems and Neural Networks · Physics 2014-04-24 Ekaterina Roberts , Ton Coolen

We consider the concept of generalized measure-theoretic entropy, where instead of the Shannon entropy function we consider an arbitrary concave function defined on the unit interval, vanishing in the origin. Under mild assumptions on this…

Dynamical Systems · Mathematics 2014-08-21 Fryderyk Falniowski

Complementarity relations between various characterizations of a probability distribution are at the core of information theory. In particular, lower and upper bounds for the entropic function are of great importance. In applied topics, we…

Quantum Physics · Physics 2022-09-07 Alexey E. Rastegin

Existing polarization theories have mostly been concerned with Shannon's information measures, such as Shannon entropy and mutual information, and some related measures such as the Bhattacharyya parameter. In this work, we extend…

Information Theory · Computer Science 2019-07-16 Mengfan Zheng , Ling Liu , Cong Ling

By making use of the familiar Mathieu series and its generalizations, the authors derive a number of new integral representations and present a systematic study of probability density functions and probability distributions associated with…

Classical Analysis and ODEs · Mathematics 2016-10-19 Zivorad Tomovski , Khaled Mehrez

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

Examples of joint probability distributions are studied in terms of Tsallis' nonextensive statistics both for correlated and uncorrelated variables, in particular it is explicitely shown how correlations in the system can make Tsallis…

Statistical Mechanics · Physics 2008-11-26 G. Wilk , Z. Wlodarczyk

In this paper, we provide the R\'enyi entropy and complexity measure for a novel, flexible class of skew-gaussian distributions and their related families, as a characteristic form of the skew-gaussian Shannon entropy. We give closed…

Data Analysis, Statistics and Probability · Physics 2016-05-10 Javier E. Contreras-Reyes

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

We consider a probability distribution depending on a real parameter $x$. As functions of $x$, the R\'enyi entropy and the Tsallis entropy can be expressed in terms of the associated index of coincidence $S(x)$. We establish recurrence…

Classical Analysis and ODEs · Mathematics 2019-10-31 Alexandra Maduta , Diana Otrocol , Ioan Rasa

The Tsallis entropy given for a positive parameter $\alpha$ can be considered as a modification of the classical Shannon entropy. For the latter, corresponding to $\alpha=1$, there exist many axiomatic characterizations. One of them based…

Mathematical Physics · Physics 2017-04-27 Sonja Jäckle , Karsten Keller

There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the…

Information Theory · Computer Science 2017-08-22 John C. Baez , Tobias Fritz , Tom Leinster

This work deals with the scattering entropy of quantum graphs in many different circumstances. We first consider the case of the Shannon entropy and then the R\'enyi and Tsallis entropies, which are more adequate to study distinct…

Quantum Physics · Physics 2024-07-30 Alison A. Silva , Fabiano M. Andrade , D. Bazeia

Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…

Quantum Physics · Physics 2023-05-30 Alexey E. Rastegin