English
Related papers

Related papers: On Tsallis extropy with an application to pattern …

200 papers

Normality, in the colloquial sense, has historically been considered an aspirational trait, synonymous with ideality. The arithmetic average and, by extension, statistics including linear regression coefficients, have often been used to…

Methodology · Statistics 2023-12-27 Matthew J. Vowels

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

We present a new class of estimators of Shannon entropy for severely undersampled discrete distributions. It is based on a generalization of an estimator proposed by T. Schuermann, which itself is a generalization of an estimator proposed…

Information Theory · Computer Science 2021-11-30 Peter Grassberger

As additivity is a characteristic property of the classical information measure, Shannon entropy, pseudo-additivity is a characteristic property of Tsallis entropy. Renyi generalized Shannon entropy by means of Kolmogorov-Nagumo averages,…

Mathematical Physics · Physics 2007-05-23 Ambedkar Dukkipati , M. Narsimha Murty , Shalabh Bhatnagar

We propose an entropy-based information measure, namely the Discounted Least Information Theory of Entropy (DLITE), which not only exhibits important characteristics expected as an information measure but also satisfies conditions of a…

Information Theory · Computer Science 2020-02-20 Weimao Ke

In order to study as a whole a wide part of entropy measures, we introduce a two-parameter non-extensive entropic form with respect to the $h$-derivative, which generalizes the conventional Newton--Leibniz calculus. This new entropy,…

Statistical Mechanics · Physics 2023-06-14 Jin-Wen Kang , Ke-Ming Shen , Ben-Wei Zhang

In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

Pinsker's and Fannes' type bounds on the Tsallis relative entropy are derived. The monotonicity property of the quantum $f$-divergence is used for its estimating from below. For order $\alpha\in(0,1)$, a family of lower bounds of Pinsker…

Mathematical Physics · Physics 2013-08-26 Alexey E. Rastegin

Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…

Information Theory · Computer Science 2017-01-04 Günther Koliander , Georg Pichler , Erwin Riegler , Franz Hlawatsch

Fundamental properties for the Tsallis relative entropy in both classical and quantum systems are studied. As one of our main results, we give the parametric extension of the trace inequality between the quantum relative entropy and the…

Statistical Mechanics · Physics 2016-08-31 S. Furuichi , K. Yanagi , K. Kuriyama

It is shown that the distribution derived from the principle of maximum Tsallis entropy is a superposable Levy-type distribution. Concomitantly, the leading order correction to the limit distribution is also deduced. This demonstration…

Statistical Mechanics · Physics 2007-05-23 Sumiyoshi Abe , A. K. Rajagopal

The pathway model of Mathai (2005) mainly deals with the rectangular matrix-variate case. In this paper the scalar version is shown to be associated with a large number of probability models used in physics. Different families of densities…

Statistical Mechanics · Physics 2009-11-11 A. M. Mathai , H. J. Haubold

The property of Tsallis entropy is examined when considering tow systems with different temperatures to be in contact with each other and to reach the thermal equilibrium. It is verified that the total Tsallis entropy of the two systems…

Statistical Mechanics · Physics 2015-08-10 Jiulin Du

We give a new proof of the theorems on the maximum entropy principle in Tsallis statistics. That is, we show that the $q$-canonical distribution attains the maximum value of the Tsallis entropy, subject to the constraint on the…

Statistical Mechanics · Physics 2015-05-14 Shigeru Furuichi

Based on the Tsallis entropy, the nonextensive thermodynamic properties are studied as a q-deformation of classical statistical results using only probabilistic methods and straightforward calculations. It is shown that the constant in the…

Statistical Mechanics · Physics 2007-05-23 Franck Jedrzejewski

Quite general, analytical (both exact and approximate) forms for discrete probability distributions (PD's) that maximize Tsallis entropy for a fixed variance are here investigated. They apply, for instance, in a wide variety of scenarios in…

Statistical Mechanics · Physics 2009-11-11 C. Vignat , A. Plastino

The structure entropy is one of the most important parameters to describe the structure property of the complex networks. Most of the existing struc- ture entropies are based on the degree or the betweenness centrality. In order to describe…

Social and Information Networks · Computer Science 2014-11-25 Qi Zhang , Xi Lu , Meizhu Li , Yong Deng , Sankaran Mahadevan

Escort distributions have been shown to be very useful in a great variety of fields ranging from information theory, nonextensive statistical mechanics till coding theory, chaos and multifractals. In this work we give the notion and the…

Mathematical Physics · Physics 2018-12-26 D. Puertas-Centeno

In this paper, we investigate the partition inequality, joint convexity, and Pinsker's inequality, for a divergence that generalizes the Tsallis Relative Entropy and Kullback-Leibler divergence. The generalized divergence is defined in…

Information Theory · Computer Science 2020-04-27 Rui F. Vigelis , Luiza H. F. de Andrade , Charles C. Cavalcante

We study the evolution of Tsallis entropy along the heat flow and establish its concavity in arbitrary dimensions. Extending prior results that were restricted to the one-dimensional setting, we prove that the Tsallis entropy is concave in…

Information Theory · Computer Science 2026-04-24 Lukang Sun