English
Related papers

Related papers: Cumulative Tsallis Entropy for Maximum Ranked Set …

200 papers

We have discussed the Tsallis entropy in finite $N$-unit nonextensive systems, by using the multivariate $q$-Gaussian probability distribution functions (PDFs) derived by the maximum entropy methods with the normal average and the…

Statistical Mechanics · Physics 2015-05-14 Hideo Hasegawa

Ranked set sampling is a sampling design which has a wide range of applications in industrial statistics, and environmental and ecological studies, etc.. It is well known that ranked set samples provide more Fisher information than simple…

Statistics Theory · Mathematics 2013-01-21 Mohammad Jafari Jozani , Jafar Ahmadi

By using the maximum entropy principle with Tsallis entropy we obtain a fragment size distribution function which undergoes a transition to scaling. This distribution function reduces to those obtained by other authors using Shannon…

Soft Condensed Matter · Physics 2015-06-24 Oscar Sotolongo-Costa , Arezky H. Rodriguez , G. J. Rodgers

Tsallis entropy is a useful one-parameter generalization of the standard von Neumann entropy in information theory. We study the variance of Tsallis entropy of bipartite quantum systems in a random pure state. The main result is an exact…

Mathematical Physics · Physics 2022-02-16 Lu Wei

Tsallis has suggested a nonextensive generalization of the Boltzmann-Gibbs entropy, the maximization of which gives a generalized canonical distribution under special constraints. In this brief report we show that the generalized canonical…

Statistical Mechanics · Physics 2021-04-28 Brian R. La Cour , William C. Schieve

The Shannon entropy is a widely used summary statistic, for example, network traffic measurement, anomaly detection, neural computations, spike trains, etc. This study focuses on estimating Shannon entropy of data streams. It is known that…

Data Structures and Algorithms · Computer Science 2009-10-09 Ping Li

Recently, a new measure of information called extropy has been introduced by Lad, Sanfilippo and Agr\`o as the dual version of Shannon entropy. In the literature, Tsallis introduced a measure for a discrete random variable, named Tsallis…

Probability · Mathematics 2021-09-30 Narayanaswamy Balakrishnan , Francesco Buono , Maria Longobardi

Entropy and relative or cross entropy measures are two very fundamental concepts in information theory and are also widely used for statistical inference across disciplines. The related optimization problems, in particular the maximization…

Statistics Theory · Mathematics 2021-06-18 Abhik Ghosh , Ayanendranath Basu

The Tsallis entropy is shown to be an additive entropy of degree-q that information scientists have been using for almost forty years. Neither is it a unique solution to the nonadditive functional equation from which random entropies are…

Classical Physics · Physics 2016-11-15 B. H. Lavenda , J. Dunning-Davies

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

In this paper we introduce an easy to compute upper bound on the Tsallis entropy of a density matrix describing a system coupled to a noise source. This suggests that the Tsallis entropy is most natural in the context of quantum information…

Quantum Physics · Physics 2017-02-28 Boaz Tamir

Traditionally, the Method of (Shannon-Kullback's) Relative Entropy Maximization (REM) is considered with linear moment constraints. In this work, the method is studied under frequency moment constraints which are non-linear in…

Data Analysis, Statistics and Probability · Physics 2012-08-27 M. Grendar, , M. Grendar

We propose a new way of defining entropy of a system, which gives a general form which may be nonextensive as Tsallis entropy, but is linearly dependent on component entropies, like Renyi entropy, which is extensive. This entropy has a…

Adaptation and Self-Organizing Systems · Physics 2007-10-11 Fariel Shafee

In industrial, environmental, and ecological investigations, ranked set sampling is a sample method that enables the experimenter to use the whole range of population values. The ranked set sampling process can be modified in two extremely…

Statistics Theory · Mathematics 2023-05-03 Santosh Kumar Chaudhary , Nitin Gupta

Though Shannon entropy of a probability measure $P$, defined as $- \int_{X} \frac{\ud P}{\ud \mu} \ln \frac{\ud P}{\ud\mu} \ud \mu$ on a measure space $(X, \mathfrak{M},\mu)$, does not qualify itself as an information measure (it is not a…

Information Theory · Computer Science 2007-07-13 Ambedkar Dukkipati , M Narasimha Murty , Shalabh Bhatnagar

An axiomatic foundation regarding the entropy for complex systems is established. Missing from decades of research was the requirement that entropy must measure the uncertainty at the informational scale of the maximizing distribution,…

Statistical Mechanics · Physics 2026-05-29 Kenric P. Nelson

We study the properties of Tsallis entropy and Shannon entropy from the point of view of algorithmic randomness. In algorithmic information theory, there are two equivalent ways to define the program-size complexity K(s) of a given finite…

Information Theory · Computer Science 2019-09-04 Kohtaro Tadaki

Some preliminary evidence suggests the conjecture that the collective behaviour of systems having long-range interactions may be described more effectively by the Tsallis rather than by the Boltzmann/Gibbs/Shannon entropy. To this end, we…

Statistical Mechanics · Physics 2017-05-19 Nikos Kalogeropoulos

Ranked set sampling (RSS) is a stratified sampling method that improves efficiency over simple random sampling (SRS) by utilizing auxiliary information for ranking and stratification. While balanced RSS (BRSS) assumes equal allocation…

Methodology · Statistics 2025-09-03 Chul Moon , Soohyun Ahn

A chain rule and a subadditivity for the entropy of type $\beta$, which is one of the nonadditive entropies, were derived by Z.Dar\'oczy. In this paper, we study the further relations among Tsallis type entropies which are typical…

Statistical Mechanics · Physics 2015-06-24 Shigeru Furuichi