English
Related papers

Related papers: Weighted Approach to General Entropy Function

200 papers

The notion of weighted Renyi's entropy for truncated random variables has recently been proposed in the information-theoretic literature. In this paper, we introduce a generalized measure of it for double truncated distribution, namely…

Statistics Theory · Mathematics 2020-04-10 Shivangi Singh , Chanchal Kundu

In this paper, we provide the R\'enyi entropy and complexity measure for a novel, flexible class of skew-gaussian distributions and their related families, as a characteristic form of the skew-gaussian Shannon entropy. We give closed…

Data Analysis, Statistics and Probability · Physics 2016-05-10 Javier E. Contreras-Reyes

We propose a computational method to measure the configurational entropy in generic polydisperse glass-formers. In particular, our method resolves issues related to the diverging mixing entropy term due to a continuous polydispersity. The…

Statistical Mechanics · Physics 2018-11-09 Misaki Ozawa , Giorgio Parisi , Ludovic Berthier

The coupled entropy is proven to correct a flaw in the derivation of the Tsallis entropy and thereby solidify the theoretical foundations for analyzing the uncertainty of complex systems. The Tsallis entropy originated from considering…

Machine Learning · Statistics 2025-11-25 Kenric P. Nelson

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

We consider a probability distribution depending on a real parameter $x$. As functions of $x$, the R\'enyi entropy and the Tsallis entropy can be expressed in terms of the associated index of coincidence $S(x)$. We establish recurrence…

Classical Analysis and ODEs · Mathematics 2019-10-31 Alexandra Maduta , Diana Otrocol , Ioan Rasa

Generalized entropies are studied as Lyapunov functions for the Master equation (Markov chains). Three basic properties of these Lyapunov functions are taken into consideration: universality (independence of the kinetic coefficients),…

Statistical Mechanics · Physics 2007-05-23 Pavel Gorban

We exploit the idea to use the maximal-entropy method, successfully tested in information theory and statistical thermodynamics, to determine approximating function's coefficients and squared errors' weights simultaneously as output of one…

Numerical Analysis · Mathematics 2021-03-04 Domenico Giordano , Felice Iavernaro

This article extends the non-extensive entropy of Tsallis and uses this entropy to model an energy producing system in an absorbing heat bath. This modified non-extensive entropy is superficially identical to the one proposed by Tsallis,…

Statistical Mechanics · Physics 2007-05-23 Mark Fleischer

Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be calculated…

Machine Learning · Statistics 2025-01-23 Takashi Furuya , Hiroyuki Kusumoto , Koichi Taniguchi , Naoya Kanno , Kazuma Suetake

This study investigates entropy's potential for analyzing scientific research patterns across disciplines. Originating from thermodynamics, entropy now measures uncertainty and diversity in information systems. We examine Shannon Entropy,…

Physics and Society · Physics 2025-03-27 Yujie Shi , Alex Jie Yang , Sanhong Deng

Information plays an important role in our understanding of the physical world. We hence propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical world,…

Quantum Physics · Physics 2010-05-04 Anthony J. Short , Stephanie Wehner

In its continuous version, the entropy functional measuring the information content of a given probability density may be plagued by a "measure" problem that results from improper weighting of phase space. This issue is addressed…

Statistical Mechanics · Physics 2011-06-08 P. Maynar , E. Trizac

This is an analysis of the additivity of the entropy of thermodynamical systems with finite heat baths. It is presented an expression for the physical entropy of weakly interacting ergodic systems, and it is shown that it is valid for both…

Statistical Mechanics · Physics 2007-05-23 M. P. Almeida

The aim of the present paper is to present a careful and accessible discussion of the formal aspects of Boltzmann-Gibbs and Tsallis entropies. We begin with a brief overview of Boltzmann-Gibbs entropy, highlighting its main properties and…

Statistical Mechanics · Physics 2025-10-23 Kelvin dos Santos Alves , Rogerio Teixeira Cavalcanti

We compute the entanglement entropy of a wide class of exactly solvable models which may be characterized as describing matter coupled to gauge fields. Our principle result is an entanglement sum rule which states that entropy of the full…

Strongly Correlated Electrons · Physics 2013-09-11 Brian Swingle

The notion of group entropy is proposed. It enables to unify and generalize many different definitions of entropy known in the literature, as those of Boltzmann-Gibbs, Tsallis, Abe and Kaniadakis. Other new entropic functionals are…

Statistical Mechanics · Physics 2015-05-28 Piergiulio Tempesta

In this research paper, it is proved that an approximation to Gibbs-Shannon entropy measure naturally leads to Tsallis entropy for the real parameter q =2 . Several interesting measures based on the input as well as output of a discrete…

Information Theory · Computer Science 2012-01-06 Garimella Rama Murthy

We derive a family of entanglement criteria for continuous variable systems based on the R\'enyi entropy of complementary distributions. We show that these entanglement witnesses can be more sensitive than those based on second-order…

Quantum Physics · Physics 2015-05-18 A. Saboia , F. Toscano , S. P. Walborn

The weighted forms of generalized survival and failure entropies of order ($\alpha,\beta$) are proposed and some properties are obtained. We further propose the dynamic versions of weighted generalized survival and failures entropies and…

Statistics Theory · Mathematics 2020-06-15 Siddhartha Chakraborty , Biswabrata Pradhan
‹ Prev 1 3 4 5 6 7 10 Next ›