English
Related papers

Related papers: A Note on Mathai's Entropy Measure

200 papers

We present the characterization of the Nath, R\'enyi and Havrda-Charv\'at-Tsallis entropies under the assumption that they are analytic function with respect to the distribution dimension, unlike the the previous characterizations, which…

Information Theory · Computer Science 2013-11-05 Velimir M. Ilic , Miomir S. Stankovic

Entropy estimation is of practical importance in information theory and statistical science. Many existing entropy estimators suffer from fast growing estimation bias with respect to dimensionality, rendering them unsuitable for…

Information Theory · Computer Science 2023-08-22 Ziqiao Ao , Jinglai Li

Following the work on Shannon entropy together with the principle of maximum entropy, Luo & Singh (J. Hydrol. Eng., 2011, 16(4): 303-315) and Singh & Luo (J. Hydrol. Eng., 2011, 16(9): 725-735) explored the concept of non-extensive Tsallis…

Fluid Dynamics · Physics 2020-08-26 Manotosh Kumbhakar , Rajendra K. Ray , Koeli Ghoshal , Vijay P. Singh

A transition matrix can be constructed through the partial contraction of two given quantum states. We analyze and compare four different definitions of entropy for transition matrices, including (modified) pseudo entropy, SVD entropy, and…

High Energy Physics - Theory · Physics 2025-08-21 Zhaohui Chen , Rene Meyer , Zhuo-Yu Xian

We combine an axiomatics of R\'{e}nyi with the $q$--deformed version of Khinchin axioms to obtain a measure of information (i.e., entropy) which accounts both for systems with embedded self-similarity and non-extensivity. We show that the…

Mathematical Physics · Physics 2015-11-11 Petr Jizba , Jan Korbel

The concept of Entropy plays a key role in Information Theory, Statistics, and Machine Learning.This paper introduces a new entropy measure, called the t-entropy, which exploits the concavity of the inverse-tan function. We analytically…

Information Theory · Computer Science 2021-05-06 Saptarshi Chakraborty , Debolina Paul , Swagatam Das

Systems driven away from thermal equilibrium constantly deliver entropy to their environment. Determining this entropy production requires detailed information about the system's internal states and dynamics. However, in most practical…

Statistical Mechanics · Physics 2017-10-03 Gili Bisker , Matteo Polettini , Todd R. Gingrich , Jordan M. Horowitz

Many complex systems are characterized by non-Boltzmann distribution functions of their statistical variables. If one wants to -- justified or not -- hold on to the maximum entropy principle for complex statistical systems (non-Boltzmann)…

Statistical Mechanics · Physics 2009-11-13 Stefan Thurner , Rudolf Hanel

Tsallis entropy is a useful one-parameter generalization of the standard von Neumann entropy in information theory. We study the variance of Tsallis entropy of bipartite quantum systems in a random pure state. The main result is an exact…

Mathematical Physics · Physics 2022-02-16 Lu Wei

Internal energy, enthalpy and entropy are the key quantities to study thermodynamic properties of the moist atmosphere, because they correspond to the First (internal energy and enthalpy) and Second (entropy) Laws of thermodynamics. The aim…

Atmospheric and Oceanic Physics · Physics 2015-10-13 Pascal Marquet , Jean-François Geleyn

A chain rule and a subadditivity for the entropy of type $\beta$, which is one of the nonadditive entropies, were derived by Z.Dar\'oczy. In this paper, we study the further relations among Tsallis type entropies which are typical…

Statistical Mechanics · Physics 2015-06-24 Shigeru Furuichi

Thermodynamic entropy is determined by a heat measurement through the Clausius equality. The entropy then formalizes a fundamental limitation of operations by the second law of thermodynamics. The entropy is also expressed as the Shannon…

Statistical Mechanics · Physics 2015-06-17 Shin-ichi Sasa

We describe in detail two numerical simulation methods valid to study systems whose thermostatistics is described by generalized entropies, such as Tsallis. The methods are useful for applications to non-trivial interacting systems with a…

Statistical Mechanics · Physics 2009-10-31 R. Salazar , R. Toral

It is possible to derive the maximum entropy principle from thermodynamic stability requirements. Using as a starting point the equilibrium probability distribution, currently used in non-extensive thermostatistics, it turns out that the…

Statistical Mechanics · Physics 2007-05-23 Jan Naudts

During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides…

Statistical Mechanics · Physics 2020-04-22 Mengjie Zu , Arunkumar Bupathy , Daan Frenkel , Srikanth Sastry

We presented background information about various entropies in the literature. The pathway idea of Mathai (2005) is shown to be inferable from the maximization of a certain generalized entropy measure and established connections to…

Mathematical Physics · Physics 2016-11-25 Nicy Sebastian

Information plays an important role in our understanding of the physical world. We hence propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical world,…

Quantum Physics · Physics 2010-05-04 Anthony J. Short , Stephanie Wehner

Entropy is one of the key thermodynamic variables reflecting changes in the state of matter. Unlike other thermodynamic variables, it is well-defined also for nonequilibrium steady states through its relation to information. Applying this…

Statistical Mechanics · Physics 2026-04-15 Haim Diamant , Gil Ariel

Entropy in thermodynamics is an extensive quantity, whereas standard methods in statistical mechanics give rise to a non-extensive expression for the entropy. This discrepancy is often seen as a sign that basic formulas of statistical…

History and Philosophy of Physics · Physics 2012-09-06 Dennis Dieks

Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy…

Chaotic Dynamics · Physics 2016-08-16 Jose M. Amigo , Matthew B. Kennel , Ljupco Kocarev