English
Related papers

Related papers: Entropy functions and functional equations

200 papers

We consider the concept of generalized measure-theoretic entropy, where instead of the Shannon entropy function we consider an arbitrary concave function defined on the unit interval, vanishing in the origin. Under mild assumptions on this…

Dynamical Systems · Mathematics 2014-08-21 Fryderyk Falniowski

In this work, we derive information-theoretic properties for a modified Tsallis entropy, hereinafter referred to as q-entropy. We introduce the notions of joint q-entropy, conditional q-entropy, relative q-entropy, conditional mutual…

Mathematical Physics · Physics 2026-03-31 Marco A. S. Trindade

Given a general scalar balance law, i.e., in several space dimensions and with flux and source both space and time dependent, we focus on the functional properties of the entropy production. We apply this operator to entropy solutions, to…

Analysis of PDEs · Mathematics 2025-04-03 Rinaldo Colombo , Vincent Perrollaz

Extensions of Fannes' inequality with partial sums of the Tsallis entropy are obtained for both the classical and quantum cases. The definition of kth partial sum under the prescribed order of terms is given. Basic properties of introduced…

Quantum Physics · Physics 2011-06-03 Alexey E. Rastegin

We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Yaming Yu

This work deals with the scattering entropy of quantum graphs in many different circumstances. We first consider the case of the Shannon entropy and then the R\'enyi and Tsallis entropies, which are more adequate to study distinct…

Quantum Physics · Physics 2024-07-30 Alison A. Silva , Fabiano M. Andrade , D. Bazeia

By replacing linear averaging in Shannon entropy with Kolmogorov-Nagumo average (KN-averages) or quasilinear mean and further imposing the additivity constraint, R\'{e}nyi proposed the first formal generalization of Shannon entropy. Using…

Information Theory · Computer Science 2007-07-13 Ambedkar Dukkipati , M. Narasimha Murty , Shalabh Bhatnagar

Oikonomou [Physica A 386 (2007) 119] has published a calculation which purports to show that the Tsallis and Renyi entropies can be obtained from the generalized multinomial coefficients. In this paper, we prove that the method of…

Statistical Mechanics · Physics 2015-05-14 A. S. Parvan

The routine definitions of both entropy, and differential entropy show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that 1) they no longer show incongruities, 2)…

Information Theory · Computer Science 2014-08-08 Nicola Cufaro Petroni

An entropic approach to formulating uncertainty relations for the number-annihilation pair is considered. We construct some normal operator that traces the annihilation operator as well as commuting quadratures with a complete system of…

Quantum Physics · Physics 2012-01-10 Alexey E. Rastegin

Entropy and relative or cross entropy measures are two very fundamental concepts in information theory and are also widely used for statistical inference across disciplines. The related optimization problems, in particular the maximization…

Statistics Theory · Mathematics 2021-06-18 Abhik Ghosh , Ayanendranath Basu

Shannon entropy in position ($S_{\rvec}$) and momentum ($S_{\pvec}$) spaces, along with their sum ($S_t$) are presented for unit-normalized densities of He, Li$^+$ and Be$^{2+}$ ions, spatially confined at the center of an impenetrable…

Quantum Physics · Physics 2021-03-01 Sangita Majumdar , Amlan K. Roy

We conclude a sequence of work by giving near-optimal sketching and streaming algorithms for estimating Shannon entropy in the most general streaming model, with arbitrary insertions and deletions. This improves on prior results that obtain…

Data Structures and Algorithms · Computer Science 2008-12-18 Nicholas J. A. Harvey , Jelani Nelson , Krzysztof Onak

The uniequness theorem for the Tsallis entropy by introducing the generalized Faddeev's axiom is proven. Our result improves the recent result, the uniqueness theorem for Tsallis entropy by the generalized Shannon-Khinchin's axiom in…

Statistical Mechanics · Physics 2010-12-30 Shigeru Furuichi

We first observe that the (co)domains of the q-deformed functions are some subsets of the (co)domains of their ordinary counterparts, thereby deeming the deformed functions to be incomplete. In order to obtain a complete definition of…

Statistical Mechanics · Physics 2015-05-13 Thomas Oikonomou , G. Baris Bagci

We consider two types of entropy, namely, Shannon and R\'{e}nyi entropies of the Poisson distribution, and establish their properties as the functions of intensity parameter. More precisely, we prove that both entropies increase with…

Information Theory · Computer Science 2024-03-15 Volodymyr Braiman , Anatoliy Malyarenko , Yuliya Mishura , Yevheniia Anastasiia Rudyk

In this article, we employ a standard convex argument to obtain new and refined inequalities related to the matrix mean of two accretive matrices, the numerical radius and the Tsallis relative operator entropy.

Functional Analysis · Mathematics 2021-04-28 Hamid Reza Moradi , Shigeru Furuichi , Mohammad Sababheh

A new method is proposed for analyzing complexity and studying the information in random geometric networks using Tsallis entropy tool. Tsallis entropy of the ensemble of random geometric networks is calculated based on the components of…

Statistical Mechanics · Physics 2025-02-20 O. K. Kazemi , S. M. Taheri

In the nonextensive Tsallis scenario, Page's conjecture for the average entropy of a subsystem[Phys. Rev. Lett. {\bf 71}, 1291(1993)] as well as its demonstration are generalized, i.e., when a pure quantum system, whose Hilbert space…

Statistical Mechanics · Physics 2009-11-07 L. C. Malacarne , R. S. Mendes , E. K. Lenzi

We study the evolution of Tsallis entropy along the heat flow and establish its concavity in arbitrary dimensions. Extending prior results that were restricted to the one-dimensional setting, we prove that the Tsallis entropy is concave in…

Information Theory · Computer Science 2026-04-24 Lukang Sun