English
Related papers

Related papers: A note on bounded entropies

200 papers

In many applications, the probability density function is subject to experimental errors. In this work the continuos dependence of a class of generalized entropies on the experimental errors is studied. This class includes the C. Shannon,…

Data Analysis, Statistics and Probability · Physics 2016-05-20 György Steinbrecher , Giorgio Sonnino

We show that Abe's general pseudoadditivity for entropy prescribed by thermal equilibrium in nonextensive systems holds not only for entropy, but also for energy. The application of this general pseudoadditivity to Tsallis entropy tells us…

Statistical Mechanics · Physics 2009-11-07 Qiuping A. Wang , Laurent Nivanen , Alain Le Mehaute , Michel Pezeril

The entropy region is a fundamental object in information theory. An outer bound for the entropy region is defined by a minimal set of Shannon-type inequalities called elemental inequalities also referred to as the Shannon region. This…

Information Theory · Computer Science 2020-05-22 Hitika Tiwari , Satyajit Thakor

Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…

Quantum Physics · Physics 2023-05-30 Alexey E. Rastegin

There exists only one generalization of the classical Boltzmann-Gibbs-Shannon entropy functional to a one-parametric family of additive entropy functionals. We find analytical solution to the corresponding extension of the classical…

Statistical Mechanics · Physics 2009-11-07 Alexander N. Gorban , Iliya V. Karlin , Hans Christian Ottinger

The notion of entropy appears in many fields and this paper is a survey about entropies in several branches of Mathematics. We are mainly concerned with the topological and the algebraic entropy in the context of continuous endomorphisms of…

General Topology · Mathematics 2013-08-20 Dikran Dikranjan , Anna Giordano Bruno

We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…

Information Theory · Computer Science 2021-09-22 Gilad Gour , Marco Tomamichel

The notion of entropy is ubiquitous both in natural and social sciences. In the last two decades, a considerable effort has been devoted to the study of new entropic forms, which generalize the standard Boltzmann-Gibbs (BG) entropy and are…

Mathematical Physics · Physics 2015-10-15 Piergiulio Tempesta

Lower bounds for the R\'enyi entropies of sums of independent random variables taking values in cyclic groups of prime order under permutations are established. The main ingredients of our approach are extended rearrangement inequalities in…

Combinatorics · Mathematics 2021-10-20 Mokshay Madiman , Liyao Wang , Jae Oh Woo

The concept of entropy, firstly introduced in information theory, rapidly became popular in many applied sciences via Shannon's formula to measure the degree of heterogeneity among observations. A rather recent research field aims at…

Methodology · Statistics 2017-03-20 Linda Altieri , Daniela Cocchi , Giulia Roli

In the present paper we prove a family of tight upper and lower bounds for the Shannon entropy and von Neumann entropy based on the p-norms. This allows us to have an entropy estimate, a criterion for the finiteness of it and a bound on the…

Information Theory · Computer Science 2024-08-22 Juan Pablo Lopez

A family of nonlinear ordinary differential equations with arbitrary order is obtained by using nonextensive concepts related to the Tsallis entropy. Applications of these equations are given here. In particular, a connection between…

Statistical Mechanics · Physics 2007-05-23 R. S. Mendes , I. T. Pedron

We demonstrate that linear combinations of subregion entropies with canceling boundary terms, commonly used to calculate the topological entanglement entropy, may suffer from spurious nontopological contributions even in models with zero…

Quantum Physics · Physics 2020-04-16 Dominic J. Williamson , Arpit Dua , Meng Cheng

Phase-space versions of quantum mechanics -- from Wigner's original distribution to modern discrete-qudit constructions -- represent some states with negative quasi-probabilities. Conventional Shannon and R\'enyi entropies become…

Quantum Physics · Physics 2025-12-23 Adam Brandenburger , Pierfrancesco La Mura

The Renyi entropy coprises a group of data estimates that sums up the well-known Shannon entropy, acquiring a considerable lot of its properties. It appears as unqualified and restrictive entropy, relative entropy, or common data, and has…

General Relativity and Quantum Cosmology · Physics 2023-02-01 H. R. Fazlollahi

This work deals with the scattering entropy of quantum graphs in many different circumstances. We first consider the case of the Shannon entropy and then the R\'enyi and Tsallis entropies, which are more adequate to study distinct…

Quantum Physics · Physics 2024-07-30 Alison A. Silva , Fabiano M. Andrade , D. Bazeia

Shannon and Renyi entropies are quantitative measures of uncertainty in a data set. They are developed by Renyi in the context of entropy theory. These measures have been studied in the case of the multivariate t-distributions. We extend…

Statistics Theory · Mathematics 2019-01-31 Salah H. Abid , Uday J. Quaez

An axiomatic foundation regarding the entropy for complex systems is established. Missing from decades of research was the requirement that entropy must measure the uncertainty at the informational scale of the maximizing distribution,…

Statistical Mechanics · Physics 2026-05-29 Kenric P. Nelson

The paper extends the analysis of the entropies of the Poisson distribution with parameter $\lambda$. It demonstrates that the Tsallis and Sharma-Mittal entropies exhibit monotonic behavior with respect to $\lambda$, whereas two generalized…

Probability · Mathematics 2024-11-27 Dmitri Finkelshtein , Anatoliy Malyarenko , Yuliya Mishura , Kostiantyn Ralchenko

We establish a relation between the boundary and the topological entropies for the conformal minimal models in some of the simplest models of the unitary A-A series. We show that in these models the boundary entropy is a difference of…

High Energy Physics - Theory · Physics 2021-09-22 Hugo García-Compeán , Norma Quiroz