English
Related papers

Related papers: Entropy and its discontents: A note on definitions

200 papers

In a recent Letter [1] a framework for estimating entropy was introduced and applied to one-dimensional and two-dimensional systems. In this Comment we show that the method is not well suited for estimating entropy in bidimensional systems…

Statistical Mechanics · Physics 2022-07-15 E. Brigatti , F. N. M. de Sousa Filho

Many important properties of quantum channels are quantified by means of entropic functionals. Characteristics of such a kind are closely related to different representations of a quantum channel. In the Jamio{\l}kowski-Choi representation,…

Quantum Physics · Physics 2013-07-23 Alexey E. Rastegin

Probably not, because there are lots of manifestly unanthropic ways of producing entropy. We demonstrate that the Causal Entropic Principle (CEP), as a replacement for the anthropic principle to explain the properties of the observed…

High Energy Physics - Theory · Physics 2008-12-05 Irit Maor , Thomas W. Kephart , Lawrence M. Krauss , Y. Jack Ng , Glenn D. Starkman

Complexity measures are introduced, that quantify the change of the natural entropy fluctuations at different length scales in time-series emitted from systems operating far from equilibrium. They identify impending sudden cardiac death…

Data Analysis, Statistics and Probability · Physics 2007-05-23 P. A. Varotsos , N. V. Sarlis , E. S. Skordas , M. S. Lazaridou

The aim of this note is to point out some observations concerning modified power entropy of $\Z$- and $\N$-actions. First, we provide an elementary example showing that this quantity is sensitive to transient dynamics, and therefore does…

Dynamical Systems · Mathematics 2015-06-25 M. Gröger , T. Jäger

Making decisions freely presupposes that there is some indeterminacy in the environment and in the decision making engine. The former is reflected on the behavioral changes due to communicating: few changes indicate rigid environments;…

Artificial Intelligence · Computer Science 2020-09-23 Luis A. Pineda

A lower bound on the R\'enyi differential entropy of a sum of independent random vectors is demonstrated in terms of rearrangements. For the special case of Boltzmann-Shannon entropy, this lower bound is better than that given by the…

Information Theory · Computer Science 2015-05-07 Liyao Wang , Mokshay Madiman

Generalized versions of the entropic (Hirschman-Beckner) and support (Elad-Bruckstein) uncertainty principle are presented for frames representations. Moreover, a sharpened version of the support inequality has been obtained by introducing…

Information Theory · Computer Science 2012-10-30 Benjamin Ricaud , Bruno Torrésani

We survey several notions of entropy related to a compact manifold of negative curvature, some relations between them, and the rigidity problems.

Dynamical Systems · Mathematics 2019-05-09 François Ledrappier , Lin Shu

Recurrence rate, determinism, average line length, and entropy of line lengths are measures of complexity in recurrence quantification analysis, that help to understand the structure, predictability and complexity of dynamical systems. In…

Dynamical Systems · Mathematics 2023-10-19 Miroslava Poláková , Vladimír Špitalský

We develop a unified, information theoretic interpretation of the number-phase complementarity that is applicable both to finite-dimensional (atomic) and infinite-dimensional (oscillator) systems. The relevant uncertainty principle is…

Quantum Physics · Physics 2015-05-19 R. Srikanth , Subhashish Banerjee

We employ quantum relative entropy to establish the relation between the measurement uncertainty and its disturbance on a state in the presence (and absence) of quantum memory. For two incompatible observables, we present the…

Quantum Physics · Physics 2017-04-17 Jun Zhang , Yang Zhang , Chang-shui Yu

We show that using nonextensive entropy can lead to spontaneous symmetry breaking when a parameter changes its value from that applicable for a symmetric domain, as in field theory. We give the physical reasons and also show that even for…

Statistical Mechanics · Physics 2008-10-27 Fariel Shafee

We show that the previously introduced concept of distance on statistical spaces leads to a straightforward definition of differential entropy on these statistical spaces. These spaces are characterized by the fact that their points can…

Statistical Mechanics · Physics 2007-05-23 Jacques Calmet , Xavier Calmet

In this paper we investigate a quantity called conditional entropy of ordinal patterns, akin to the permutation entropy. The conditional entropy of ordinal patterns describes the average diversity of the ordinal patterns succeeding a given…

Chaotic Dynamics · Physics 2015-03-10 Valentina A. Unakafova , Anton M. Unakafov , Karsten Keller

Uncertainty quantification is a key aspect in many tasks such as model selection/regularization, or quantifying prediction uncertainties to perform active learning or OOD detection. Within credal approaches that consider modeling…

Machine Learning · Computer Science 2026-03-26 Tuan-Anh Vu , Sébastien Destercke , Frédéric Pichon

The uncertainty principle sets limit on our ability to predict the values of two incompatible observables measured on a quantum particle simultaneously. This principle can be stated in various forms. In quantum information theory, it is…

Quantum Physics · Physics 2018-09-27 H. Dolatkhah , S. Haseli , S. Salimi , S. A. Khorashad

The aim of this paper is to discuss new results concerning some kinds of parametric extended entropies and divergences. As a result of our studies for mathematical properties on entropy and divergence, we give new bounds for the Tsallis…

Information Theory · Computer Science 2019-07-24 Shigeru Furuichi , Nicuşor Minculete

Entropy dimension is an entropy-type quantity which takes values in $[0,1]$ and classifies different levels of intermediate growth rate of complexity for dynamical systems. In this paper, we consider the complexity of skew products of…

Dynamical Systems · Mathematics 2021-07-01 Dou Dou , Kyewon Koh Park

We report an inconsistency found in probability theory (also referred to as measure-theoretic probability). For probability measures induced by real-valued random variables, we deduce an "equality" such that one side of the "equality" is a…

General Mathematics · Mathematics 2017-03-01 Guang-Liang Li , Victor O. K. Li