English
Related papers

Related papers: A complete characterisation of conditional entropi…

200 papers

Information theory on a time-discrete setting in the framework of time series analysis is generalized to the time-continuous case. Considerations of the Roessler and Lorenz dynamics as well as the Ornstein-Uhlenbeck process yield for…

Chaotic Dynamics · Physics 2008-06-04 Detlef Holstein

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

Statistical Mechanics · Physics 2011-10-25 B. H. Lavenda

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

Entropy metrics (for example, permutation entropy) are nonlinear measures of irregularity in time series (one-dimensional data). Some of these entropy metrics can be generalised to data on periodic structures such as a grid or lattice…

Combinatorics · Mathematics 2021-10-22 John Stewart Fabila-Carrasco , Chao Tan , Javier Escudero

From a new rigorous formulation of the general axiomatic foundations of thermodynamics we derive an operational definition of entropy that responds to the emergent need in many technological frameworks to understand and deploy thermodynamic…

Mathematical Physics · Physics 2014-11-21 Gian Paolo Beretta , Enzo Zanchini

The R\'enyi entanglement entropy (REE) is an entanglement quantifier considered as a natural generalisation of the entanglement entropy. When it comes to stochastic local operations and classical communication (SLOCC), however, only a…

Quantum Physics · Physics 2020-09-03 Hyukjoon Kwon , A. J. Paige , M. S. Kim

Entropic uncertainty relations play an important role in both fundamentals and applications of quantum theory. Although they have been well-investigated in quantum theory, little is known about entropic uncertainty in generalized…

Quantum Physics · Physics 2021-08-11 Ryo Takakura , Takayuki Miyadera

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

Statistics Theory · Mathematics 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

We give a characterization of Maximum Entropy/Minimum Relative Entropy inference by providing two `strong entropy concentration' theorems. These theorems unify and generalize Jaynes' `concentration phenomenon' and Van Campenhout and Cover's…

Information Theory · Computer Science 2008-09-17 Peter Grunwald

The requirement that an entropy function be composable is key: it means that the entropy of a compound system can be calculated in terms of the entropy of its independent components. We prove that, under mild regularity assumptions, the…

Mathematical Physics · Physics 2018-01-17 Alberto Enciso , Piergiulio Tempesta

In this paper, we present some results on information, complexity and entropy as defined below and we discuss their relations with the Kolmogorov-Sinai entropy which is the most important invariant of a dynamical system. These results have…

Dynamical Systems · Mathematics 2019-08-17 Vieri Benci , Claudio Bonanno , Stefano Galatolo , Giulia Menconi , Federico Ponchio

We offer new methods for characterizing general closed and convex quantum resource theories, including dynamic ones, based on entropic concepts and operational tasks. We propose a resource-theoretic generalization of the quantum conditional…

Quantum Physics · Physics 2026-05-28 Kaiyuan Ji , Eric Chitambar

In nonlinear dynamics, basins of attraction link a given set of initial conditions to its corresponding final states. This notion appears in a broad range of applications where several outcomes are possible, which is a common situation in…

We explore the measurement problem in the entropic dynamics approach to quantum theory. The dual modes of quantum evolution---either continuous unitary evolution or abrupt wave function collapse during measurement---are unified by virtue of…

Quantum Physics · Physics 2015-05-30 David T. Johnson , Ariel Caticha

Entropy production is often interpreted as a proxy for microscopic disorder or environmental roughness in stochastic systems. We test this interpretation using controlled simulations of overdamped stochastic dynamics on curved surfaces in…

Statistical Mechanics · Physics 2026-02-23 Patrick Romanescu

Product probability property, known in the literature as statistical independence, is examined first. Then generalized entropies are introduced, all of which give generalizations to Shannon entropy. It is shown that the nature of the…

Statistics Theory · Mathematics 2009-11-13 A. M. Mathai , H. J. Haubold

It is well known that a Shannon based definition of information entropy leads in the classical case to the Boltzmann entropy. It is tempting to regard the Von Neumann entropy as the corresponding quantum mechanical definition. But the…

Quantum Physics · Physics 2009-11-10 Alexander Stotland , Andrei A. Pomeransky , Eitan Bachmat , Doron Cohen

R\'enyi entropy is an important measure in the context of information theory as a generalization of Shannon entropy. This information measure was often used for uncertainty quantification of dynamical behaviour of stochastic processes. In…

Statistics Theory · Mathematics 2025-10-28 Salah H. Abid , Uday J. Quaez , Javier E. Contreras-Reyescor

There are three ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a…

Statistical Mechanics · Physics 2018-11-05 Stefan Thurner , Bernat Corominas-Murtra , Rudolf Hanel

Heisenberg's uncertainty principle forms a fundamental element of quantum mechanics. Uncertainty relations in terms of entropies were initially proposed to deal with conceptual shortcomings in the original formulation of the uncertainty…

Quantum Physics · Physics 2017-02-09 Patrick J. Coles , Mario Berta , Marco Tomamichel , Stephanie Wehner