English
Related papers

Related papers: Algebraic Representations of Entropy and Fixed-Par…

200 papers

We propose new measures of shared information, unique information and synergistic information that can be used to decompose the multi-information of a pair of random variables $(Y,Z)$ with a third random variable $X$. Our measures are…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost , Nihat Ay

We define a notion of entropy for an infinite family $\mathcal{C}$ of measurable sets in a probability space. We show that the mean ergodic theorem holds uniformly for $\mathcal{C}$ under every ergodic transformation if and only if…

Dynamical Systems · Mathematics 2014-03-12 Terrence M. Adams , Andrew B. Nobel

Information theory provides principled ways to analyze different inference and learning problems such as hypothesis testing, clustering, dimensionality reduction, classification, among others. However, the use of information theoretic…

Machine Learning · Computer Science 2014-09-03 Luis G. Sanchez Giraldo , Murali Rao , Jose C. Principe

We study a class of dynamical systems generated by random substitutions, which contains both intrinsically ergodic systems and instances with several measures of maximal entropy. In this class, we show that the measures of maximal entropy…

Dynamical Systems · Mathematics 2026-03-26 Philipp Gohlke , Andrew Mitchell

We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate…

Mathematical Physics · Physics 2018-03-02 Alberto Barchielli , Matteo Gregoratti , Alessandro Toigo

Background: Even though data visualizations (and underlying data) almost always contain uncertainty, it remains complex to communicate and interpret uncertainty representations. Consequently, uncertainty visualizations for non-expert…

We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…

Information Theory · Computer Science 2021-09-22 Gilad Gour , Marco Tomamichel

Non-local properties of ensembles of quantum gates induced by the Haar measure on the unitary group are investigated. We analyze the entropy of entanglement of a unitary matrix U equal to the Shannon entropy of the vector of singular values…

Quantum Physics · Physics 2013-05-01 Marcin Musz , Marek Kus , Karol Zyczkowski

Observational entropy provides a general notion of quantum entropy that appropriately interpolates between Boltzmann's and Gibbs' entropies, and has recently been argued to provide a useful measure of out-of-equilibrium thermodynamic…

Quantum Physics · Physics 2023-05-09 Francesco Buscemi , Joseph Schindler , Dominik Šafránek

The concept of a uniform set is introduced for an ergodic, measure-preserving transformation on a non-atomic, infinite Lebesgue space. The uniform sets exist as much as they generate the underlying $\sigma$-algebra. This leads to the result…

Dynamical Systems · Mathematics 2011-08-22 Hisatoshi Yuasa

We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality recently proposed by Pawlowski et. al. (arXiv:0905.2992). We consider two…

We develop a convenient framework for characterizing multipartite entanglement in composite systems, based on relations between entropies of various subsystems. This continues the program initiated in arXiv:1808.07871, of using holography…

High Energy Physics - Theory · Physics 2019-05-01 Veronika E. Hubeny , Mukund Rangamani , Massimiliano Rota

I formulate an entropy-rate maximization problem at the observable level for stochastic processes observed through an information-reducing observation map. For a visible stationary law, the map determines an observational fiber of hidden…

Information Theory · Computer Science 2026-04-14 Oleg Kiriukhin

We discuss the procedure of different partitions in the finite set of $N$ integer numbers and construct generic formulas for a bijective map of real numbers $s_y$, where $y=1,2,\ldots,N$, $N=\prod \limits_{k=1}^{n} X_k$, and $X_k$ are…

Quantum Physics · Physics 2017-03-01 V. I. Manko , Z. Seilov

Entropic uncertainty relations are quantitative characterizations of Heisenberg's uncertainty principle, which make use of an entropy measure to quantify uncertainty. In quantum cryptography, they are often used as convenient tools in…

Quantum Physics · Physics 2012-06-22 Niek J. Bouman , Serge Fehr , Carlos González-Guillén , Christian Schaffner

We introduce the \textit{Latent Entropy} (L-entropy) as a novel measure to characterize the genuine multipartite entanglement in quantum systems. Our measure leverages the upper bound of reflected entropy and its maximal values attained by…

High Energy Physics - Theory · Physics 2026-05-29 Jaydeep Kumar Basak , Vinay Malvimat , Junggi Yoon

Relative Fisher information (IR), which is a measure of correlative fluctuation between two probability densities, has been pursued for a number of quantum systems, such as, 1D quantum harmonic oscillator (QHO) and a few central potentials…

Quantum Physics · Physics 2019-04-05 Neetik Mukherjee , Amlan K. Roy

We consider the one-parameter family of interval maps arising from generalized continued fraction expansions known as alpha-continued fractions. For such maps, we perform a numerical study of the behaviour of metric entropy as a function of…

Dynamical Systems · Mathematics 2015-05-14 Carlo Carminati , Stefano Marmi , Alessandro Profeti , Giulio Tiozzo

Information-Theoretical restrictions on the systems self-descriptions are applied to Quantum Measurements Theory. For the quantum object S measurement by information system O such restrictions are described by the restricted states…

Quantum Physics · Physics 2007-05-23 S. Mayburov

We study the entropy of quantum-dot system in contact with a symmetrical CFT bath living on the boundary of pure AdS3 black hole. The q-dot is localized at the centre of bath system of finite size. We first determine the exact location of…

High Energy Physics - Theory · Physics 2021-11-29 Harvendra Singh