English
Related papers

Related papers: Algebraic Representations of Entropy and Fixed-Par…

200 papers

A certain type of integer grid, called here an echelon grid, is an object found both in coherent systems whose components have a finite or countable number of levels and in algebraic geometry. If \alpha=(\alpha_1,...,\alpha_d) is an integer…

Statistics Theory · Mathematics 2007-06-13 Beatrice Giglio , Henry P. Wynn

The unified entropy as a promotion of the von Neumann entropy exhibits distinct diversity which contains the Tsallis entropy, the R\'{e}nyi entropy, the von Neumann entropy as special cases. The unified-($r,t$) entropy entanglement with…

Quantum Physics · Physics 2026-05-22 Wenxue Ren , Binghao Li , Ruiqun Niu , Yu Guo , Shuanping Du

Kolmogorov complexity of a finite binary word reflects both algorithmic structure and the empirical distribution of symbols appearing in the word. Words with symbol frequencies far from one half have smaller combinatorial richness and…

Computation · Statistics 2025-12-25 Brani Vidakovic

Conditional mutual information is important in the selection and interpretation of graphical models. Its empirical version is well known as a generalised likelihood ratio test and that it may be represented as a difference in entropy. We…

Methodology · Statistics 2015-01-20 Joe Whittaker , Florian Martin , Yang Xiang

The entropy region is a fundamental object in information theory. An outer bound for the entropy region is defined by a minimal set of Shannon-type inequalities called elemental inequalities also referred to as the Shannon region. This…

Information Theory · Computer Science 2020-05-22 Hitika Tiwari , Satyajit Thakor

Quantum mutual information (QMI) not only displays the mutual information in the system but also demonstrates some quantum correlation beyond entanglement. We explore here the two alternatives of multipartite quantum mutual information…

Quantum Physics · Physics 2023-09-01 Yu Guo , Lizhong Huang

This thesis consolidates, improves and extends the smooth entropy framework for non-asymptotic information theory and cryptography. We investigate the conditional min- and max-entropy for quantum states, generalizations of classical R\'enyi…

Quantum Physics · Physics 2015-03-20 Marco Tomamichel

The finiteness of black hole entropy suggest that spacetime is fundamentally discrete, and hints at an underlying relationship between geometry and "information". The foundation of this relationship is yet to be uncovered, but should…

General Relativity and Quantum Cosmology · Physics 2008-10-14 D. Rideout , S. Zohren

New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Andrew Barron

We shall prove that the celebrated R\'enyi entropy is the first example of a new family of infinitely many multi-parametric entropies. We shall call them the $Z$-entropies. Each of them, under suitable hypotheses, generalizes the celebrated…

Mathematical Physics · Physics 2017-02-07 Piergiulio Tempesta

We show that restricted shareability of multi-qubit entanglement can be fully characterized by unified-$(q,s)$ entropy. We provide a two-parameter class of bipartite entanglement measures, namely unified-$(q,s)$ entanglement with its…

Quantum Physics · Physics 2011-06-22 Jeong San Kim , Barry C. Sanders

Many quantum information measures can be written as an optimization of the quantum relative entropy between sets of states. For example, the relative entropy of entanglement of a state is the minimum relative entropy to the set of separable…

Quantum Physics · Physics 2018-08-09 Hamza Fawzi , Omar Fawzi

In this paper we introduce three notions of measure theoretical entropy of a measurable cover U in a measure theoretical dynamical system. Two of them were already introduced in [R] and the new one is defined only in the ergodic case. We…

Dynamical Systems · Mathematics 2008-10-24 Uri Shapira

For quantum mechanical systems an entropy-like quantity $S_q$ is defined. $S_q$ can differ from the usually defined entropy $S$ and $S_q$ may increase with time for an isolated system. The essential condition for the difference between $S$…

Quantum Physics · Physics 2007-05-23 S. Schlieder

The general framework of entropic dynamics is used to formulate a relational quantum dynamics. The main new idea is to use tools of information geometry to develop an entropic measure of the mismatch between successive configurations of a…

Quantum Physics · Physics 2016-01-11 Selman Ipek , Ariel Caticha

Let $G$ be a countable infinite discrete amenable group.It should be noted that a $G$-system $(X,G)$ naturally induces a $G$-system $(\mathcal{M}(X),G)$, where $\mathcal{M}(X)$ denotes the space of Borel probability measures on the compact…

Dynamical Systems · Mathematics 2023-03-06 Kairan Liu , Runju Wei

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, Shannon's entropy power inequality (EPI) seems to be an exception: available information theoretic proofs of the…

Information Theory · Computer Science 2016-11-17 Olivier Rioul

Given two jointly distributed random variables $(X,Y)$, a functional representation of $X$ is a random variable $Z$ independent of $Y$, and a deterministic function $g(\cdot, \cdot)$ such that $X=g(Y,Z)$. The problem of finding a minimum…

Information Theory · Computer Science 2023-05-11 Yanina Y. Shkel , Anuj Kumar Yadav

We look at the maximal entropy (MME) measure of the boundaries of connected components of the Fatou set of a rational map of degree greater than or equal to 2. We show that if there are infinitely many Fatou components, and if either the…

Dynamical Systems · Mathematics 2017-08-25 Jane Hawkins , Michael Taylor

Information theory establishes the fundamental limits on data transmission, storage, and processing. Quantum information theory unites information theoretic ideas with an accurate quantum-mechanical description of reality to give a more…

Quantum Physics · Physics 2017-02-01 Andrew W. Cross , Ke Li , Graeme Smith