Related papers: Mutual information superadditivity and unitarity b…
We carry out a systematic study of entanglement entropy in nonrelativistic conformal field theories via holographic techniques. After a discussion of recent results concerning Galilean conformal field theories, we deduce a novel expression…
The mutual information characterizes correlations between spatially separated regions of a system. Yet, in experiments we often measure dynamical correlations, which involve probing operators that are also separated in time. Here, we…
We compute the entanglement entropy and mutual information for two disjoint intervals in two-dimensional conformal field theories as a function of time after a local quench, using the replica trick and boundary conformal field theory. We…
The mutual and tripartite information between pairs and triples of disjoint regions in a quantum field theory are sensitive probes of the spread of correlations in an equilibrating system. We compute these quantities in strongly coupled…
There is a vast body of recent literature on the reliability of communication through noisy channels, the recovery of community structures in the stochastic block model, the limiting behavior of the free entropy in spin glasses and the…
We study formal properties of smooth max-information, a generalization of von Neumann mutual information derived from the max-relative entropy. Recent work suggests that it is a useful quantity in one-shot channel coding, quantum rate…
The concept of entropy, firstly introduced in information theory, rapidly became popular in many applied sciences via Shannon's formula to measure the degree of heterogeneity among observations. A rather recent research field aims at…
We present some exact results about universal quantities derived from the local density matrix, for a free massive Dirac field in two dimensions. We first find the trace of powers of the density matrix in a novel fashion, which involves the…
We propose learning discrete structured representations from unlabeled data by maximizing the mutual information between a structured latent variable and a target variable. Calculating mutual information is intractable in this setting. Our…
Mutual information and information entropies in momentum space are proposed as measures of the non-local aspects of information. Singlet and triplet state members of the helium isoelectronic series are employed to examine Coulomb and Fermi…
Previously proposed measures of entanglement, such as entanglement of formation and assistance, are shown to be special cases of the relative entropy of entanglement. The difference between these measures for an ensemble of mixed states is…
In this work, we study the universal behaviors in the mutual information of two disjoint spheres in a conformal field theory(CFT). By using the operator product expansion of the spherical twist operator in terms of the conformal family, we…
Information-theoretic quantities like entropy and mutual information have found numerous uses in machine learning. It is well known that there is a strong connection between these entropic quantities and submodularity since entropy over a…
The mutual information is bounded from above by a decreasing affine function of the square of the distance between the input distribution and the set of all capacity-achieving input distributions $\Pi_{\mathcal{A}}$, on small enough…
Markov categories are a novel framework to describe and treat problems in probability and information theory. In this work we combine the categorical formalism with the traditional quantitative notions of entropy, mutual information, and…
The various entropy bounds that exist in the literature suggest that spacetime is fundamentally discrete, and hint at an underlying relationship between geometry and "information". The foundation of this relationship is yet to be uncovered,…
For spin and fermionic systems in any spatial dimension, we establish that the superpolynomial decay behavior of mutual information and conditional mutual information is a universal property of gapped pure- and mixed-state phases; i.e., all…
Mutual information is one of the essential building blocks of information theory. Yet, it is only finitely defined for distributions with fast decaying tails on a countable joint alphabet of two random elements. The unboundedness of mutual…
The data for many classification problems, such as pattern and speech recognition, follow mixture distributions. To quantify the optimum performance for classification tasks, the Shannon mutual information is a natural information-theoretic…
Real-world systems are characterized by complex interactions of their internal degrees of freedom, while living in ever-changing environments whose net effect is to act as additional couplings. Here, we introduce a paradigmatic interacting…