Related papers: Free Entropy
We extend algorithmic information theory to quantum mechanics, taking a universal semicomputable density matrix (``universal probability'') as a starting point, and define complexity (an operator) as its negative logarithm. A number of…
The method of Maximum (relative) Entropy (ME) is used to translate the information contained in the known form of the likelihood into a prior distribution for Bayesian inference. The argument is guided by intuition gained from the…
Perturbation theory is used to investigate the evolution of the von Neumann entropy of a subsystem of a bipartite quantum system under the action of a unitary matrix, in the limit where that matrix is close to the unit matrix. The physical…
This is a short analysis of the changes in the concept of entropy as applied to physics of the present-day and Early Universe. Of special interest is a leading role of such a notion as deformation of a physical theory. The relation to a…
Various properties of relative entropy have led to its widespread use in information theory. These properties suggest that relative entropy has a role to play in systems that attempt to perform inference in terms of probability…
We translate the problem of calculating the entropy of a set of binary configurations/signals into a sequence of supervised classification tasks. Subsequently, one can use virtually any machine learning classification algorithm for…
Based on the recently introduced averaging procedure in phase space, a new type of entropy is defined on the von Neumann lattice. This quantity can be interpreted as a measure of uncertainty associated with simultaneous measurement of the…
The entanglement entropy in a quantum field theory between two regions of space has been shown in simple cases to be proportional to the volume of the hypersurface separating the regions. We prove that this is true for a free scalar field…
Free probability theory started in the 1980s has attracted much attention lately in signal processing and communications areas due to its applications in large size random matrices. However, it involves with massive mathematical concepts…
Situations in many fields of research, such as digital communications, nuclear physics and mathematical finance, can be modelled with random matrices. When the matrices get large, free probability theory is an invaluable tool for describing…
We define a classical probability analogue of Voiculescu's free entropy dimension that we shall call the classical probability entropy dimension of a probability measure on $\mathbb{R}^n$. We show that the classical probability entropy…
The entropy of a hierarchical network topology in an ensemble of sparse random networks with "hidden variables" associated to its nodes, is the log-likelihood that a given network topology is present in the chosen ensemble.We obtain a…
In this paper we seek to understand what current knowledge of entanglement entropies suggests about the appropriate way to interpret the covariant entropy bound. We first begin by arguing that just as in the classical case, a universal…
We present an alternative approach to the theory of free Gibbs states with convex potentials. Instead of solving SDE's, we combine PDE techniques with a notion of asymptotic approximability by trace polynomials for a sequence of functions…
A general method for proving continuity of the von Neumann entropy on subsets of positive trace-class operators is considered. This makes it possible to re-derive the known conditions for continuity of the entropy in more general forms and…
Entropy concept was introduced by Clausius 160 years ago, and has been continually enriched, developed and interpreted by the researchers in many different scientific disciplines ever since. Thermodynamics and other scientific disciplines…
Pseudo entropy is an interesting quantity with a simple gravity dual, which generalizes entanglement entropy such that it depends on both an initial and a final state. Here we reveal the basic properties of pseudo entropy in quantum field…
The goal of the present paper is to derive some conditions on saturation of (strong) subadditivity inequality for the stochastic matrices. The notion of relative entropy of stochastic matrices is introduced by mimicking quantum relative…
The Renyi entropy is a generalization of the usual concept of entropy which depends on a parameter q. In fact, Renyi entropy is closely related to free energy. Suppose we start with a system in thermal equilibrium and then suddenly divide…
We carry out a systematic study of entanglement entropy in relativistic quantum field theory. This is defined as the von Neumann entropy S_A=-Tr rho_A log rho_A corresponding to the reduced density matrix rho_A of a subsystem A. For the…