Related papers: Information vs Thermodynamic Entropy
Shannon's metric of "Entropy" of information is a foundational concept of information theory. This article is a primer for novices that presents an intuitive way of understanding, remembering, and/or reconstructing Shannon's Entropy metric…
The statistical properties of physical systems in thermal equilibrium are blatantly different from their far-from-equilibrium counterparts. In the latter, fluctuations often dominate the dynamics and might cluster in ordered patterns in the…
Many fruitful analogies have emerged between the theories of quantum entanglement and thermodynamics, motivating the pursuit of an axiomatic description of entanglement akin to the laws of thermodynamics. A long-standing open problem has…
Entanglement is central both to the foundations of quantum theory and, as a novel resource, to quantum information science. The theory of entanglement establishes basic laws, such as the non-increase of entanglement under local operations,…
In the scientific and engineering literature, the second law of thermodynamics is expressed in terms of the behavior of entropy in reversible and irreversible processes. According to the prevailing statistical mechanics interpretation the…
This paper introduces time into information theory, gives a more accurate definition of information, and unifies the information in cognition and Shannon information theory. Specially, we consider time as a measure of information, giving a…
In many complex systems, whether biological or artificial, the thermodynamic costs of communication among their components are large. These systems also tend to split information transmitted between any two components across multiple…
Thermodynamics is a macroscopic physical theory whose two very general laws are independent of any underlying dynamical laws and structures. Nevertheless, its generality enables us to understand a broad spectrum of phenomena in physics,…
The so-called information-thermodynamics link has been created in a series of works starting from Maxwell demon and established by the idea of transforming information into work in the though experiment of Szilard which then evolved into…
Algorithmic entropy and Shannon entropy are two conceptually different information measures, as the former is based on size of programs and the later in probability distributions. However, it is known that, for any recursive probability…
We deploy Shannon's information entropy to the distribution of branching fractions in a particle decay. This serves to quantify how important a given new reported decay channel is, from the point of view of the information that it adds to…
Even after over 150 years of discussion, the interpretation of the second law of thermodynamics continues to be a source of confusion and controversy in physics. This confusion has been accentuated by recent challenges to the second law and…
This article is a short version of a longer article to appear in Physics Reports (cond-mat/9708200). The essential postulates of classical thermodynamics are formulated, from which the second law is deduced as the principle of increase of…
Traditional form of the second law of thermodynamics is strongly restricted by three conditions: One is the initial joint state of the system and surroundings should be a product state, so that there exists no initial correlations. The…
We present an axiomatic framework for thermodynamics that incorporates information as a fundamental concept. The axioms describe both ordinary thermodynamic processes and those in which information is acquired, used and erased, as in the…
We argue that the entanglement entropy for a very small subsystem obeys a property which is analogous to the first law of thermodynamics when we excite the system. In relativistic setups, its effective temperature is proportional to the…
We generalize stochastic thermodynamics to include information reservoirs. Such information reservoirs, which can be modeled as a sequence of bits, modify the second law. For example, work extraction from a system in contact with a single…
In this study, we present a reformulation of classical equilibrium thermodynamics by replacing the obscure and ambiguous concept of entropy with the clear and intuitive concept of information stored in a thermodynamic system. Specifically,…
Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the…
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…