Related papers: Information vs Thermodynamic Entropy
Fundamental limits on the controllability of physical systems are discussed in the light of information theory. It is shown that the second law of thermodynamics, when generalized to include information, sets absolute limits to the minimum…
The Kelvin-Planck statement of the Second Law of Thermodynamics is a stricture on the nature of heat receipt by any body suffering a cyclic process. It makes no mention of temperature or of entropy. Beginning with a Kelvin-Planck statement…
Asher Peres' proof that a violation of No Cloning Theorem would imply a violation of the Second Law of Thermodynamics is shown not to take into account the algorithmic-information's contribution to the Thermodynamical Entropy of the…
The essence of the second law of classical thermodynamics is the `entropy principle' which asserts the existence of an additive and extensive entropy function, S, that is defined for all equilibrium states of thermodynamic systems and whose…
We report two results complementing the second law of thermodynamics for Markovian open quantum systems coupled to multiple reservoirs with different temperatures and chemical potentials. First, we derive a nonequilibrium free energy…
The development of stochastic thermodynamics during the last decades prompted the discovery of novel nonequilibrium relations refining our understanding of the second law in small fluctuating systems and its connection with information…
Shannon entropy is the most crucial foundation of Information Theory, which has been proven to be effective in many fields such as communications. Renyi entropy and Chernoff information are other two popular measures of information with…
We develop an axiomatic reconstruction of thermodynamics based entirely on two primitive components: a description of what aspects of a system are observed and a reference measure that encodes the underlying descriptive convention. These…
The second law of thermodynamics is discussed and reformulated from a quantum information theoretic perspective for open quantum systems using relative entropy. Specifically, the relative entropy of a quantum state with respect to…
A basic task of information processing is information transfer (flow). Here we study a pair of Brownian particles each coupled to a thermal bath at temperature $T_1$ and $T_2$, respectively. The information flow in such a system is defined…
The essential postulates of classical thermodynamics are formulated, from which the second law is deduced as the principle of increase of entropy in irreversible adiabatic processes that take one equilibrium state to another. The entropy…
A general nonequilibrium thermodynamic theory is developed for time-dependent Langevin dynamics, starting from the common definition of nonequilibrium Gibbs entropy. It is shown that the notations appearing in the First and the Second Law…
Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…
Three different approaches to derive mutual information via thermodynamics are presented where the temperature-dependent energy is given by: (a) $\beta \mathcal{E} = -\ln[P(X,Y)]$, (b) $\beta \mathcal{E} =-\ln[P(Y|X)]$ or (c) $\beta…
This article consists of a very short introduction to classical and quantum information theory. Basic properties of the classical Shannon entropy and the quantum von Neumann entropy are described, along with related concepts such as…
Information plays an important role in our understanding of the physical world. We hence propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical world,…
The application of the Shannon entropy to study the relationship between information and structures has yielded insights into molecular and material systems. However, the difficulty in directly observing and manipulating atoms and molecules…
Shannon entropy was defined for probability distributions and then its using was expanded to measure the uncertainty of knowledge for systems with complete information. In this article, it is proposed to extend the using of Shannon entropy…
Materials that are constantly driven out of thermodynamic equilibrium, such as active and living systems, typically violate the Einstein relation. This may arise from active contributions to particle fluctuations which are unrelated to the…
We examine information theory using the steady-state Boltzmann equation. In a nonequilibrium steady-state system under steady heat conduction, the thermodynamic quantities from information theory are calculated and compared with those from…