Related papers: Information vs Thermodynamic Entropy
Even though the second law of thermodynamics holds the supreme position among the laws of nature, as stated by many distinguished scientists, notably Eddington and Einstein, its position appears to be also quite peculiar. Given the atomic…
After presenting possible motives for fighting against the second law of thermodynamics, several attempts to beat this law are analyzed. The second law wins, but an interesting interpretation of it emerges. This interpretation uses the…
While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…
We study a dynamical system with time dependent Hamiltonian by numerical experiments so as to find a relation between thermodynamics and chaotic nature of the system. Excess information loss, defined newly based on Lyapunov analysis, is…
The property that power means are monotonically increasing functions of their order is shown to be the basis of the second laws not only for processes involving heat conduction but also for processes involving deformations. In an…
Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…
It has long been known that, fundamentally different from a large body of rarefied gas, when a Knudsen gas is immersed in a thermal bath, it may never reach thermal equilibrium. The root cause is nonchaoticity: as the particle-particle…
Landauer's erasure principle exposes an intrinsic relation between thermodynamics and information theory: the erasure of information stored in a system, S, requires an amount of work proportional to the entropy of that system. This entropy,…
Fisher information, Shannon information entropy and Statistical Complexity are calculated for the interface of a normal metal and a superconductor, as a function of the temperature for several materials. The order parameter $\Psi({\bf r})$…
A central result that arose in applying information theory to the stochastic thermodynamics of nonlinear dynamical systems is the Information-Processing Second Law (IPSL): the physical entropy of the universe can decrease if compensated by…
In these decades, it has been revealed that there is rich information-theoretic structure in thermodynamics of out-of-equilibrium systems in both the classical and quantum regimes. This has led to the fruitful interplay among statistical…
We relate the information exchange between two stochastic systems to the nonequilibrium entropy production in the whole system. By deriving a general formula that decomposes the total entropy production into the thermodynamic and…
Most psychophysical experiments discard half the data collected. Specifically, experiments discard reaction time data, and use binary responses (e.g. yes/no) to measure performance. Here, Shannon's information theory is used to define…
The irreversible entropy increase described by the second law of thermodynamics is fundamentally tied to thermalization and the emergence of equilibrium. In the first part of our work (Ref: arXiv.2503.04152), we constructed an isolated gas…
Landauer erasure seems to provide a powerful link between thermodynamics and information processing (logical computation). The only logical operations that require a generation of heat are logically irreversible ones, with the minimum heat…
This article serves as a brief introduction to the Shannon information theory. Concepts of information, Shannon entropy and channel capacity are mainly covered. All these concepts are developed in a totally combinatorial flavor. Some issues…
Information thermodynamics relates the rate of change of mutual information between two interacting subsystems to their thermodynamics when the joined system is described by a bipartite stochastic dynamics satisfying local detailed balance.…
By considering an explicit nonequilibrium model, we analyze the statistics of the irreversible work, $w_{\rm irr}$, and irreversible entropy production, $\Delta_i s$, within the stochastic energetics framework. Restating the second law of…
Twentyseven comments (.) on the Second Law and nonequilibrium systems
We consider the generalized second law of black hole thermodynamics in the light of quantum information theory, in particular information erasure and Landauer's principle (namely, that erasure of information produces at least the equivalent…