Related papers: Physics of the Shannon Limits
The property that power means are monotonically increasing functions of their order is shown to be the basis of the second laws not only for processes involving heat conduction but also for processes involving deformations. In an…
Information theory is introduced in this lecture note with a particular emphasis on its relevance to algebraic coding theory. The document develops the mathematical foundations for quantifying uncertainty and information transmission by…
We report two results complementing the second law of thermodynamics for Markovian open quantum systems coupled to multiple reservoirs with different temperatures and chemical potentials. First, we derive a nonequilibrium free energy…
An "entropy increasing to the maximum" result analogous to the entropic central limit theorem (Barron 1986; Artstein et al. 2004) is obtained in the discrete setting. This involves the thinning operation and a Poisson limit. Monotonic…
Thermodynamic systems involving reversible and non-reversible heat transfer are used to derive integral inequalities expected from the Second of Law of Thermodynamics. Then, the inequalities are proved and generalized to higher dimensions…
Irreversible processes accomplished in a fixed time involve nonlinearly coupled flows of matter, energy, and information. Here, using entropy production as an example, we show how thermodynamic uncertainty relations and speed limits on…
Superstatistics describes statistical systems that behave like superpositions of different inverse temperatures $\beta$, so that the probability distribution is $p(\epsilon_i) \propto \int_{0}^{\infty} f(\beta) e^{-\beta \epsilon_i}d\beta$,…
An essential role of information in microscopic thermodynamics (e.g. Maxwell's demon) opens a challenging question if there exists a formulation of the second law of thermodynamics based only on pure information ideas. Here, such a…
This paper revisits Brownian motion from the perspective of Information Theory, aiming to explore the connections between Information Theory, Thermodynamics, and Complex Science. First, we propose a single-particle discrete Brownian motion…
As early as 1867, two years after the introduction of the concept of entropy by Clausius, Maxwell showed that the limitations imposed by the second law of thermodynamics depend on the information that one possesses about the state of a…
We show that there exists a natural way to define a condition of generalized thermal equilibrium between systems governed by Tsallis thermostatistics, under the hypotheses that i) the coupling between the systems is weak, ii) the structure…
It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…
Landauer's principle, often regarded as the foundation of the thermodynamics of information processing, holds that any logically irreversible manipulation of information, such as the erasure of a bit or the merging of two computation paths,…
It is known that the high-dimensional quantum state space is notoriously complicated in contrast with the beautiful Bloch ball of the qubit. We examined the mechanism behind this fact in the frame work of general probabilistic theory (GPT),…
Most psychophysical experiments discard half the data collected. Specifically, experiments discard reaction time data, and use binary responses (e.g. yes/no) to measure performance. Here, Shannon's information theory is used to define…
Growing economic inequalities are observed in several countries throughout the world. Following Pareto, the power-law structure of these inequalities has been the subject of much theoretical and empirical work. But their nonequilibrium…
Equilibrium thermodynamics is combined with Jarzynski's irreversible work theorem to quantify the excess entropy produced by irreversible processes. The resulting rectified form of the second law parallels the first law, in the sense that…
The laws of thermodynamics, despite their wide range of applicability, are known to break down when systems are correlated with their environments. Here, we generalize thermodynamics to physical scenarios which allow presence of…
Dunkel and Hilbert, "Consistent thermostatistics forbids negative absolute temperatures," Nature Physics, {\bf 10}, 67 (2014), and Hilbert, H\"anggi, and Dunkel, "Thermodynamic laws in isolated systems," Phys. Rev. E {\bf 90}, 062116 (2014)…
In this paper, we derive both the Adam-Gibbs and the Rosenfield relations from the microscopic point of view and compare them with the numerical calculation for one and two dimensional systems. The comparison shows there is an excellent…