Related papers: Kullback-Leibler Potential for Non-Ergodic Replica…
We study the problem of the energetic cost of information erasure by looking at it through the lens of the Jarzynski equality. We observe that the Landauer bound, $\langle W \rangle \geq kT \ln 2$, on average dissipated work $\langle W…
While Kolmogorov complexity is the accepted absolute measure of information content in an individual finite object, a similarly absolute notion is needed for the information distance between two individual objects, for example, two…
We analyze information transmission in a recently proposed coarse-grained model of polymer replication by framing it as a communication channel between templates and copies. By calculating the mutual information in the steady-state limit of…
We present the minimal energy costs for the measurement and the information erase, using only the Helmholtz free energy and the entanglement of formation. The entanglement of formation appears in the form of difference which indicates the…
We propose an information-geometric signature of nonconservative driving that detects violations of detailed balance using the Kullback--Leibler divergence and the Fisher information. For Markov jump processes satisfying detailed balance,…
In the recent progress in nonequilibrium thermodynamics, information has been recognized as a kind of thermodynamic resource that can drive thermodynamic current without any direct energy injection. In this paper, we establish the framework…
We generalize stochastic thermodynamics to include information reservoirs. Such information reservoirs, which can be modeled as a sequence of bits, modify the second law. For example, work extraction from a system in contact with a single…
Landauer's principle provides a perspective on the physical meaning of information as well as on the minimum working cost of information processing. Whereas most studies have related the decrease in entropy during a computationally…
Classical and quantum error correction are presented in the form of Maxwell's demon and their efficiency analyzed from the thermodynamic point of view. We explain how Landauer's principle of information erasure applies to both cases. By…
The improvement in the performance of efficient and lightweight models (i.e., the student model) is achieved through knowledge distillation (KD), which involves transferring knowledge from more complex models (i.e., the teacher model).…
Quantum information scrambling refers to the loss of local recoverability of quantum information, which has found widespread attention from high energy physics to quantum computing. In the present analysis we propose a possible starting…
Quantitative measure of disorder or randomness based on the entropy production characterizes thermodynamical irreversibility, which is relevant to the conventional second law of thermodynamics. Here we report, in a quantum mechanical…
A unification of thermodynamics and information theory is proposed. It is argued that similarly to the randomness due to collisions in thermal systems, the quenched randomness that exists in data files in informatics systems contributes to…
Motivated by the recent proposed models of the information engine [D. Mandal and C. Jarzynski, Proc. Natl. Acad. Sci. 109, 11641 (2012)] and the information refrigerator [D. Mandal, H. T. Quan, and C. Jarzynski, Phys. Rev. Lett. 111, 030602…
Information theory is a mathematical theory of learning with deep connections with topics as diverse as artificial intelligence, statistical physics, and biological evolution. Many primers on information theory paint a broad picture with…
The Landauer principle asserts that the energy cost of erasure of one bit of information by the action of a thermal reservoir in equilibrium at temperature T is never less than $kTlog 2$. We discuss Landauer's principle for quantum…
Irreversible information processing cannot be carried out without some inevitable thermodynamical work cost. This fundamental restriction, known as Landauer's principle, is increasingly relevant today, as the energy dissipation of computing…
The problem of formulating thermodynamics in a relativistic scenario remains unresolved, although many proposals exist in the literature. The challenge arises due to the intrinsic dynamic structure of spacetime as established by the general…
Deep nonlinear models pose a challenge for fitting parameters due to lack of knowledge of the hidden layer and the potentially non-affine relation of the initial and observed layers. In the present work we investigate the use of information…
Experimental designs are tools which can dramatically reduce the number of simulations required by time-consuming computer codes. Because we don't know the true relation between the response and inputs, designs should allow one to fit a…