English
Related papers

Related papers: Shannon Meets Carnot: Mutual Information Via Therm…

200 papers

Despite the wide usage of information as a concept in science, we have yet to develop a clear & concise scientific definition. This paper is aimed at laying the foundations for a new theory concerning the mechanics of information alongside…

General Physics · Physics 2017-07-13 Kiyam Lin , SongLing Lin

Shannon entropy is the most crucial foundation of Information Theory, which has been proven to be effective in many fields such as communications. Renyi entropy and Chernoff information are other two popular measures of information with…

Information Theory · Computer Science 2017-01-13 Shanyun Liu , Rui She , Jiaxun Lu , Pingyi Fan

We examine the classical joint source--channel coding problem from the viewpoint of statistical physics and demonstrate that in the random coding regime, the posterior probability distribution of the source given the channel output is…

Information Theory · Computer Science 2008-10-14 Neri Merhav

This thesis investigates the connection between quantum theory, thermodynamics and information theory. Theories with structure similar to that of quantum theory are considered, mathematically described by the framework of "Generalized…

Quantum Physics · Physics 2015-08-14 Marius Krumm

The Clausius inequality (CI) form of the second law of thermodynamics relates information changes (entropy) to changes in the first moment of the energy (heat and indirectly also work). Are there similar relations between other moments of…

Quantum Physics · Physics 2017-09-27 Raam Uzdin

We show that the conservation and the non-additivity of the information, together with the additivity of the entropy make the entropy increase in an isolated system. The collapse of the entangled quantum state offers an example of the…

Quantum Physics · Physics 2009-11-13 Qi-Ren Zhang

We report two results complementing the second law of thermodynamics for Markovian open quantum systems coupled to multiple reservoirs with different temperatures and chemical potentials. First, we derive a nonequilibrium free energy…

Statistical Mechanics · Physics 2019-04-18 Krzysztof Ptaszynski , Massimiliano Esposito

Energy transfer and information transmission are two fundamental aspects of nature. They are seemingly unrelated, while recent findings suggest that a deep connection between them is to be discovered. This amounts to asking: Can we phrase…

Quantum Physics · Physics 2025-02-07 Chung-Yun Hsieh

In this paper, we derive both the Adam-Gibbs and the Rosenfield relations from the microscopic point of view and compare them with the numerical calculation for one and two dimensional systems. The comparison shows there is an excellent…

Statistical Mechanics · Physics 2025-04-21 Bidhan Chandra Bag

This work consists in the theorical development on the analysis of the Thermodynamic Laws and thermodynamic systems in relative motion, according to the laws of Classical Mechanics. The difference of this work for many of the literature is…

Classical Physics · Physics 2021-05-04 Wendel Macedo Mendes , Bruno Poti e Silva

The mutual information is a measure of classical and quantum correlations of great interest in quantum information. It is also relevant in quantum many-body physics, by virtue of satisfying an area law for thermal states and bounding all…

Quantum Physics · Physics 2021-09-15 Samuel O. Scalet , Álvaro M. Alhambra , Georgios Styliaris , J. Ignacio Cirac

In a previous paper [1] we considered the question, "What underlying property of nature is responsible for the second law?" A simple answer can be stated in terms of information: The fundamental loss of information gives rise to the second…

Statistical Mechanics · Physics 2012-02-21 T. L. Duncan , J. S. Semura

In recent years, the unified theory of information and thermodynamics has been intensively discussed in the context of stochastic thermodynamics. The unified theory reveals that information theory would be useful to understand…

Statistical Mechanics · Physics 2018-07-23 Sosuke Ito

This topical review article gives an overview of the interplay between quantum information theory and thermodynamics of quantum systems. We focus on several trending topics including the foundations of statistical mechanics, resource…

Quantum Physics · Physics 2016-08-29 John Goold , Marcus Huber , Arnau Riera , Lídia del Rio , Paul Skrzypczyk

Universality of classical thermodynamics rests on the central limit theorem, due to which, measurements of thermal fluctuations are unable to reveal detailed information regarding the microscopic structure of a macroscopic body. When small…

Quantum Physics · Physics 2024-02-28 Lucas Chibebe Céleri , Łukasz Rudnicki

In the present work we are studying a bosonic quantum field system at finite temperature, and at zero and non-zero chemical potential. For a simple spatial partition we derive the corresponding mutual information, a quantity that measures…

Quantum Physics · Physics 2014-05-12 C. N. Gagatsos , A. I. Karanikas , G. I. Kordas

In this work, we derive information-theoretic properties for a modified Tsallis entropy, hereinafter referred to as q-entropy. We introduce the notions of joint q-entropy, conditional q-entropy, relative q-entropy, conditional mutual…

Mathematical Physics · Physics 2026-03-31 Marco A. S. Trindade

We extend the recently developed non-gaussian thermodynamic formalism \cite{tre98} of a (presumably strongly turbulent) non-Markovian medium to its most general form that allows for the formulation of a consistent thermodynamic theory. All…

Space Physics · Physics 2009-10-31 R. A. Treumann

We investigate thermodynamics of feedback processes driven by measurement. Regarding system and memory device as a composite system, mutual information as a measure of correlation between the two constituents contributes to the entropy of…

Statistical Mechanics · Physics 2017-04-12 Chulan Kwon

One of the main notions of information theory is the notion of mutual information in two messages (two random variables in Shannon information theory or two binary strings in algorithmic information theory). The mutual information in $x$…

Information Theory · Computer Science 2012-06-19 Ilya Razenshteyn