Related papers: The Second Law and Informatics
This paper introduces time into information theory, gives a more accurate definition of information, and unifies the information in cognition and Shannon information theory. Specially, we consider time as a measure of information, giving a…
In this paper, we analyze the relationship between entropy and information in the context of the mixing process of two identical ideal gases. We will argue that entropy has a special information-based feature that is enfolded in the…
We investigate how undecidability enters into computations of classical physical systems and contributes to the increase of entropy and loss of information. In actual computation with finite bit of information capacity we accept…
The Clausius inequality (CI) form of the second law of thermodynamics relates information changes (entropy) to changes in the first moment of the energy (heat and indirectly also work). Are there similar relations between other moments of…
I give a quick overview of some of the theoretical background necessary for using modern non-equilibrium statistical physics to investigate the thermodynamics of computation. I first present some of the necessary concepts from information…
Similarity between quantum mechanics and thermodynamics is discussed. It is found that if the Clausius equality is imposed on the Shannon entropy and the analogue of the heat quantity, then the value of the Shannon entropy comes to formally…
Materials that are constantly driven out of thermodynamic equilibrium, such as active and living systems, typically violate the Einstein relation. This may arise from active contributions to particle fluctuations which are unrelated to the…
Traditional form of the second law of thermodynamics is strongly restricted by three conditions: One is the initial joint state of the system and surroundings should be a product state, so that there exists no initial correlations. The…
The classical thermodynamic laws fail to capture the behavior of systems with energy Hamiltonian which is an explicit function of the temperature. Such Hamiltonian arises, for example, in modeling information processing systems, like…
We establish the fluctuation theorem in the presence of information exchange between a nonequilibrium system and other degrees of freedom such as an observer and a feedback controller, where the amount of information exchange is added to…
Isoenergetic thermalization amongst $n$ bodies is a well-known irreversible process, bringing the bodies to a common temperature $T_F$ and leading to a rise in the total entropy of the bodies. We express this change in entropy using the…
We propose an information theoretic model for sociological networks. The model is a microcanonical ensemble of states and particles. The states are the possible pairs of nodes (i.e. people, sites and alike) which exchange information. The…
A thermodynamic framework for asymptotic inference is developed in which sample size and parameter variance define a state space. Within this description, Shannon information plays the role of entropy, and an integrating factor organizes…
I argue here that both the first and second laws of thermodynamics, generally understood to be quintessentially physical in nature, can be equally well described as being about certain types of information without the need to invoke…
An essential role of information in microscopic thermodynamics (e.g. Maxwell's demon) opens a challenging question if there exists a formulation of the second law of thermodynamics based only on pure information ideas. Here, such a…
Fundamental limits on the controllability of physical systems are discussed in the light of information theory. It is shown that the second law of thermodynamics, when generalized to include information, sets absolute limits to the minimum…
As early as 1867, two years after the introduction of the concept of entropy by Clausius, Maxwell showed that the limitations imposed by the second law of thermodynamics depend on the information that one possesses about the state of a…
In this paper we discuss about the validity of the Shannon entropy functional in connection with the correct Gibbs-Hertz probability distribution function. We show that there is no contradiction in using the Shannon-Gibbs functional and…
The irreversible entropy increase described by the second law of thermodynamics is fundamentally tied to thermalization and the emergence of equilibrium. In the first part of our work (Ref: arXiv.2503.04152), we constructed an isolated gas…
The second law of thermodynamics is discussed and reformulated from a quantum information theoretic perspective for open quantum systems using relative entropy. Specifically, the relative entropy of a quantum state with respect to…