Related papers: Undecidability, entropy and information loss in co…
Entropy is critically examined as a fundamental concept in contemporary science and informatics. Although the typical Shannon entropy provides a proper framework for describing the canonical ensemble, it fails to represent adequately the…
Information theory establishes the fundamental limits on data transmission, storage, and processing. Quantum information theory unites information theoretic ideas with an accurate quantum-mechanical description of reality to give a more…
We study the approach to equilibrium of systems of gas particles in terms of relative entropy. The systems are modeled by the Kac master equation in arbitrary dimensions. First, we study the Kac system coupled to a thermostat, and secondly…
Here we deconstruct, and then in a reasoned way reconstruct, the concept of "entropy of a system," paying particular attention to where the randomness may be coming from. We start with the core concept of entropy as a COUNT associated with…
The irreversible entropy increase described by the second law of thermodynamics is fundamentally tied to thermalization and the emergence of equilibrium. In the first part of our work (Ref: arXiv.2503.04152), we constructed an isolated gas…
We give a simple proof of the uncertainty principle with quantum side information, as in [Berta et al. Nature Physics 6, 659 (2010)], invoking the monotonicity of the relative entropy. Our proof shows that the entropic uncertainty principle…
We propose an interpretation of the expansion and acceleration of the Universe from an information theoretic viewpoint. We obtain the time evolution of the configuration entropy of the mass distribution in a static Universe and show that…
An explanation of the mechanism of irreversible dynamics was offered. The explanation was obtained within the framework of laws of classical mechanics by the expansion of Hamilton formalism. Such expansion consisted in adaptation of it to…
Quantum information scrambling refers to the loss of local recoverability of quantum information, which has found widespread attention from high energy physics to quantum computing. In the present analysis we propose a possible starting…
To make clear several issues relating with the thermodynamics of computations, we perform a simulation of a binary device using a Langevin equation. Based on our numerical results, we consider how to estimate thermodynamic entropy of…
Accurately determining dependency structure is critical to discovering a system's causal organization. We recently showed that the transfer entropy fails in a key aspect of this---measuring information flow---due to its conflation of dyadic…
A microscopic definition of the thermodynamic entropy in an isolated quantum system must satisfy (i) additivity, (ii) extensivity and (iii) the second law of thermodynamics. We show that the diagonal entropy, which is the Shannon entropy in…
Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…
We analyze dynamical properties of the Shannon information entropy of a continuous probability distribution, which is driven by a standard diffusion process. This entropy choice is confronted with another option, employing the conditional…
We study an information-theoretic measure of uncertainty for quantum systems. It is the Shannon information $I$ of the phase space probability distribution $\la z | \rho | z \ra $, where $|z \ra $ are coherent states, and $\rho$ is the…
Some physical processes, including the intensity fluctuations of a chaotic laser, the detection of single photons, and the Brownian motion of a microscopic particle in a fluid are unpredictable, at least on long timescales. This…
The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and…
In this work we investigate the information loss in (nonlinear) dynamical input-output systems and provide some general results. In particular, we present an upper bound on the information loss rate, defined as the (non-negative) difference…
We study dynamical properties of systems with many interacting Fermi-particles under the influence of static imperfections. Main attention is payed to the time dependence of the Shannon entropy of wave packets, and to the fidelity of the…
The logical basis for information theory is the newly developed logic of partitions that is dual to the usual Boolean logic of subsets. The key concept is a "distinction" of a partition, an ordered pair of elements in distinct blocks of the…