Related papers: Shannon information increase and rescue in frictio…

The characterization of irreversibility in general quantum processes is an open problem of increasing techno- logical relevance. Yet, the tools currently available to this aim are mostly limited to the assessment of dynamics induced by…

This article introduces the physics of information in the context of molecular biology and genomics. Entropy and information, the two central concepts of Shannon's theory of information and communication, are often confused with each other…

Irreversibility is a fundamental concept with important implications at many levels. It pinpoints the fundamental difference between the intrinsically reversible microscopic equations of motion and the unidirectional arrow of time that…

We generalize the Clausius (in)equality to overdamped mesoscopic and macroscopic diffusions in the presence of nonconservative forces. In contrast to previous frameworks, we use a decomposition scheme for heat which is based on an exact…

This article studies the emergence of ambiguity in communication through the concept of logical irreversibility and within the framework of Shannon's information theory. This leads us to a precise and general expression of the intuition…

A classical random variable can be faithfully compressed into a sequence of bits with its expected length lies within one bit of Shannon entropy. We generalize this variable-length and faithful scenario to the general quantum source…

The irreversibility of the dynamics of the conservative systems on example of hard disks and potentially of interacting elements is investigated in terms of laws of classical mechanics. The equation of the motion of interacting systems and…

A restricted form of Landauer's Principle, independent of computational considerations, is shown to hold for thermal systems by reference to the joint entropy associated with conjugate observables. It is shown that the source of the…

In this paper, we investigate the asymptotic stability of finite-dimensional stochastic integrable Hamiltonian systems via information entropy. Specifically, we establish the asymptotic vanishing of Shannon entropy difference (with…

In biology, information flows from the environment to the genome by the process of natural selection. But it has not been clear precisely what sort of information metric properly describes natural selection. Here, I show that Fisher…

The second law of thermodynamics states that entropy production in macroscopic systems is non-negative, reaching zero only at thermodynamic equilibrium. As a corollary, this implies that the state trajectory of macroscopic systems is…

What is information originating in observation? Until now it has no scientifically conclusive definition. Information is memorized entropy cutting in random observations which processing interactions. Randomness of various interactive…

We use the formalism of 'Maximum Principle of Shannon's Entropy' to derive the general power law distribution function, using what seems to be a reasonable physical assumption, namely, the demand of a constant mean "internal order"…

We address the fundamental limits of learning unknown parameters of any stochastic process from time-series data, and discover exact closed-form expressions for how optimal inference scales with observation length. Given a parametrized…

Statistical properties of coupled dynamic-stochastic systems are studied within a combination of the maximum information principle and the superstatistical approach. The conditions at which the Shannon entropy functional leads to a…

We analyze a specific role of probability density gradients in the theory of irreversible transport processes. The classic Fisher information and information entropy production concepts are found to be intrinsically entangled with the very…

In this paper we remark that Shannon entropy can be expressed as a function of the self-information (i.e. the logarithm) and the inverse of the Lambert $W$ function. It means that we consider that Shannon entropy has the trace form: $-k…

We study a setting where a receiver must design a questionnaire to recover a sequence of symbols known to strategic sender, whose utility may not be incentive compatible. We allow the receiver the possibility of selecting the alternatives…

Physical systems that power motion and create structure in a fixed amount of time dissipate energy and produce entropy. Whether living or synthetic, systems performing these dynamic functions must balance dissipation and speed. Here, we…

We consider a free fermion chain with uniform nearest-neighbor hopping and let it evolve from an arbitrary initial state with a fixed macroscopic number of particles. We then prove that, at a sufficiently large and typical time, the…