Related papers: Is Entropy Associated with Time's Arrow?
Currently, 'time' does not play any essential role in quantum information theory. In this sense, quantum information theory is underdeveloped similarly to how quantum physics was underdeveloped before Erwin Schrodinger introduced his famous…
The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…
Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…
We analyze the equilibrium space of an ideal gas using the formalism of geometrothermodynamics. We introduce the concept of thermodynamic geodesics to show that the equilibrium space around a particular initial state can be divided into two…
Shannon's metric of "Entropy" of information is a foundational concept of information theory. This article is a primer for novices that presents an intuitive way of understanding, remembering, and/or reconstructing Shannon's Entropy metric…
A message of any sort can be regarded as a source of information. Claude. E. Shannon showed in the last century that information ("what we don't already know") is equivalent to the entropy as defined in statistical mechanics. A string of…
Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…
Several results of black holes thermodynamics can be considered as firmly founded and formulated in a very general manner. From this starting point we analyse in which way these results may give us the opportunity to gain a better…
Entropy measures have become increasingly popular as an evaluation metric for complexity in the analysis of time series data, especially in physiology and medicine. Entropy measures the rate of information gain, or degree of regularity in a…
We note that the observable part of universe at a certain time t_P is necessarily limited, when there is a beginning of universe. We argue that an appropriate spacetime region associated with an observer from tI to t_P is the causal diamond…
All the laws of physics are time-reversible. Time arrow emerges only when ensembles of classical particles are treated probabilistically, outside of physics laws, and the entropy and the second law of thermodynamics are introduced. In…
Entropy production is the crucial quantity characterizing irreversible phenomena and the second law of thermodynamics. Yet, a ubiquitous definition eludes consensus. Given that entropy production arises from incomplete access to…
The paper describes an approach to measuring convergence of an algorithm to its result in terms of an entropy-like function of partitions of its inputs of a given length. The goal is to look at the algorithmic data processing from the…
We investigate the thermodynamic arrow of time in a time-symmetrically recollapsing universe by calculating quantum mechanically the entropy production of a massive scalar field. It is found that even though the Hamiltonian has a…
By using entropy and entropy production, we calculate the steady flux of some phenomena. The method we use is a competition method, $S_S/\tau+\sigma={\it maximum}$, where $S_S$ is system entropy, $\sigma$ is entropy production and $\tau$ is…
We introduce the notion of metric entropy for a nonautonomous dynamical system given by a sequence of probability spaces and a sequence of measure-preserving maps between these spaces. This notion generalizes the classical concept of metric…
In [Sch05a], it is argued that Boltzmann's intuition, that the psychological arrow of time is necessarily aligned with the thermodynamic arrow, is correct. Schulman gives an explicit physical mechanism for this connection, based on the…
In this article we discuss a model used to introduce the concept of entropy with secondary school students. It can be used to discuss with students the reversibility of time, the tendency towards homogeneity and the link between probability…
Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…
The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…