Related papers: Time Evolution of Entropy in a Growth model: Depen…

The effective evolution of an inhomogeneous cosmological model may be described in terms of spatially averaged variables. We point out that in this context, quite naturally, a measure arises which is identical to a fluid model of the…

Here we deconstruct, and then in a reasoned way reconstruct, the concept of "entropy of a system," paying particular attention to where the randomness may be coming from. We start with the core concept of entropy as a COUNT associated with…

We propose an interpretation of the expansion and acceleration of the Universe from an information theoretic viewpoint. We obtain the time evolution of the configuration entropy of the mass distribution in a static Universe and show that…

Most of the DNA that composes a complex organism is non-coding and defined as junk. Even the coding part is composed of genes that affect the phenotype differently. Therefore, a random mutation has an effect on the specimen fitness that…

Entropy always increases monotonically in a closed system but complexity increases at first and then decreases as equilibrium is approached. Commonsense information-related definitions for entropy and complexity demonstrate that complexity…

Entropy is a measure of self-information which is used to quantify losses. Entropy was developed in thermodynamics, but is also used to compare probabilities based on their deviating information content. Corresponding model uncertainty is…

Testable conditional probabilities appear to be restricted to single hypersurfaces (marvelous moments) and depend only on stationary observables. Observable evolution, such as a change of entropy, should be expressed as a dependence upon…

The information shared among observables representing processes of interest is traditionally evaluated in terms of macroscale measures characterizing aggregate properties of the underlying processes and their interactions. Traditional…

Graph based entropy, an index of the diversity of events in their distribution to parts of a co-occurrence graph, is proposed for detecting signs of structural changes in the data that are informative in explaining latent dynamics of…

Complex structures often emerge from initially homogeneous or weakly correlated states. We address the apparent tension between this ordering and entropy growth through a unified framework combining semi-microscopic phase-space dynamics,…

We show that the naive application of the maximum entropy principle can yield answers which depend on the level of description, i.e. the result is not invariant under coarse-graining. We demonstrate that the correct approach, even for…

In the above mentioned paper by J. Dunkel and S. A. Trigger [Phys. Rev. {\bf A 71}, 052102, (2005)] a hypothesis has been pursued that the loss of information associated with the quantum evolution of pure states, quantified in terms of an…

The emergence of a direction of time in statistical mechanics from an underlying time-reversal-invariant dynamics is explained by examining a simple model. The manner in which time-reversal symmetry is preserved and the role of initial…

Entropy relates the fast, microscopic behaviour of the elements in a system to its slow, macroscopic state. We propose to use it to explain how, as complexity theory suggests, small scale decisions of individuals form cities. For this, we…

Information entropy is applied to the analysis of time series generated by dynamical systems. Complexity of a temporal or spatio-temporal signal is defined as the difference between the sum of entropies of the local linear regions of the…

Many dynamical phenomena in complex systems concern spreading that plays out on top of networks with changing architecture over time -- commonly known as temporal networks. A complex system's proneness to facilitate spreading phenomena,…

The concept of entropy connects the number of possible configurations with the number of variables in large stochastic systems. Independent or weakly interacting variables render the number of configurations scale exponentially with the…

Given entropy's central role in multiple areas of physics and science, one important task is to develop a systematic and unifying approach to defining entropy. Games of chance become a natural candidate for characterising the uncertainty of…

The dynamics of molecular collisions in a macroscopic body are encoded by the parameter Thermodynamic entropy - a statistical measure of the number of molecular configurations that correspond to a given macrostate. Directionality in the…

Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building…