Related papers: Memory and entropy
Here we define and study the properties of retrodictive inference. We derive equations relating retrodiction entropy and thermodynamic entropy, and as a special case, show that under equilibrium conditions, the two are identical. We…
We propose a new self-organizing mechanism behind the emergence of memory in which temporal sequences of stimuli are transformed into spatial activity patterns. In particular, the memory emerges despite the absence of temporal correlations…
We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…
The chemical reactions are very complex, and include oscillation, condensation, catalyst and self-organization, etc. In these case changes of entropy may increase or decrease. The second law of thermodynamics is based on an isolated system…
We review of the interface between (theoretical) physics and information for non-experts. The origin of information as related to the notion of entropy is described, first in the context of thermodynamics then in the context of statistical…
Gathering the most information by picking the least amount of data is a common task in experimental design or when exploring an unknown environment in reinforcement learning and robotics. A widely used measure for quantifying the…
Particle motion at the micro-scale is an incessant tug-of-war between thermal fluctuations and applied forces on one side, and the strong resistance exerted by fluid viscosity on the other. Friction is so strong that completely neglecting…
We present exact results for two complementary measures of spatial structure generated by 1D spin systems with finite-range interactions. The first, excess entropy, measures the apparent spatial memory stored in configurations. The second,…
Open quantum systems are highly relevant, both for practical applications as well as for fundamental questions about the nature of information and its transfer, encompassing for example decoherence and memory effects. Quantum mechanics…
In thermodynamics one considers thermal systems and the maximization of entropy subject to the conservation of energy. A consequence is Landauer's erasure principle, which states that the erasure of 1 bit of information requires a minimum…
The emergence of a direction of time in statistical mechanics from an underlying time-reversal-invariant dynamics is explained by examining a simple model. The manner in which time-reversal symmetry is preserved and the role of initial…
We attempt to describe geometry in terms of informational quantities for the universe considered as a finite ensemble of correlated quantum particles. As the main dynamical principle, we use the conservation of the sum of all kinds of…
A few decades after Hill's work on nano-thermodynamics, the development of a thermodynamic framework, to account consistently for the fluctuations of small systems due to their interactions with the surrounding environment, is still…
Life on earth is distinguished by long-lived correlations in time. The patterns of material organization that characterize living organisms today are contingent on events that occurred billions of years ago. This contingency is a necessary…
A microscopic understanding of the thermodynamic entropy in quantum systems has been a mystery ever since the invention of quantum mechanics. In classical physics, this entropy is believed to be the logarithm of the volume of phase space…
This paper studies the structure of several real-world traces (including Facebook, High-Performance Computing, Machine Learning, and simulation generated traces) and presents a systematic approach to quantify and compare the structure of…
Entropic uncertainty relations demonstrate the intrinsic uncertainty of nature from an information-theory perspective. Recently, a quantum-memory-assisted entropic uncertainty relation for multiple measurements was proposed by Wu $et\ al.$…
When constructing models of the world, we aim for optimal compressions: models that include as few details as possible while remaining as accurate as possible. But which details -- or features measured in data -- should we choose to include…
In many real-world situations, there are constraints on the ways in which a physical system can be manipulated. We investigate the entropy production (EP) and extractable work involved in bringing a system from some initial distribution $p$…
Memory effects are ubiquitous in nature and are particularly relevant at the nanoscale where the dynamical properties of electrons and ions strongly depend on the history of the system, at least within certain time scales. We review here…