Related papers: The infinite information gap between mathematical …
Information theory has explained the organization of many biological phenomena, from the physiology of sensory receptive fields to the variability of certain DNA sequence ensembles. Some scholars have proposed that information should…
Using information theory we derive a thermodynamics for systems evolving under a collective motion, i.e. under a time-odd constraint. An illustration within the Lattice gas Model is given for two model cases: a collision between two complex…
One of the most ubiquitous problems in optimization is that of finding all the elements of a finite set at which a function $f$ attains its minimum (or maximum). When the codomain of $f$ is equipped with a total order, it is easy to…
Due to entropic effects, it is possible that generic high-energy states of a quantum or classical system are ordered. This leads to spontaneous symmetry breaking at arbitrarily high temperatures. We present minimal models of entropic order…
It is usual to identify initial conditions of classical dynamical systems with mathematical real numbers. However, almost all real numbers contain an infinite amount of information. I argue that a finite volume of space can't contain more…
Ascribing to inanimate matter a possibility to receive, work on and transfer information allows us to explain quantum-mechanical phenomena including "delayed-choice"- and "Einstein-Podolsky-Rosen (EPR)"-type experiments adhering to the…
The configurational entropy is one of the most important thermodynamic quantities characterizing supercooled liquids approaching the glass transition. Despite decades of experimental, theoretical, and computational investigation, a widely…
Recent theoretical progress in nonequilibrium thermodynamics, linking the physical principle of Maximum Entropy Production ("MEP") to the information-theoretical "MaxEnt" principle of scientific inference, together with conjectures from…
Bounded rationality, that is, decision-making and planning under resource limitations, is widely regarded as an important open problem in artificial intelligence, reinforcement learning, computational neuroscience and economics. This paper…
Extremal principles are fundamental in our interpretation of phenomena in nature. One of the best known examples is the second law of thermodynamics, governing most physical and chemical systems and stating the continuous increase of…
The question of deriving general force/flux relationships that apply out of the linear response regime is a central topic of theories for nonequilibrium statistical mechanics. This work applies an information theory perspective to compute…
Informational entropy is often identified as physical entropy. This is surprising because the two quantities are differently defined and furthermore the former is a subjective quantity while the latter is an objective one. We describe the…
How condensed-matter simulations depend on the number of molecules being simulated ($N$) is sometimes itself a valuable piece of information. Liquid crystals provide a case in point. Light scattering and $2d$-IR experiments on…
The centuries-long practice of the teaching turned mechanics into an academic construct detached from its underlying science, the physics of macroscopic bodies. In particular, the regularities that delineate the scope of validity of…
Passive states, i.e., those states from which no work can be extracted via unitary operations, play an important role in the foundations and applications of quantum thermodynamics. They generalize the familiar Gibbs thermal states, which…
Quantum computing is finding promising applications in optimization, machine learning and physics, leading to the development of various models for representing quantum information. Because these representations are often studied in…
We present an information-theoretic framework for understanding overfitting and underfitting in machine learning and prove the formal undecidability of determining whether an arbitrary classification algorithm will overfit a dataset.…
While the equilibrium properties, states, and phase transitions of interacting systems are well described by statistical mechanics, the lack of suitable state parameters has hindered the understanding of non-equilibrium phenomena in diverse…
How far can we take the resource theoretic approach to explore physics? Resource theories like LOCC, reference frames and quantum thermodynamics have proven a powerful tool to study how agents who are subject to certain constraints can act…
In quantum information processing it may be possible to have efficient computation and secure communication beyond the limitations of classical systems. In a fundamental point of view, however, evolution of quantum systems by the laws of…