Related papers: Comment on Phys. Rev. Lett. 110, 168702 (2013): Ca…
We demonstrate and characterize a first-principles approach to modeling the mass action dynamics of metabolism. Starting from a basic definition of entropy expressed as a multinomial probability density using Boltzmann probabilities with…
Self-organization is the autonomous assembly of a network of interacting components into a stable, organized pattern. This article shows that the process of self-assembly can be encoded in terms of evolutionary entropy, a statistical…
The concept of free energy has its origins in 19th century thermodynamics, but has recently found its way into the behavioral and neural sciences, where it has been promoted for its wide applicability and has even been suggested as a…
Using mobile phone records and information theory measures, our daily lives have been recently shown to follow strict statistical regularities, and our movement patterns are to a large extent predictable. Here, we apply entropy and…
Biological and engineered systems operate by coupling function to the transfer of heat and/or particles down a thermal or chemical gradient. In idealized \textit{deterministically} driven systems, thermodynamic control can be exerted…
There are three ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a…
I consider motivation and value-alignment in AI systems from the perspective of (constrained) entropy maximization. Though the structures encoding knowledge in any physical system can be understood as energetic constraints, only living…
We analyze spacetimes with horizons and study the thermodynamic aspects of causal horizons, suggesting that the resemblance between gravitational and thermodynamic systems has a deeper quantum mechanical origin. We find that the observer…
Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a…
Despite a century of use, the mechanism of nanoparticle-driven mechanical reinforcement of elastomers is unresolved. A major hypothesis attributes it to glassy interparticle bridges, supported by an observed inversion of the variation of…
This effort is focused on examining the behavior of reinforcement learning systems in personalization environments and detailing the differences in policy entropy associated with the type of learning algorithm utilized. We demonstrate that…
While often treated as abstract algorithmic properties, intelligence and computation are ultimately physical processes constrained by conservation laws. We introduce the Conservation-Congruent Encoding (CCE) framework as a unified,…
This study investigates entropy's potential for analyzing scientific research patterns across disciplines. Originating from thermodynamics, entropy now measures uncertainty and diversity in information systems. We examine Shannon Entropy,…
A thermodynamic formalism describing the efficiency of information learning is proposed, which is applicable for stochastic thermodynamic systems with multiple internal degree of freedom. The learning rate, entropy production rate (EPR),…
Active particle systems of interacting self-propelled particles offer a versatile framework for modeling complex systems. When employed to describe aspects of animal behavior, the complexity of animal movement and decision-making often…
In this study, we propose a theoretical framework to investigate the interactions between flexible polymer chains, specifically polyelectrolytes (PEs). By calculating the system's free energy while considering position-dependent mutual…
Recent theoretical progress in nonequilibrium thermodynamics, linking the physical principle of Maximum Entropy Production ("MEP") to the information-theoretical "MaxEnt" principle of scientific inference, together with conjectures from…
Thermodynamics and information have intricate interrelations. Often thermodynamics is considered to be the logical premise to justify that information is physical - through Landauer's principle -, thereby also linking information and…
Information plays an important role in our understanding of the physical world. We hence propose an entropic measure of information for any physical theory that admits systems, states and measurements. In the quantum and classical world,…
Matrix theories exhibit the phenomenon of spacetime emergence in certain regimes of their dynamics. In this work, I posit that the key to this emergence is a hierarchy between two timescales -- very slow modes that an observer measures plus…