Related papers: Comment on Phys. Rev. Lett. 110, 168702 (2013): Ca…
Using the stochastic thermodynamics, we determine the entropy production and the dynamic heat capacity of systems subject to a sinusoidally time dependent temperature, in which case the systems are permanently out of thermodynamic…
An entropic-force scenario, i.e., entropic cosmology, assumes that the horizon of the universe has an entropy and a temperature. In the present study, in order to examine entropic cosmology, we derive entropic-force terms not only from the…
Language prediction is constrained by informational entropy intrinsic to language, such that there exists a limit to how accurate any language model can become and equivalently a lower bound to language compression. The most efficient…
The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been…
A primary objective of the NASA Earth-Sun Exploration Technology Office is to understand the observed Earth climate variability, thus enabling the determination and prediction of the climate's response to both natural and human-induced…
Adaptation in a fluctuating environment is a process of fueling environmental information to gain fitness. Living systems have gradually developed strategies for adaptation from random and passive diversification of the phenotype to more…
Thermodynamics is commonly presented as a theory of macroscopic systems in stable equilibrium, built upon assumptions of extensivity and scaling with system size. In this paper, we present a universal formulation of the elementary…
We present a general holistic theory for the organization of complex networks, both human-engineered and naturally-evolved. Introducing concepts of value of interactions and satisfaction as generic network performance measures, we show that…
The process of protein folding from an unfolded state to a biologically active, folded conformation is governed by many parameters e.g the sequence of amino acids, intermolecular interactions, the solvent, temperature and chaperon…
The rapid scaling of artificial intelligence models has revealed a fundamental tension between model capacity (storage) and inference efficiency (computation). While classical information theory focuses on transmission and storage limits,…
The question of deriving general force/flux relationships that apply out of the linear response regime is a central topic of theories for nonequilibrium statistical mechanics. This work applies an information theory perspective to compute…
The principle of entropy increase is not only the basis of statistical mechanics, but also closely related to the irreversibility of time, the origin of life, chaos and turbulence. In this paper, we first discuss the dynamic system…
In this paper, we analyze the relationship between entropy and information in the context of the mixing process of two identical ideal gases. We will argue that entropy has a special information-based feature that is enfolded in the…
A major part of the many thermally driven processes in our natural environment as well as in engineering solutions of Carnot-type machinery is based on the second law of thermodynamics (or principle of entropy increase). An interesting link…
The concept of entropy connects the number of possible configurations with the number of variables in large stochastic systems. Independent or weakly interacting variables render the number of configurations scale exponentially with the…
Most three dimensional constitutive relations that have been developed to describe the behavior of bodies are correlated against one dimensional and two dimensional experiments. What is usually lost sight of is the fact that infinity of…
The elastic response is studied of a single flexible chain grafted on a rigid plane and an ensemble of non-interacting tethered chains. It is demonstrated that the entropic theory of rubber elasticity leads to conclusions that disagree with…
In a glassy system different degrees of freedom have well-separated characteristic times, and are described by different temperatures. The stationary state is essentially non-equilibrium. A generalized statistical thermodynamics is…
As Nature's version of machine learning, evolution has solved many extraordinarily complex problems, none perhaps more remarkable than learning to harness an increase in chemical entropy (disorder) to generate directed chemical forces…
Solutes added to solutions often dramatically impact molecular processes ranging from the suspension or precipitation of colloids to biomolecular associations and protein folding. Here we revisit the origins of the effective attractive…