Related papers: Lost work and exergy: two views of the same concep…
By training linear physical networks to learn linear transformations, we discern how their physical properties evolve due to weight update rules. Our findings highlight a striking similarity between the learning behaviors of such networks…
Entropy is the distinguishing and most important concept of our efforts to understand and regularize our observations of a very large class of natural phenomena, and yet, it is one of the most contentious concepts of physics. In this…
A vast concourse of events and phenomena occur in nature that may be interrelated by a entropy-maximization technique that provides a comprehensible explanation of a range of physical problems, integrating in a new framework the universal…
Entropy is one of the key thermodynamic variables reflecting changes in the state of matter. Unlike other thermodynamic variables, it is well-defined also for nonequilibrium steady states through its relation to information. Applying this…
The mechanism of irreversible dynamics in the systems with mixing is analyzed. The procedure of splitting of system on equilibrium subsystems and studying of dynamics of one of them under condition of its interaction with other subsystems…
We address entropic uncertainty relations between time and energy or, more precisely, between measurements of an observable $G$ and the displacement $r$ of the $G$-generated evolution $e^{-ir G}$. We derive lower bounds on the entropic…
In the theory of special relativity, energy can be found in two forms: kinetic energy and rest mass. Potential energy of a body is actually stored under the form of rest mass, interaction energy too, temperature is not. Information acquired…
A notion of entropy is introduced for causal fermion systems. This entropy is a measure of the state of disorder of a causal fermion system at a given time compared to the vacuum. The definition is given both in the finite and…
We propose an extension of the principle of virtual work of mechanics to random dynamics of mechanical systems. The total virtual work of the interacting forces and inertial forces on every particle of the system is calculated by…
Non-reciprocal interactions are present in many systems out of equilibrium. The rate of entropy production is a measure that quantifies the time irreversibility of a system, and thus how far it is from equilibrium. In this work, we…
This chapter deals with our recent attempt to extend the notion of equilibrium (EQ) entropy to nonequilibrium (NEQ) systems so that it can also capture memory effects. This is done by enlarging the equilibrium state space by introducing…
Imaging systems are commonly described using resolution, contrast, and signal-to-noise ratio, but these quantities do not provide a general account of how physical transformations affect the flow of information. This paper introduces an…
Induction is the process by which we obtain predictive laws or theories or models of the world. We consider the structural aspect of induction. We answer the question as to whether we can find a finite and minmalistic set of operations on…
One observes that a considerable level of confusion remains about some of those aspects of irreversibility, entropy generation and `the arrow of time' which actually are well understood. This demands that great care must be taken in any…
The erasure of information is fundamentally an irreversible logical operation, carrying profound consequences for the energetics of computation and information processing. We investigate the thermodynamic costs associated with erasing (and…
Some general considerations on the notion of entropy in physics are presented. An attempt is made to clarify the question of the differentiation between physical entropy (the Clausius-Boltzmann one) and quantities called entropies…
Cross-entropy loss is the standard metric used to train classification models in deep learning and gradient boosting. It is well-known that this loss function fails to account for similarities between the different values of the target. We…
The association of information with entropy has been argued on plausibility arguments involving the operation of imaginary engines and beings, and it is not a universal theorem. In this paper, a theorem by Charles Bennett on reversible…
The thermodynamic definition of entropy can be extended to nonequilibrium systems based on its relation to information. To apply this definition in practice requires access to the physical system's microstates, which may be prohibitively…
Two qualitatively different ways of driving a physical system out of equilibrium, time-dependent and non-conservative forcing, are reflected by the decomposition of the system's entropy production into excess and housekeeping parts. We show…