Related papers: A discussion on maximum entropy production and inf…
This paper develops an envelope-based approach to establish a link between information and queueing theory. Unlike classical, equilibrium information theory, information envelopes focus on the dynamics of sources and coders, using functions…
An information theory description of finite systems explicitly evolving in time is presented. We impose a MaxEnt variational principle on the Shannon entropy at a given time while the constraints are set at a former time. The resulting…
We study the maximum achievable differential entropy at the output of a system assigning to each input X the sum X+N, with N a given noise with probability law absolutely continuous with respect to the Lebesgue measure and where the input…
The objective of this manuscript consists in a critical consideration of the Maximum Entropy Production Principle (MEPP) and an analysis of its corollaries for some (primarily morphological) nonequilibrium phase transitions.
In many complex systems, whether biological or artificial, the thermodynamic costs of communication among their components are large. These systems also tend to split information transmitted between any two components across multiple…
Entropy production (EP) is known as a fundamental quantity for measuring the irreversibility of processes in thermal equilibrium and states far from equilibrium. In stochastic thermodynamics, the EP becomes more visible in terms of the…
A simplified climate model based on maximum entropy production, described by a variational principle, is revisited and an analytical solution to its Euler-Lagrange equation is found. Mindful of controversy about maximum or minimum entropy…
A maximum entropy-based framework is presented for the synthesis of projections from multiple Earth climate models. This identifies the most representative (most probable) model from a set of climate models -- as defined by specified…
This thesis focuses on three fundamental aspects of biological systems; namely, entropy production, Bayesian mechanics, and the free-energy principle. The contributions are threefold: 1) We compute the entropy production for a greater class…
Maximum entropy (MAXENT) method has a large number of applications in theoretical and applied machine learning, since it provides a convenient non-parametric tool for estimating unknown probabilities. The method is a major contribution of…
The minimum rate of entropy production (MREP) and the least dissipation energy (LDE) principles are re-examined concerning continuous systems in stationary nonequilibrium states. By means of simple considerations on coefficients of…
The maximum entropy principle, as applied to quantum systems, is a fundamental prescript positing that for a quantum system for which we only have partial knowledge, the maximum entropy state consistent with the partial knowledge is a…
We look at multiparticle production processes from the Information Theory point of view, both in its extensive and nonextensive versions. Examples of both symmetric (like pp or AA) and asymmetric (like pA) collisions are considered showing…
It is known that the thermal conductivity of a dilute gas can be derived by using kinetic theory. We present here a new derivation by starting with two known entropy production principles: the steepest entropy ascent (SEA) principle and the…
We are working to develop automated intelligent agents, which can act and react as learning machines with minimal human intervention. To accomplish this, an intelligent agent is viewed as a question-asking machine, which is designed by…
Entropy production quantifies the breaking of time-reversal symmetry in non-equilibrium systems. Here, we develop a direct method to obtain closed, tractable expressions for entropy production in a broad class of dynamical density…
Most of the existing classification methods are aimed at minimization of empirical risk (through some simple point-based error measured with loss function) with added regularization. We propose to approach this problem in a more information…
The form invariance of pseudoadditivity is shown to determine the structure of nonextensive entropies. Nonextensive entropy is defined as the appropriate expectation value of nonextensive information content, similar to the definition of…
Convex integration has revealed that the Euler system of gas dynamics is ill-posed in the class of weak solutions even if the entropy inequality is imposed as an additional constraint. A natural question arises, namely, if a physically…
The rate of entropy production by a stochastic process quantifies how far it is from thermodynamic equilibrium. Equivalently, entropy production captures the degree to which detailed balance and time-reversal symmetry are broken. Despite…