Related papers: Gradient dynamics and entropy production maximizat…
In a first order theory of dissipative hydrodynamics, we have simulated hydrodynamic evolution of QGP fluid with dissipation due to shear viscosity only. Simulation confirms that compared to an ideal fluid, energy density or temperature of…
`Entropy' appears as driving force in many different evolution equations, both deterministic and stochastic, and in these equations this `entropy' also takes different forms. We show how all these examples can be understood as different…
Classical gradient systems have a linear relation between rates and driving forces. In generalized gradient systems we allow for arbitrary relations derived from general non-quadratic dissipation potentials. This paper describes two natural…
We propose a method to derive the stationary size distributions of a system, and the degree distributions of networks, using maximisation of the Gibbs-Shannon entropy. We apply this to a preferential attachment-type algorithm for systems of…
Thermodynamics teaches that if a system initially off-equilibrium is coupled to work sources, the maximum work that it may yield is governed by its energy and entropy. For finite systems this bound is usually not reachable. The maximum…
In the last few decades, some hypotheses for entropy production (EP) principles have been forwarded as possible candidates for organizational principles in non-linear non- equilibrium systems. Two important hypotheses will be studied: the…
The total entropy production and its three constituent components are described both as fluctuating trajectory-dependent quantities and as averaged contributions in the context of the continuous Markovian dynamics, described by stochastic…
Certain Markov processes, or deterministic evolution equations, have the property that they are dual to a stochastic process that exhibits extinction versus unbounded growth, i.e., the total mass in such a process either becomes zero, or…
Collections of self-propelled particles that move persistently by continuously consuming free energy are a paradigmatic example of active matter. In these systems, unlike Brownian "hot colloids", the breakdown of detailed balance yields a…
The field of complex networks studies a wide variety of interacting systems by representing them as networks. To understand their properties and mutual relations, the randomisation of network connections is a commonly used tool. However,…
By using entropy and entropy production, we calculate the steady flux of some phenomena. The method we use is a competition method, $S_S/\tau+\sigma={\it maximum}$, where $S_S$ is system entropy, $\sigma$ is entropy production and $\tau$ is…
Gradient Descent (GD) is a ubiquitous algorithm for finding the optimal solution to an optimization problem. For reduced computational complexity, the optimal solution $\mathrm{x^*}$ of the optimization problem must be attained in a minimum…
The interrelationships of the fundamental biological processes natural selection, mutation, and stochastic drift are quantified by the entropy rate of Moran processes with mutation, measuring the long-run variation of a Markov process. The…
Isolating slower dynamics from fast fluctuations has proven remarkably powerful, but how do we proceed from partial observations of dynamical systems for which we lack underlying equations? Here, we construct maximally-predictive states by…
We show that the principle of maximum entropy, a variational method appearing in statistical inference, statistical physics, and the analysis of stochastic dynamical systems, admits a geometric description from gauge theory. Using the…
Entropy serves as a central observable in equilibrium thermodynamics. However, many biological and ecological systems operate far from thermal equilibrium. Here we show that entropy production can characterize the behavior of such…
Fluctuating entropy production is studied for a set of linearly coupled complex fields. The general result is applied to non-equilibrium fluctuating hydrodynamic equations for coarse-grained fields (density, temperature and velocity), in…
Depending on context, the term entropy is used for a thermodynamic quantity, a~measure of available choice, a quantity to measure information, or, in the context of statistical inference, a maximum configuration predictor. For systems in…
Variational principles play a fundamental role in deriving evolution equations of physics. They are working well in case of nondissipative evolution but for dissipative systems they are not unique, not predictive and not constructive. With…
Autoregressive generative models -- including Transformers, recurrent neural networks, classical Kalman filters, state space models, and Mamba -- all generate sequences by sampling each output from a deterministic summary of the past,…