Related papers: Utilizing time-series measurements for entropy pro…
This is a short review of the statistical mechanical definition of entropy production for systems composed of a large number of interacting components. Emphasis is on open systems driven away from equilibrium where the entropy production…
We consider a one-dimensional persisent random walk viewed as a deterministic process with a form of time reversal symmetry. Particle reservoirs placed at both ends of the system induce a density current which drives the system out of…
A recent result presented the expansion for the entropy rate of a Hidden Markov Process (HMP) as a power series in the noise variable $\eps$. The coefficients of the expansion around the noiseless ($\eps = 0$) limit were calculated up to…
In this note, the equilibrium curve of a thermodynamic system is used to depict entropy production in the process of thermalization with a reservoir. For the given initial and final equilibrium states of the system, the entropy production…
We present data-dependent learning bounds for the general scenario of non-stationary non-mixing stochastic processes. Our learning guarantees are expressed in terms of a data-dependent measure of sequential complexity and a discrepancy…
The universal typical-signal estimators of entropy and cross entropy based on the asymptotics of recurrence and waiting times play an important role in information theory. Building on their construction, we introduce and study universal…
The second law of thermodynamics governs that nonequilibrium systems evolve towards states of higher entropy over time. However, it does not specify the rate of this evolution and the role of fluctuations that impact the system's dynamics.…
Based on a variational expression for the steady-state entropy production rate in overdamped Langevin dynamics, we derive concrete upper bounds on the entropy production rate in various physical settings. For particles in a thermal…
Nonequilibrium systems, in particular living organisms, are maintained by irreversible transformations of energy that drive diverse functions. Quantifying their irreversibility, as measured by energy dissipation, is essential for…
The entropy produced when a quantum system is driven away from equilibrium can be decomposed in two parts, one related with populations and the other with quantum coherences. The latter is usually based on the so-called relative entropy of…
Inference of causality is central in nonlinear time series analysis and science in general. A popular approach to infer causality between two processes is to measure the information flow between them in terms of transfer entropy. Using…
There are many functional contexts where it is desirable to maintain a mesoscopic system in a nonequilibrium state. However, such control requires an inherent energy dissipation. In this article, we unify and extend a number of works on the…
Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of…
Time series are used in many domains including finance, engineering, economics and bioinformatics generally to represent the change of a measurement over time. Modeling techniques may then be used to give a synthetic representation of such…
We consider the standard thermodynamic processes with constraints, but with additional uncertainty about the control parameters. Motivated by inductive reasoning, we assign prior distribution that provides a rational guess about likely…
The excess work required to drive a stochastic system out of thermodynamic equilibrium through a time-dependent external perturbation is directly related to the amount of entropy produced during the driving process, allowing excess work and…
We obtain the large deviation function for entropy production of the medium and its distribution function for two-site totally asymmetric simple exclusion process(TASEP) and three-state unicyclic network. Since such systems are described…
Discrete diffusion models have emerged as a powerful paradigm for generative modeling on sequence data; however, the information-theoretic principles governing their reverse processes remain significantly less understood than those of their…
We study the entropy production in a macroscopic nonequilibrium system that undergoes an order-disorder phase transition. Entropy production is a characteristic feature of nonequilibrium dynamics with broken detailed balance. It is found…
Biological systems sense and extract information from fluctuating signals while operating under energetic constraints and limited resolution. We introduce a general chemical model in which a sensor, coupled to a signaling pathway activated…