Related papers: Decision Making in the Arrow of Time
We consider a generic class of stochastic particle-based models whose state at an instant in time is described by a set of continuous degrees of freedom (e.g. positions), and the length of this set changes stochastically in time due to…
Measurements of any property of a microscopic system are bound to show significant deviations from the average, due to thermal fluctuations. For time-integrated currents such as heat, work or entropy production in a steady state, it is in…
The entropy production is one of the most essential features for systems operating out of equilibrium. The formulation for discrete-state systems goes back to the celebrated Schnakenberg's work and hitherto can be carried out when for each…
We show that the dissipation rate bounds the rate at which physical processes can be performed in stochastic systems far from equilibrium. Namely, for rare processes we prove the fundamental tradeoff $\langle \dot S_\text{e} \rangle…
We consider the stochastic ranking process with the jump times of the particles determined by Poisson random measures. We prove that the joint empirical distribution of scaled position and intensity measure converges almost surely in the…
We derive a simple closed analytical expression for the total entropy production along a single stochastic trajectory of a Brownian particle diffusing on a periodic potential under an external constant force. By numerical simulations we…
The mean completion time of a stochastic process may be rendered finite and minimised by a judiciously chosen restart protocol, which may either be stochastic or deterministic. Here we study analytically an arbitrary stochastic search…
We propose a random adaptation variant of time-varying distributed averaging dynamics in discrete time. We show that this leads to novel interpretations of fundamental concepts in distributed averaging, opinion dynamics, and distributed…
Consider a regenerative storage process with a nondecreasing L\'evy input (subordinator) such that every cycle may be split into two periods. In the first (off) the output is shut off and the workload accumulates. This continues until some…
We derive an Ito stochastic differential equation for entropy production in nonequilibrium Langevin processes. Introducing a random-time transformation, entropy production obeys a one-dimensional drift-diffusion equation, independent of the…
This paper provides a statistical method to test whether a system that performs a binary sequential hypothesis test is optimal in the sense of minimizing the average decision times while taking decisions with given reliabilities. The…
We prove that a time series satisfying a (linear) multivariate autoregressive moving average (VARMA) model satisfies the same model assumption in the reversed time direction, too, if all innovations are normally distributed. This…
For chemical reaction networks described by a master equation, we define energy and entropy on a stochastic trajectory and develop a consistent nonequilibrium thermodynamic description along a single stochastic trajectory of reaction…
Recent large deviation results have provided general lower bounds for the fluctuations of time-integrated currents in the steady state of stochastic systems. A corollary are so-called thermodynamic uncertainty relations connecting precision…
The validity of the fluctuation theorem for entropy production as deduced from the observation of trajectories implicitly requires that all slow degrees of freedom are accessible. We experimentally investigate the role of hidden slow…
We introduce a deterministic, time-reversible version of the Ehrenfest urn model. The distribution of first-passage times from equilibrium to non-equilibrium states and vice versa is calculated. We find that average times for transition to…
We consider a stochastic process which is (a) described by a continuous-time Markov chain on only short time-scales and (b) constrained to conserve a number of hidden quantities on long time-scales. We assume that the transition matrix of…
We present the stochastic thermodynamics analysis of an open quantum system weakly coupled to multiple reservoirs and driven by a rapidly oscillating external field. The analysis is built on a modified stochastic master equation in the…
This article considers the average optimality for a continuous-time Markov decision process with Borel state and action spaces and an arbitrarily unbounded nonnegative cost rate. The existence of a deterministic stationary optimal policy is…
Stochastic restart may drastically reduce the expected run time of a computer algorithm, expedite the completion of a complex search process, or increase the turnover rate of an enzymatic reaction. These diverse first-passage-time (FPT)…