Related papers: Non-Markovianity increases transition path probabi…
It is known that the time evolution of a subsystem from an initial state to two later times, t1, t2 (t2 > t1), are both completely positive (CP) but it is shown here that in the intermediate times between t1 and t2, in general, it need not…
We introduce a method to construct non-Markovian variants of completely positive (CP) dynamical maps, particularly, qubit Pauli channels. We identify non-Markovianity with the breakdown in CP-divisibility of the map, i.e., appearance of a…
Finding optimal reaction coordinates and predicting accurate kinetic rates for activated processes are two of the foremost challenges of molecular simulations. We introduce an algorithm that tackles the two problems at once: starting from a…
Adaptive multilevel splitting algorithms have been introduced rather recently for estimating tail distributions in a fast and efficient way. In particular, they can be used for computing the so-called reactive trajectories corresponding to…
Identifying non-Markovianity with non-divisibility, we propose a measure for non-Markovinity of quantum process. Three examples are presented to illustrate the non-Markovianity, measure for non-Markovianity is calculated and discussed.…
Although a number of measures for quantum non-Markovianity have been proposed recently, it is still an open question whether these measures directly characterize the memory effect of the environment, i.e., the dependence of a quantum state…
Markov decision processes (MDPs) are a popular model for performance analysis and optimization of stochastic systems. The parameters of stochastic behavior of MDPs are estimates from empirical observations of a system; their values are not…
Reinforcement learning in non-stationary environments is challenging due to abrupt and unpredictable changes in dynamics, often causing traditional algorithms to fail to converge. However, in many real-world cases, non-stationarity has some…
Complex networks, comprised of individual elements that interact with each other through reaction channels, are ubiquitous across many scientific and engineering disciplines. Examples include biochemical, pharmacokinetic, epidemiological,…
We study non-parametric estimation of the value function of an infinite-horizon $\gamma$-discounted Markov reward process (MRP) using observations from a single trajectory. We provide non-asymptotic guarantees for a general family of…
Continuous-time Markov chains on non-negative integers can be used for modeling biological systems, population dynamics, and queueing models. Qualitative behaviors of birth-and-death models, typical examples of such one-dimensional…
While there is an extensive body of research on the analysis of Value Iteration (VI) for discounted cumulative-reward MDPs, prior work on analyzing VI for (undiscounted) average-reward MDPs has been limited, and most prior results focus on…
Chemical reactions can be modelled via diffusion processes conditioned to make a transition between specified molecular configurations representing the state of the system before and after the chemical reaction. In particular the model of…
By modeling the interaction of a system with an environment through a renewal approach, we demonstrate that completely positive non-Markovian dynamics may develop some unexplored non-standard statistical properties. The renewal approach is…
The reaction coordinate describing a transition between reactant and product is a fundamental concept in the theory of chemical reactions. Within transition-path theory, a quantitative definition of the reaction coordinate is found in the…
A universal definition of non-Markovianity for open systems dynamics is proposed. It is extended from the classical definition to the quantum realm by showing that a `transition' from the Markov to the non-Markov regime occurs when the…
Entropy production plays a fundamental role in nonequilibrium thermodynamics to quantify the irreversibility of open systems. Its positivity can be ensured for a wide class of setups, but the entropy production rate can become negative…
We investigate non-Markovian barrier-crossing kinetics of a massive particle in one dimension in the presence of a memory function that is the sum of two exponentials with different memory times $\tau_1$ and $\tau_2$. Our Langevin…
We consider an anisotropic spin-1/2 XY Heisenberg chain in the presence of a transverse magnetic field. Selecting the nearest neighbor pair spins as an open quantum system, the rest of the chain plays the role of the structured environment.…
Traditional thermodynamic trade-off relations usually apply to quantities that depend linearly on probability distributions. In contrast, many important information-theoretic measures, such as entropies, are nonlinear and therefore…