Related papers: Non-Markovianity increases transition path probabi…
The interplay between non-Markovian dynamics and driving fields in the survival of entanglement between two non-degenerate oscillators is considered here. Based on exact analytical results for the non-Markovian dynamics of two…
The path probability of stochastic motion of non dissipative or quasi-Hamiltonian systems is investigated by numerical experiment. The simulation model generates ideal one-dimensional motion of particles subject only to conservative forces…
Mixed observable Markov decision processes (MOMDPs) are a modeling framework for autonomous systems described by both fully and partially observable states. In this work, we study the problem of synthesizing a control policy for MOMDPs that…
The quantification and characterization of non-Markovian dynamics in quantum systems is an essential endeavor both for the theory of open quantum systems and for a deeper understanding of the effects of non-Markovian noise on quantum…
Simulation methods based on stochastic realizations of state vector evolutions are commonly used tools to solve open quantum system dynamics, both in the Markovian and non-Markovian regime. Here, we address the question of waiting time…
We investigate the non-Markovian characteristics in continuous measurement of a charge qubit by a quantum point contact. The backflow of information from the reservoir to the system in the non-Markovian domain gives rise to strikingly…
One of the most widely used methods for solving average cost MDP problems is the value iteration method. This method, however, is often computationally impractical and restricted in size of solvable MDP problems. We propose acceleration…
This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…
We consider a stationary Markovian evolution with values on a disjointly partitioned set space $I\sqcup {\cal E}$. The evolution is visible (in the sense of knowing the transition probabilities) on the states in $I$ but not for the states…
The reaction dynamics of O(3P) + O2(3Sigma_g-) collisions in the O3(1A') electronic ground state is characterized on a high-level MRCI+Q/aug-cc-pVQZ potential energy surface represented as a reproducing kernel. For the atom exchange…
We present a detailed study of the non-Markovian two-state system dynamics for the regime of incoherent quantum tunneling. Using perturbation theory in the system tunneling amplitude $\Delta$, and in the limit of strong system-bath…
This paper provides full classification of dynamics for continuous time Markov chains (CTMCs) on the non-negative integers with polynomial transition rate functions. Such stochastic processes are abundant in applications, in particular in…
Non-stationary environments are challenging for reinforcement learning algorithms. If the state transition and/or reward functions change based on latent factors, the agent is effectively tasked with optimizing a behavior that maximizes…
Given Markov chains and Markov decision processes (MDPs) whose transitions are labelled with non-negative integer costs, we study the computational complexity of deciding whether the probability of paths whose accumulated cost satisfies a…
A Non-Markovian generalization of one-dimensional Contact Process (CP) is being introduced in which every particle has an age and will be annihilated at its maximum age $\tau$. There is an absorbing state phase transition which is…
We prove a sample path Large Deviation Principle (LDP) for a class of jump processes whose rates are not uniformly Lipschitz continuous in phase space. Building on it we further establish the corresponding Wentzell-Freidlin (W-F) (infinite…
Isotope shift of atomic spectra is considered as a probe of new interaction between electrons and neutrons in atoms. We employ the method of seeking a breakdown of King's linearity in the isotope shifts of two atomic transitions. In the…
We explore the connection between two recently introduced notions of non-Markovian quantum dynamics and the validity of the so-called quantum regression theorem. While non-Markovianity of a quantum dynamics has been defined looking at the…
Estimating the transition dynamics of controlled Markov chains is crucial in fields such as time series analysis, reinforcement learning, and system exploration. Traditional non-parametric density estimation methods often assume independent…
Via operator theoretic methods, we formalize the concentration phenomenon for a given observable `$r$' of a discrete time Markov chain with `$\mu_{\pi}$' as invariant ergodic measure, possibly having support on an unbounded state space. The…