Related papers: Non-Markovianity increases transition path probabi…
Interval Markov decision processes are a class of Markov models where the transition probabilities between the states belong to intervals. In this paper, we study the problem of efficient estimation of the optimal policies in Interval…
In this work we study how the non-Markovian character of the dynamics can affect the thermodynamic performance of a quantum thermal engine, by analysing the maximum power output of Carnot and Otto cycles departing from the quasi-static and…
Non-homogeneous chain environments (e.g. segmented ion traps) are investigated through an exact diagonalization approach. Different spectral densities, including band-gaps, can be engineered to separately assess memory effects. Environment…
We develop a qualitative theory of Markov Decision Processes (MDPs) and Partially Observable MDPs that can be used to model sequential decision making tasks when only qualitative information is available. Our approach is based upon an…
A path information is defined in connection with different possible paths of irregular dynamic systems moving in its phase space between two points. On the basis of the assumption that the paths are physically differentiated by their…
Principled prediction of when and where links form in complex networks is a fundamental problem. We derive a closed-form non-Markovian expression for next-step connection probabilities that unifies latent hyperbolic geometry with long-range…
Real-world reinforcement learning is often \emph{nonstationary}: rewards and dynamics drift, accelerate, oscillate, and trigger abrupt switches in the optimal action. Existing theory often represents nonstationarity with coarse-scale models…
The nonincreasing feature of temporal quantum steering under a completely positive trace-preserving (CPTP) map, as proposed by Chen, et al. in Phys. Rev. Lett. 116, 020503 (2016), has been considered as a practical measure of…
Stochastic search processes are ubiquitous in nature and are expected to become more efficient when equipped with a memory, where the searcher has been before. A natural realization of a search process with long-lasting memory is a…
We study the random acceleration model, which is perhaps one of the simplest, yet nontrivial, non-Markov stochastic processes, and is key to many applications. For this non-Markov process, we present exact analytical results for the…
Superdense coding is a significant technique widely used in quantum information processing. Indeed, it consists of sending two bits of classical information using a single qubit, leading to faster and more efficient quantum communication.…
Recently, a large class of quantum non-Markovian piecewise dynamics for an open quantum system obeying closed evolution equations has been introduced [B. Vacchini, Phys. Rev. Lett. 117, 230401 (2016)]. These dynamics have been defined in…
Due to the time scale problem, rare events are not accessible by straight forward molecular dynamics. The presence of multiple reaction channels complicates the problem even further. The feasibility of the standard free energy based methods…
A popular approach to solving a decision process with non-Markovian rewards (NMRDP) is to exploit a compact representation of the reward function to automatically translate the NMRDP into an equivalent Markov decision process (MDP) amenable…
In this paper we propose a new method for approximating the nonstationary moment dynamics of one dimensional Markovian birth-death processes. By expanding the transition probabilities of the Markov process in terms of Poisson-Charlier…
An analysis of the network defined by the potential energy minima of multi-atomic systems and their connectivity via reaction pathways that go through transition states allows to understand important characteristics like thermodynamic,…
We apply the recently proposed quantum probing protocols with an unknown system-probe coupling to probe the convex coefficients in mixtures of commuting states. By using two reference states instead of one as originally suggested, we are…
In nuclear fusion and fission, fluctuation and dissipation arise due to the coupling of collective degrees of freedom with internal excitations. Close to the barrier, both quantum, statistical and non-Markovian effects are expected to be…
Most biochemical reactions in living cells are open systems interacting with environment through chemostats to exchange both energy and materials. At a mesoscopic scale, the number of each species in those biochemical reactions can be…
We consider a model of interacting neurons where the membrane potentials of the neurons are described by a multidimensional piecewise deterministic Markov process (PDMP) with values in ${\mathbb R}^N, $ where $ N$ is the number of neurons…