Related papers: Stochastic approximation in non-markovian environm…
Unlike equilibrium statistical mechanics, with its well-established foundations, a similar widely-accepted framework for non-equilibrium statistical mechanics (NESM) remains elusive. Here, we review some of the many recent activities on…
Non-homogeneous chain environments (e.g. segmented ion traps) are investigated through an exact diagonalization approach. Different spectral densities, including band-gaps, can be engineered to separately assess memory effects. Environment…
This paper compiles several aspects of the dynamics of stochastic approximation algorithms with Markov iterate-dependent noise when the iterates are not known to be stable beforehand. We achieve the same by extending the lock-in probability…
A non-Markovian stochastic Schroedinger equation for a quantum system coupled to an environment of harmonic oscillators is presented. Its solutions, when averaged over the noise, reproduce the standard reduced density operator without any…
Memoryless processes are ubiquitous in nature, in contrast with the mathematics of open systems theory, which states that non-Markovian processes should be the norm. This discrepancy is usually addressed by subjectively making the…
Non-Markovian processes may arise in physics due to memory effects of environmental degrees of freedom. For quantum non-Markovianity, it is an ongoing debate to clarify whether such memory effects have a verifiable quantum origin, or…
Stochastic Approximation (SA) is a classical algorithm that has had since the early days a huge impact on signal processing, and nowadays on machine learning, due to the necessity to deal with a large amount of data observed with…
In this paper we study how to learn stochastic, multimodal transition dynamics in reinforcement learning (RL) tasks. We focus on evaluating transition function estimation, while we defer planning over this model to future work.…
Featuring memory of past inputs is a fundamental requirement for machine learning models processing time-dependent data. In quantum reservoir computing, all architectures proposed so far rely on Markovian dynamics, which, as we prove,…
We explore generalizations of some integrated learning and optimization frameworks for data-driven contextual stochastic optimization that can adapt to heteroscedasticity. We identify conditions on the stochastic program, data generation…
Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…
It is shown that non-Markovian master equations for an open system which are local in time can be unravelled through a piecewise deterministic quantum jump process in its Hilbert space. We derive a stochastic Schr\"odinger equation that…
We generalise the martingale-coboundary representation of discrete time stochastic processes to the non-stationary case and to random variables in Orlicz spaces. Related limit theorems (CLT, invariance principle, log log law, probabilities…
We construct a large class of completely positive and trace preserving non-Markovian dynamical maps for an open quantum system. These maps arise from a piecewise dynamics characterized by a continuous time evolution interrupted by jumps,…
We consider a microscopic collision model, i.e., a quantum system interacts with a hierarchical environment consisting of an auxiliary system and a reservoir. We show how the non-Markovian character of the system is influenced by the…
Contemporary robots have become exceptionally skilled at achieving specific tasks in structured environments. However, they often fail when faced with the limitless permutations of real-world unstructured environments. This motivates…
The stochastic theory of non-relativistic quantum mechanics presented here relies heavily upon the theory of stochastic processes, with its definitions, theorems and specific vocabulary as well. Its main hypothesis states indeed that the…
Quantum Markov models are employed ubiquitously in quantum physics and in quantum information theory due to their relative simplicity and analytical tractability. In particular, these models are known to give accurate approximations for a…
Imitation learning is a data-driven approach to acquiring skills that relies on expert demonstrations to learn a policy that maps observations to actions. When performing demonstrations, experts are not always consistent and might…
As we discuss, a stationary stochastic process is nonergodic when a random persistent topic can be detected in the infinite random text sampled from the process, whereas we call the process strongly nonergodic when an infinite sequence of…