Related papers: Cover time for countable Markov shifts
An aperiodic and irreducible Markov chain on a finite state space converges to its stationary distribution. When convergence to equilibrium is measured by total variation distance, there exists an optimal coupling and a maximal coupling…
Markov-modulated Brownian motion is a popular tool to model continuous-time phenomena in a stochastic context. The main quantity of interest is the invariant density, which satisfies a differential equation associated with the quadratic…
We consider exchangeable Markov multi-state survival processes -- temporal processes taking values over a state-space$\mathcal{S}$ with at least one absorbing failure state $\flat \in \mathcal{S}$ that satisfy natural invariance properties…
We consider the problem of approximating the reachability probabilities in Markov decision processes (MDP) with uncountable (continuous) state and action spaces. While there are algorithms that, for special classes of such MDP, provide a…
A trade-off relation on our knowledge about two noncommuting observables of a qubit system in simultaneous measurement is formulated. The obtained inequality offers a quantitative information-theoretic representation of Bohr's principle of…
We review connections between the metric of spacetime and the quantum fluctuations of fields. In particular, we discuss the finding that the spacetime metric can be expressed entirely in terms of the 2-point correlators of the fluctuations…
We study unconstrained control of a two-level quantum system and analyse critical points of the objective functional which represents quantum average of system observable at some final time $T$. In Proc. Steklov Inst. Math. 285, 233-240…
In this paper, we study discrete-time absorbing Markov Decision Processes (MDP) with measurable state space and Borel action space with a given initial distribution. For such models, solutions to the characteristic equation that are not…
We derive the theory of open quantum system dynamics intervened by a series of nonselective measurements. We analyze the cases of time independent and time dependent Hamiltonian dynamics in between the measurements and find the approximate…
We study the behavior of non-Markovianity with respect to the localization of the initial environmental state. The "amount" of non-Markovianity is measured using divisibility and distinguishability as indicators, employing several schemes…
A major topic of (classical) ergodic theory is to examine qualitatively how the phase space of dynamical systems is penetrated by the orbits of their dynamics. We consider interacting qubit systems with dynamics according to 4-local…
It is argued that a Gibbsian formula for the space-time distribution of microscopic trajectories of a nonequilibrium system provides a unifying framework for recent results on the fluctuations of the entropy production. The variable entropy…
Theorists are often told to express things in the "observational plane". One can do this for space-time geometry, considering "visual" observations of matter in our universe by a single observer over time, with no assumptions about…
Many robots move through the world by composing locomotion primitives like steps and turns. To do so well, robots need not have primitives that make intuitive sense to humans. This becomes of paramount importance when robots are damaged and…
Many problems of interest in computer science and information theory can be phrased in terms of a probability distribution over discrete variables associated to the vertices of a large (but finite) sparse graph. In recent years,…
It is often assumed that a warped galaxy can be modeled by a set of rings. This paper verifies numerically the validity of this assumption by the study of periodic orbits populating a heavy self-gravitating warped disk. The phase space…
We suggest scattering experiments which implement the concept of ``protective measurements'' allowing the measurement of the complete wave function even when only one quantum system (rather than an ensemble) is available. Such scattering…
Filtering is concerned with the sequential estimation of the state, and uncertainties, of a Markovian system, given noisy observations. It is particularly difficult to achieve accurate filtering in complex dynamical systems, such as those…
Basic for the definition of 'time' are clocks operating under stationary conditions. The periods of two clocks can be compared with each other via two return experiments. The central clock mediates between the rotating and the inertial…
A general method is discussed to obtain Markovian master equations which describe the interaction with the environment in a microscopic and non-perturbative fashion. It is based on combining time-dependent scattering theory with the concept…