Related papers: Ising Disks: Topology Preserving Glauber Dynamics
For a Markov decision process with countably infinite states, the optimal value may not be achievable in the set of stationary policies. In this paper, we study the existence conditions of an optimal stationary policy in a countable-state…
In this paper, the reachability of dimension-bounded linear systems is investigated.Since state dimensions of dimension-bounded linear systems vary with time, the expression of state dimension at each time is provided.A method for judging…
In this paper we study the state-feedback stabilization of a discrete-time Markov jump linear system when the observation of the Markov chain of the system, called the Markov state, is time-randomized by another Markov chain. Embedding the…
A one-dimensional Ising model with nearest neighbour interactions is applied to study compaction processes in granular media. An equivalent particle-hole picture is introduced, with the holes being associated to the domain walls of the…
We provide quantitative bounds for the long time behavior of a class of Piecewise Deterministic Markov Processes with state space Rd \times E where E is a finite set. The continuous component evolves according to a smooth vector field that…
The dynamics of Markovian open quantum systems are described by Lindblad master equations, generating a quantum dynamical semigroup. An important concept for such systems is (Davies) irreducibility, i.e., the question whether there exist…
Equilibrium states are natural dynamical analogues of Gibbs states in thermodynamic formalism. This paper investigates their computability within the framework of Computable Analysis. We show that the unique equilibrium state for a…
The thermodynamic formalism allows one to access the chaotic properties of equilibrium and out-of-equilibrium systems, by deriving those from a dynamical partition function. The definition that has been given for this partition function…
A Markov state model is a powerful tool that can be used to track the evolution of populations of configurations in an atomistic representation of a protein. For a coarse-grained linear chain model with discontinuous interactions, the…
We study quenched dynamics of fully-connected spin models. The system is prepared in a ground state of the initial Hamiltonian and the Hamiltonian is suddenly changed to a different form. We apply the Krylov subspace method to map the…
The cutoff phenomenon is an abrupt transition from out of equilibrium to equilibrium undergone by certain Markov processes in the limit where the size of the state space tends to infinity: instead of decaying gradually over time, their…
We present a reachability based approach to establish unique ergodicity of non-linear filter processes where state space of a hidden Markov model is a compact Polish metric space and the observation space is a Polish metric space. We also…
Open Markovian quantum systems with fast and full Hamiltonian control can be reduced to an equivalent control system on the standard simplex modelling the dynamics of the eigenvalues of the density matrix describing the quantum state. We…
We study the ergodic property of a continuous-state branching process with immigration and competition. The exponential ergodicity in a weighted total variation distance is proved under natural assumptions. The main theorem applies to…
We establish general conditions under which Markov chains produced by the Hamiltonian Monte Carlo method will and will not be geometrically ergodic. We consider implementations with both position-independent and position-dependent…
The cutoff phenomenon describes a sharp transition in the convergence of a Markov chain to equilibrium. In recent work, the authors established cutoff and its location for the stochastic Ising model on the $d$-dimensional torus $(Z/nZ)^d$…
Unlike classical system, understanding ergodicity from phase space mixing remains unclear for interacting quantum systems due to the absence of phase space trajectories. By considering an interacting spin model known as kicked coupled top,…
Well-posedness of a reversible variant of the Gray-Scott model is shown, along with the convergence of each trajectory to one of the two spatially homogeneous steady states. The principle of linearized stability provides the local…
In this work, we consider an inhomogeneous (discrete time) Markov chain and are interested in its long time behavior. We provide sufficient conditions to ensure that some of its asymptotic properties can be related to the ones of a…
We construct an irreversible local Markov dynamics on configurations of up-right paths on a discrete two-dimensional torus, that preserves the Gibbs measures for the six vertex model. An additional feature of the dynamics is a conjecturally…