Related papers: Equilibrium states and invariant measures for rand…

We define the empiric stochastic stability of an invariant measure in the finite-time scenario, the classical definition of stochastic stability. We prove that an invariant measure of a continuous system is empirically stochastically stable…

For a Markov decision process with countably infinite states, the optimal value may not be achievable in the set of stationary policies. In this paper, we study the existence conditions of an optimal stationary policy in a countable-state…

This is a significantly expanded version of the survey paper "Mixing and decay of correlations in non-uniformly expanding maps: a survey of recent results" math/0301319. We discuss recent results on decay of correlations for non-uniformly…

We consider an independent and identically distributed (i.i.d.) random dynamical system of simple linear transformations on the unit interval $T_{\beta}(x)=\beta x$ (mod $1$), $x\in[0,1]$, $\beta>0$, which are the so-called…

This is a detailed analysis of invariant measures for one-dimensional dynamical systems with random switching. In particular, we prove smoothness of the invariant densities away from critical points and describe the asymptotics of the…

We consider a basic model of a dynamical distribution network, modeled as a directed graph with storage variables corresponding to every vertex and flow inputs corresponding to every edge, subject to unknown but constant inflows and…

Continuous-time Markov chains on non-negative integers can be used for modeling biological systems, population dynamics, and queueing models. Qualitative behaviors of birth-and-death models, typical examples of such one-dimensional…

For a large class of nonuniformly expanding maps of $\Bbb R^m$, with indifferent fixed points and unbounded distorsion and non necessarily Markovian, we construct an absolutely continuous invariant measure. We extend to our case techniques…

Let $T \colon M \to M$ be a nonuniformly expanding dynamical system, such as logistic or intermittent map. Let $v \colon M \to \mathbb{R}^d$ be an observable and $v_n = \sum_{k=0}^{n-1} v \circ T^k$ denote the Birkhoff sums. Given a…

We consider a stochastic conservation law on the line with solution-dependent diffusivity, a super-linear, sub-quadratic Hamiltonian, and smooth, spatially-homogeneous kick-type random forcing. We show that this Markov process admits a…

We consider a deterministic system with two conserved quantities and infinity many invariant measures. However the systems possess a unique invariant measure when enough stochastic forcing and balancing dissipation are added. We then show…

I provide a proof of the existence of absolutely continuous invariant measures (and study their statistical properties) for multidimensional piecewise expanding systems with not necessarily bounded derivative or distortion. The proof uses…

While invariant measures are widely employed to analyze physical systems when a direct study of pointwise trajectories is intractable, e.g., due to chaos or noise, they cannot uniquely identify the underlying dynamics. Our first result…

We consider the non autonomous dynamical system $\{\tau_{n}\},$ where $\tau_{n}$ is a continuous map $X\rightarrow X,$ and $X$ is a compact metric space. We assume that $\{\tau_{n}\}$ converges uniformly to $\tau .$ The inheritance of…

This article considers the average optimality for a continuous-time Markov decision process with Borel state and action spaces and an arbitrarily unbounded nonnegative cost rate. The existence of a deterministic stationary optimal policy is…

We develop a Thermodynamic Formalism for bounded continuous potentials defined on the sequence space $X\equiv E^{\mathbb{N}}$, where $E$ is a general Borel standard space. In particular, we introduce meaningful concepts of entropy and…

We study the pointwise perturbations of countable Markov maps with infinitely many inverse branches and establish the following continuity theorem: Let $T_k$ and $T$ be expanding countable Markov maps such that the inverse branches of $T_k$…

The stability of iterations of affine linear maps $\Psi_{n}(x)=A_{n}x+B_{n}$, $n=1,2,\ldots$, is studied in the presence of a Markovian environment, more precisely, for the situation when $(A_{n},B_{n})_{n\ge 1}$ is modulated by an ergodic…

Quantum trajectories of a Markovian open quantum system arise from the back-action of measurements performed in the environment with which the system interacts. In this work, we consider counting measurements of quantum jumps, corresponding…

We consider a randomly forced Ginzburg-Landau equation on an unbounded domain. The forcing is smooth and homogeneous in space and white noise in time. We prove existence and smoothness of solutions, existence of an invariant measure for the…