相关论文: Further remarks on absorbing Markov decision proce…

For a Markov decision process with countably infinite states, the optimal value may not be achievable in the set of stationary policies. In this paper, we study the existence conditions of an optimal stationary policy in a countable-state…

In proving large deviation estimates, the lower bound for open sets and upper bound for compact sets are essentially local estimates. On the other hand, the upper bound for closed sets is global and compactness of space or an exponential…

Random dynamical systems with countably many maps which admit countable Markov partitions on complete metric spaces such that the resulting Markov systems are uniformly continuous and contractive are considered. A non-degeneracy and a…

We investigate absorption, i.e., almost sure convergence to an absorbing state, in time-varying (non-homogeneous) discrete-time Markov chains with finite state space. We consider systems that can switch among a finite set of transition…

We show that there is a compact topological space carrying a measure which is not a weak* limit of finitely supported measures but is in the sequential closure of the set of such measures. We construct compact spaces with measures of…

The present paper considers the constrained optimal control problem with total undiscounted criteria for a continuous-time Markov decision process (CTMDP) in Borel state and action spaces. Under the standard compactness and continuity…

We consider average-cost Markov decision processes (MDPs) with Borel state and action spaces and universally measurable policies. For the nonnegative cost model and an unbounded cost model, we introduce a set of conditions under which we…

For a continuous map $T$ of a compact metrizable space $X$ with finite topological entropy, the order of accumulation of entropy of $T$ is a countable ordinal that arises in the context of entropy structure and symbolic extensions. We show…

In the work it is shown that the space of idempotent probability measures with compact supports is kappa-metrizable if the given Tychonoff space is kappa-metrizable. It is constructed a series of max-plus-convex subfunctors of the functor…

A compactness of the Revuz map is established in the sense that the locally uniform convergence of a sequence of positive continuous additive functionals is derived in terms of their smooth measures. To this end, we first introduce a metric…

We prove that the entropy map for countable Markov shifts of finite entropy is upper semi-continuous at ergodic measures. Note that the phase space is non-compact. Applications to systems that can be coded by these shifts, such as positive…

Simple random coverage models, well studied in Euclidean space, can also be defined on a general compact metric space. By analogy with the geometric models, and with the discrete coupon collector's problem and with cover times for finite…

We extend the definition of topological pressure to locally compact Hausdorff spaces, and we demonstrate a "variational principle" comparing the topological and measure theoretic pressures. Given a continuous $\mathbb{Z}_+^N$-action $T$…

This article considers the average optimality for a continuous-time Markov decision process with Borel state and action spaces and an arbitrarily unbounded nonnegative cost rate. The existence of a deterministic stationary optimal policy is…

A semi-Markov process is one that changes states in accordance with a Markov chain but takes a random amount of time between changes. We consider the generalisation to semi-Markov processes of the classical Lamperti law for the occupation…

We prove the existence of SRB measures for diffeomorphisms where a positive volume set of initial conditions satisfy an "effective hyperbolicity" condition that guarantees certain recurrence conditions on the iterates of Lebesgue measure.…

In this present article, we get sufficient conditions for the existence and uniqueness of fixed points and common fixed points for single and double mapping satisfying various contractive conditions within the partially ordered…

Many economic models feature monotone Markov dynamics on state spaces that may be noncompact. Establishing existence, uniqueness, and stability of stationary distributions in such settings has required a patchwork of sufficient conditions,…

In this article, we introduce the notions of sequentially compactness and boundedly compactness in the framework of a newly defined $b_v(s)$-metric space which is a generalization of usual metric spaces and several other abstract spaces. We…

We consider weak invariance principles (functional limit theorems) in the domain of a stable law. A general result is obtained on lifting such limit laws from an induced dynamical system to the original system. An important class of…