相关论文: Further remarks on absorbing Markov decision proce…

In these notes, uniform convergence on compacta is studied on the space of functions taking values in the set of finite Borel measures. Related limit theorems, including L\'evy's continuity theorem and functional limit theorems for…

Our aim is to unify and extend the large deviation upper and lower bounds for the occupation times of a Markov process with $L_2$ semigroups under minimal conditions on the state space and the process trajectories; for example, no strong…

Using the setting of ordered metric spaces, we obtain common end point of two multivalued mappings satisfying a generalized $(\psi,\varphi)$-weak contractive condition. Under comparative condition on the set of end points of multivalued…

Partially observable Markov decision processes (POMDPs) are standard models for dynamic systems with probabilistic and nondeterministic behaviour in uncertain environments. We prove that in POMDPs with long-run average objective, the…

We establish a Crapo complementation formula for the M\"obius function $\mu^X$ in a general decomposition space $X$ in terms of a convex subspace $K$ and its complement: $\mu^X \simeq \mu^{X\setminus K} + \mu^X*\zeta^K*\mu^X$. We work at…

For a stochastically monotone Markov chain taking values in a Polish space, we present a number of conditions for existence and for uniqueness of its stationary regime, as well as for closeness of its transient trajectories. In particular,…

We consider non-uniformly expanding maps on compact Riemannian manifolds of arbitrary dimension, possibly having discontinuities and/or critical sets, and show that under some general conditions they admit an induced Markov tower structure…

For $C^0$ generic continuous maps or homeomorphisms on compact Riemannian manifold, we prove that (1) the space of physical-like measures coincides with the set of invariant measures supported on chain recurrent classes, (2) every point in…

We develop sufficient analytic conditions for conservativeness of non-sectorial perturbations of symmetric Dirichlet forms which can be represented through a carr\'e du champ on a locally compact separable metric space. These form an…

We present metrics for measuring state similarity in Markov decision processes (MDPs) with infinitely many states, including MDPs with continuous state spaces. Such metrics provide a stable quantitative analogue of the notion of…

This article is concerned with measure equivalence and uniform measure equivalence of locally compact, second countable groups. We show that two unimodular, locally compact, second countable groups are measure equivalent if and only if they…

We consider Markov Decision Processes (MDPs) with mean-payoff parity and energy parity objectives. In system design, the parity objective is used to encode \omega-regular specifications, and the mean-payoff and energy objectives can be used…

Our aim is to find sufficient conditions for weak convergence of stochastic integrals with respect to the state occupation measure of a Markov chain. First, we study properties of the state indicator function and the state occupation…

In a quantum (inhomogeneous) Markov process $\rho_1:=\Gamma_1(\rho)$, $\rho_2:=\Gamma_1(\rho_1)$, ..., where $\Gamma_i$ are CPTP maps and $\rho$ is the initial state, the the state of the system is either oscillatory or convergent to a…

A short proof is given of a necessary and sufficient condition for the normalized occupation measure of a L\'evy process in a metrizable compact group to be asymptotically uniform with probability one.

This note describes sufficient conditions under which total-cost and average-cost Markov decision processes (MDPs) with general state and action spaces, and with weakly continuous transition probabilities, can be reduced to discounted MDPs.…

In the absence of the axiom of choice, the set-theoretic status of many natural statements about metrizable compact spaces is investigated. Some of the statements are provable in $\mathbf{ZF}$, some are shown to be independent of…

We consider the reversible adsorption of dimers on a regular lattice, where adsorption occurs on a finite fraction of sites selected randomly. By comparing this system to the pure system where all sites are available for adsorption, we show…

Ergodic properties of rational maps are studied, generalising the work of F.\ Ledrappier. A new construction allows for simpler proofs of stronger results. Very general conformal measures are considered. Equivalent conditions are given for…

We study extensions of the measure of maximal entropy to suitable compactifications of the parameter space and the moduli space of rational maps acting on the Riemann sphere. For parameter space, we consider a space which resolves the…