English
Related papers

Related papers: Further remarks on absorbing Markov decision proce…

200 papers

We prove in this paper that, under suitable coinditions on an initial data set, we can obtain Area and Curvature Estimates for simple marginally outer trapped surfaces (or MOTS). Using this estimates, we derive a Compactness Theorem for…

Differential Geometry · Mathematics 2011-08-30 José M. Espinar

While compactness is an essential assumption for many results in dynamical systems theory, for many applications the state space is only locally compact. Here we provide a general theory for compactifying such systems, i.e. embedding them…

Dynamical Systems · Mathematics 2010-04-05 Ethan Akin , Joseph Auslander

A fundamental assumption of reinforcement learning in Markov decision processes (MDPs) is that the relevant decision process is, in fact, Markov. However, when MDPs have rich observations, agents typically learn by way of an abstract state…

Machine Learning · Computer Science 2024-03-18 Cameron Allen , Neev Parikh , Omer Gottesman , George Konidaris

We consider average-cost Markov decision processes (MDPs) with Borel state spaces, countable, discrete action spaces, and strictly unbounded one-stage costs. For the minimum pair approach, we introduce a new majorization condition on the…

Optimization and Control · Mathematics 2020-05-06 Huizhen Yu

Let $(X,d,f)$ be a topological dynamical system, where $(X,d)$ is a compact metric space and $f:X\to X$ is a continuous map. We define $n$-ordered empirical measure of $x\in X$ by \begin{align*}…

Dynamical Systems · Mathematics 2016-10-31 Zheng Yin , Ercai Chen

We study approach to the large-time jammed state of the deposited particles in the model of random sequential adsorption. The convergence laws are usually derived from the argument of Pomeau which includes the assumption of the dominance,…

Statistical Mechanics · Physics 2017-11-27 Arjun Verma , Vladimir Privman

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant "additivity" properties: (i) existence of a…

Data Analysis, Statistics and Probability · Physics 2013-11-12 A. N. Gorban , P. A. Gorban , G. Judge

Many driven systems alternate between bursts of activity and quiescence and can become trapped in an absorbing state, such as complete inactivity in reaction-diffusion processes or extinction in predator-prey dynamics. It is generally…

Statistical Mechanics · Physics 2026-05-14 Kartik Chhajed , P. K. Mohanty

We introduce a general notion of covering property, of which many classical definitions are particular instances. Notions of closure under various sorts of convergence, or, more generally, under taking kinds of accumulation points, are…

General Topology · Mathematics 2022-06-28 Paolo Lipparini

We establish limiting absorption principles for contractions on a Hilbert space. Our sufficient conditions are based on positive commutator estimates. We discuss the dynamical implications of this principle to the corresponding…

Mathematical Physics · Physics 2024-05-21 Joachim Asch , Olivier Bourget

We give two examples of metric measure spaces satisfying the measure contraction property MCP(K,N) but having different topological dimensions at different regions of the space. The first one satisfies MCP(0,3) and contains a subset…

Metric Geometry · Mathematics 2014-03-14 Christian Ketterer , Tapio Rajala

We find many conditions equivalent to the model-theoretical property $\lambda \stackrel{\kappa}{\Rightarrow} \mu$ introduced in [L1]. Our conditions involve uniformity of ultrafilters, compactness properties of products of topological…

Logic · Mathematics 2008-04-10 Paolo Lipparini

We characterize order preserving continuous surjections between compact linearly ordered spaces which admit an averaging operator, together with estimates of the norm of such an operator. This result is used to the study of strengthenings…

Functional Analysis · Mathematics 2012-10-23 Wieslaw Kubiś , Ondrej Kalenda

We study existence and uniqueness of invariant probability measures for continuous-time Markov processes on general state spaces. Existence is obtained from tightness of time averages under a weak regularity assumption inspired by…

Probability · Mathematics 2026-01-21 Jean-Gabriel Attali

(I.) We consider generalizations of an iterated function system and the associated Markov operators. A Markov operator, defined on the space of (deficient) topological measures on a locally compact space, is an infinite convex linear…

Functional Analysis · Mathematics 2026-05-06 S. V. Butler

We introduce the {\em $\mu$-topological stability}. This is a type of stability depending on the measure $\mu$ different from the set-valued approach \cite{lm}. We prove that the map $f$ is $m_p$-topologically stable if and only if $p$ is a…

Dynamical Systems · Mathematics 2025-10-28 Keonhee Lee , Seunghee Lee , C. A. Morales

We present a rigorous proof of the Spacetime Penrose Inequality relating the ADM mass to the area of trapped surfaces in asymptotically flat initial data sets satisfying the dominant energy condition. The main theorem establishes that the…

General Relativity and Quantum Cosmology · Physics 2026-01-01 Da Xu

Let $f:M\rightarrow M$ be a $C^1$ diffeomorphism with a dominated splitting on a compact Riemanian manifold $M$ without boundary. We state and prove several sufficient conditions for the topological entropy of $f$ to be positive. The…

Dynamical Systems · Mathematics 2016-06-08 Eleonora Catsigeras , Xueting Tian

The Bernstein Markov Property, shortly BMP, is an asymptotic quan- titative assumption on the growth of uniform norms of polynomials or rational functions on a compact set with respect to L {\mu} 2 -norms, where {\mu} is a positive finite…

Complex Variables · Mathematics 2015-12-11 Federico Piazzon

For Markov processes with absorption, we provide general criteria ensuring the existence and the exponential non-uniform convergence in total variation norm to a quasi-stationary distribution. We also characterize a subset of its domain of…

Probability · Mathematics 2022-10-24 Nicolas Champagnat , Denis Villemonais