相关论文: Further remarks on absorbing Markov decision proce…

Weak convergence of the empirical copula process is shown to hold under the assumption that the first-order partial derivatives of the copula exist and are continuous on certain subsets of the unit hypercube. The assumption is…

We axiomatize and generalize Markov's approach to the continuity problem for Type 1 computable functions, i.e. the problem of finding sufficient conditions on a computable topological space to obtain a theorem of the form "computable…

We prove the existence of a Markov-perfect equilibrium in randomized stopping times for a model of the war of attrition in which the underlying state variable follows a homogenous linear diffusion. The proof uses the fact that the space of…

Let $(X_t)_{t \geq 0}$ be a continuous time Markov process on some metric space $M,$ leaving invariant a closed subset $M_0 \subset M,$ called the {\em extinction set}. We give general conditions ensuring either "Stochastic persistence"…

A uniformly continuously integrable sequence of real-valued measurable functions, defined on some probability space, is relatively compact in the $\sigma(L^1,L^\infty)$ topology. In this paper, we link such a result to weak convergence…

Topological measures and quasi-linear functionals generalize measures and linear functionals. We define and study deficient topological measures on locally compact spaces. A deficient topological measure on a locally compact space is a set…

This paper focuses on various decompositions of topological measures, deficient topological measures, signed topological measures, and signed deficient topological measures. These set functions generalize measures and correspond to certain…

This paper studies limit measures of stationary measures of stochastic ordinary differential equations on the Euclidean space and tries to determine which invariant measures of an unperturbed system will survive. Under the assumption for…

We consider Markov Decision Processes (MDPs) in which every stationary policy induces the same graph structure for the underlying Markov chain and further, the graph has the following property: if we replace each recurrent class by a node,…

We prove a robust super-hedging duality result for path-dependent options on assets with jumps, in a continuous time setting. It requires that the collection of martingale measures is rich enough and that the payoff function satisfies some…

In this paper, we explore a topological system $f:M\rightarrow M$ with average shadowing property. We extend Sigmund's results and show that every non-empty, compact and connected subset $V\subseteq\mathcal {M}_{inv}(f)$ coincides with…

The transition kernel of a continuous-state-action Markov decision process (MDP) admits a natural tensor structure. This paper proposes a tensor-inspired unsupervised learning method to identify meaningful low-dimensional state and action…

We study infinite-horizon robust Markov decision processes (MDPs) on continuous state spaces with structured rectangular ambiguity set. The proposed ambiguity set falls within the convex hull of unknown generating kernels. We utilize the…

Topological insulators interacting with magnetic impurities have been reported to host several unconventional effects. These phenomena are described within the framework of gapping Dirac quasiparticles due to broken time-reversal symmetry.…

We study an approximation method for partially observed Markov decision processes (POMDPs) with continuous spaces. Belief MDP reduction, which has been the standard approach to study POMDPs requires rigorous approximation methods for…

In this article we investigate which compact spaces remain compact under countably closed forcing. We prove that, assuming the Continuum Hypothesis, the natural generalizations to $\omega_1$-sequences of the selection principle and…

We are interested in risk constraints for infinite horizon discrete time Markov decision processes (MDPs). Starting with average reward MDPs, we show that increasing concave stochastic dominance constraints on the empirical distribution of…

This paper provides new sufficient conditions so that the optimal policy of a partially observed Markov decision process (POMDP) can be lower bounded by a myopic policy. The two new proposed conditions, namely, Lehmann precision and…

In this paper we generalize the main result of [13] in two different situations: in the first case for MOTSs of genus greater than one and, in the second case, for MOTSs of high dimension with negative $\sigma$-constant. In both cases we…

The properties of the absorbing states of non-equilibrium models belonging to the conserved directed percolation universality class are studied. We find that at the critical point the absorbing states are hyperuniform, exhibiting…