Related papers: Fixed Points of the Set-Based Bellman Operator

This paper combines the decomposition technique ($\sigma$-stability) in random functional analysis with the deterministic theory of asymptotically pointwise contractions to provide a complete self-contained derivation of a fixed point…

In this paper, our aim is to obtain new fixed-disc results on metric spaces. To do this, we present a new approach using the set of simulation functions and some known fixed-point techniques. We do not need to have some strong conditions…

We study the convergence of random function iterations for finding an invariant measure of the corresponding Markov operator. We call the problem of finding such an invariant measure the stochastic fixed point problem. This generalizes…

In this note, we consider a framework for the analysis of iterative algorithms which can described in terms of a structured set-valued operator. More precisely, at each point in the ambient space, we assume that the value of operator can be…

We present an optimization-based framework for robust permissive synthesis for Interval Markov Decision Processes (IMDPs), motivated by robotic decision-making under transition uncertainty. In many robotic systems, model inaccuracies and…

We give a self-contained and introductory account of some basic functional analytic tools needed to understand maximal monotone operators in Hilbert spaces. We review domains of (possibly unbounded) operators, closed sets and closed…

A new technique for proving fixed point theorems for families of holomorphic transformations of operator balls is developed. One of these theorems is used to show that a bounded representation in a real or complex Hilbert space is…

Learning-based approaches to verifying unknown Markov decision processes (MDPs) often employ uncertain MDPs. These models use, for example, confidence intervals to capture transition uncertainty and allow synthesis of policies that are…

We find the exact Bellman function associated to the level-sets of sparse operators acting on characteristic functions.

In this paper, a convex optimization-based method is proposed for numerically solving dynamic programs in continuous state and action spaces. The key idea is to approximate the output of the Bellman operator at a particular state by the…

In this paper, we study the existence of fixed points for mappings defined on complete metric space (X, d) satisfying a general contractive inequality of integral type depended on another function. This conditions is analogous of Banach…

We investigate partially observed Markov decision processes (POMDPs) with cost functions regularized by entropy terms describing state, observation, and control uncertainty. Standard POMDP techniques are shown to offer bounded-error…

Generalized (rational) graph contractions in the framework of a dislocated metric space endowed with a directed graph are investigated. Fixed point results for set-contractions are obtained. We also provide some examples to illustrate our…

Robust Markov decision processes (MDPs) provide a general framework to model decision problems where the system dynamics are changing or only partially known. Efficient methods for some \texttt{sa}-rectangular robust MDPs exist, using its…

Considering the large number of fractional operators that exist, and since it does not seem that their number will stop increasing soon at the time of writing this paper, it is presented for the first time, as far as the authors know, a…

In this paper we investigate the action of self-consistent transfer operators (STOs) on Birkhoff cones and give sufficient conditions for stability of their fixed points. Our approach relies on the order preservation properties of STOs that…

In this article, a new class of operators, termed Ad-contractions, is introduced to extend the framework of A-contractions to the setting of dislocated metric spaces. Fixed point results are established for single mappings, sequences of…

A new family of stable processes indexed by metric spaces with stationary increments are introduced. They are special cases of a new family of set-indexed stable processes with Chentsov representation. At the heart of the representation, a…

We propose a novel operator-theoretic framework to study global stability of nonlinear systems. Based on the spectral properties of the so-called Koopman operator, our approach can be regarded as a natural extension of classic linear…

A general fixed point theorem for isometries in terms of metric functionals is proved under the assumption of the existence of a conical bicombing. It is new even for isometries of Banach spaces as well as for non-locally compact…