Zero-one Laws for a Control Problem with Random Action Sets
Abstract
In many control problems there is only limited information about the actions that will be available at future stages. We introduce a framework where the Controller chooses actions , one at a time. Her goal is to maximize the probability that the infinite sequence is an element of a given subset of . The set , called the goal, is assumed to be a Borel tail set. The Controller's choices are restricted: having taken a sequence of actions prior to stage , she must choose an action at stage from a non-empty, finite subset of . The set is chosen from a distribution , independently over all and all . We consider several information structures defined by how far ahead into the future the Controller knows what actions will be available. In the special case where all the action sets are singletons (and thus the Controller is a dummy), Kolmogorov's 0-1 law says that the probability for the goal to be reached is 0 or 1. We construct a number of counterexamples to show that in general the value of the control problem can be strictly between 0 and 1, and derive several sufficient conditions for the 0-1 ``law" to hold.
Cite
@article{arxiv.2404.07012,
title = {Zero-one Laws for a Control Problem with Random Action Sets},
author = {János Flesch and Arkadi Predtetchinski and William D Sudderth and Xavier Venel},
journal= {arXiv preprint arXiv:2404.07012},
year = {2024}
}