Related papers: On Bellman's principle with inequality constraints
The distribution of a Markov process with killing, conditioned to be still alive at a given time, can be approximated by a Fleming-Viot type particle system. In such a system, each particle is simulated independently according to the law of…
Local systems may appear to violate Bell's inequalities if they are observed through suitable filters. The nonlocality leading to violation is outside the system and comprises the observer comparing the outcomes of the typical two wing Bell…
We consider a long-run impulse control problem for a generic Markov process with a multiplicative reward functional. We construct a solution to the associated Bellman equation and provide a verification result. The argument is based on the…
The correspondence principle suggests that quantum systems grow classical when large. Classical systems cannot violate Bell inequalities. Yet agents given substantial control can violate Bell inequalities proven for large-scale systems. We…
For a class of irreducible Markov chains with an infinitely countable set of states, we establish a new verifiable necessary and sufficient condition for recurrence and transience. We show that if one of the basic assumptions is not…
This article contains a review of Nelson's analysis of Bell's theorem. It shows that Bell's inequalities can be violated with a theory of local random variables if one accepts that the outcomes of these variables are not predetermined prior…
When modelling metapopulation dynamics, the influence of a single patch on the metapopulation depends on the number of individuals in the patch. Since the population size has no natural upper limit, this leads to systems in which there are…
This paper studies function approximation for finite horizon discrete time Markov decision processes under certain convexity assumptions. Uniform convergence of these approximations on compact sets is proved under several sampling schemes…
A general result on the method of randomized stopping is proved. It is applied to optimal stopping of controlled diffusion processes with unbounded coefficients to reduce it to an optimal control problem without stopping. This is motivated…
It is known from Bell's theorem that quantum predictions for some entangled states cannot be mimicked using local hidden variable (LHV) models. From a computer science perspective, LHV models may be interpreted as classical computers…
We provide a framework for Bell inequalities which is based on multilinear contractions. The derivation of the inequalities allows for an intuitive geometric depiction and their violation within quantum mechanics can be seen as a direct…
For a stochastic process $(X_t)_{t\geq 0}$ we establish conditions under which the inverse first-passage time problem has a solution for any random variable $\xi >0$. For Markov processes we give additional conditions under which the…
This short article concentrates on the conceptual aspects of the violation of Bell inequalities, and acts as a map to the 265 cited references. The article outlines (a) relevant characteristics of quantum mechanics, such as statistical…
The model of a quantum-optical device for a conditional preparation of entangled states from input mixed states is presented. It is demonstrated that even thermal or pseudo-thermal radiation can be entangled in such a way, that…
Entanglement between two separate systems is a necessary resource to violate a Bell inequality in a test of local realism. We demonstrate that to overcome the Bell bound, this correlation must be accompanied by the entanglement between the…
We consider the expected violations of Bell inequalities from random pure states. More precisely, we focus on a slightly generalised version of the CGLMP inequality, which concerns Bell experiments of two parties, two measurement options…
An operational description of the controlled Markov dynamics of quantum-mechanical system is introduced. The feedback control strategies with regard to the dynamical reduction of quantum states in the course of quantum real-time…
We establish a new Bernstein-type deviation inequality for general (non-reversible) discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to…
Motion planning under uncertainty for an autonomous system can be formulated as a Markov Decision Process with a continuous state space. In this paper, we propose a novel solution to this decision-theoretic planning problem that directly…
A continuous-time Markov process $X$ can be conditioned to be in a given state at a fixed time $T > 0$ using Doob's $h$-transform. This transform requires the typically intractable transition density of $X$. The effect of the $h$-transform…