Related papers: On optimality gaps in the Halfin--Whitt regime
In this paper, we study a linear-quadratic optimal control problem for mean-field stochastic differential equations driven by a Poisson random martingale measure and a multidimensional Brownian motion. Firstly, the existence and uniqueness…
In this paper we use an affine connection formulation to study an optimal control problem for a class of nonholonomic, under-actuated mechanical systems. In particular, we aim at minimizing the norm-squared of the control input to move the…
We study a control-constrained optimal control problem governed by a semilinear elliptic equation. The control acts in a bilinear way on the boundary, and can be interpreted as a heat transfer coefficient. A detailed study of the state…
In this paper, we study optimal control problems of semilinear elliptic and parabolic equations. A tracking cost functional, quadratic in the control and state variables, is considered. No control constraints are imposed. We prove that the…
We consider an optimal control problem with tracking-type cost functional constrained by the Cattaneo equation, which is a well-known model for delayed heat transfer. In particular, we are interested the asymptotic behaviour of the optimal…
We consider optimal stopping problems, in which a sequence of independent random variables is drawn from a known continuous density. The objective of such problems is to find a procedure which maximizes the expected reward; this is often…
For the stochastic multi-armed bandit (MAB) problem from a constrained model that generalizes the classical one, we show that an asymptotic optimality is achievable by a simple strategy extended from the $\epsilon_t$-greedy strategy. We…
We study the asymptotic optimal control of multi-class restless bandits. A restless bandit is a controllable stochastic process whose state evolution depends on whether or not the bandit is made active. Since finding the optimal control is…
We revisit the problem of stochastic online learning with feedback graphs, with the goal of devising algorithms that are optimal, up to constants, both asymptotically and in finite time. We show that, surprisingly, the notion of optimal…
The asymptotic behaviour of a closed BCMP network, with $n$ queues and $m_n$ clients, is analyzed when $n$ and $m_n$ become simultaneously large. Our method relies on Berry-Esseen type approximations coming in the Central Limit Theorem. We…
In this paper we solve two equivalent time optimal control problems. On one hand, we design the control field to implement in minimum time the SWAP (or equivalent) operator on a two-level system, assuming that it interacts with an…
In optimal control theory, infimum gap means that there is a gap between the infimum values of a given minimum problem and an extended problem, obtained by enlarging the set of original solutions and controls. The gap phenomenon is somewhat…
We study a finite-horizon stochastic control criterion for non-convex optimization in which Brownian exploration is balanced against a quadratic control cost. Rather than emphasizing the classical Hopf--Cole representation, we isolate the…
This paper is concerned with a constrained stochastic linear-quadratic optimal control problem, in which the terminal state is fixed and the initial state is constrained to lie in a stochastic linear manifold. The controllability of…
A Deterministic affine quadratic optimal control problem is considered. Due to the nature of the problem, optimal controls exist under some very mild conditions. Further, it is shown that under some assumptions, the value function is…
The coherent control of small quantum system is considered. For a two-level system coupled to an arbitrary bath we consider a pulse of finite duration. We derive the leading and the next-leading order corrections to the evolution operator…
This article discusses an optimal control problem for a phase field model of two immiscible incompressible fluid flow, incorporating surface tension effects. The optimal control problem is defined with a $L^2$-cost functional and subject to…
Suboptimal methods in optimal control arise due to a limited computational budget, unknown system dynamics, or a short prediction window among other reasons. Although these methods are ubiquitous, their transient performance remains…
This paper aims to establish second order necessary conditions for optimal control in quantum stochastic systems. We employ a variational approach, analogous to methods in classical stochastic control, to analyze systems governed by quantum…
The numerical analysis of a family of distributed mixed optimal control problems governed by elliptic variational inequalities (with parameter $\alpha >0$) is obtained through the finite element method when its parameter $h\rightarrow 0$.…