Related papers: Refraction strategies in stochastic control: optim…
In this paper, a new approach based on convex analysis is introduced to solve the $H_\infty$ problem for discrete-time nonlinear stochastic systems. A stochastic version of bounded real lemma is proved and the state feedback $H_\infty$…
Many techniques originally developed in the context of deterministic control theory have been recently applied to the quest for optimal protocols in stochastic processes. Given a system subject to environmental fluctuations, one may ask…
This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…
We exhibit optimal control strategies for a simple toy problem in which the underlying dynamics depend on a parameter that is initially unknown and must be learned. We consider a cost function posed over a finite time interval, in contrast…
We consider the problem of designing a feedback controller for a multivariable linear time-invariant system which regulates an arbitrary system output to the solution of an equality-constrained convex optimization problem despite unknown…
We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for…
This paper is concerned with a stochastic linear-quadratic optimal control problem with regime switching, random coefficients, and cone control constraint. The randomness of the coefficients comes from two aspects: the Brownian motion and…
The Markowitz problem consists of finding in a financial market a self-financing trading strategy whose final wealth has maximal mean and minimal variance. We study this in continuous time in a general semimartingale model and under cone…
This paper mainly investigates reflected stochastic recursive control problems governed by jump-diffusion dynamics. The system's state evolution is described by a stochastic differential equation driven by both Brownian motion and Poisson…
We consider a deterministic continuous time model of monopolistic firm, which chooses production and pricing strategies of a single good. Firm's goal is to maximize the discounted profit over infinite time horizon. The no-backlogging…
This paper deals with the existence of optimal transport maps for some optimal transport problems with a convex but non strictly convex cost. We give a decomposition strategy to address this issue. As part of our strategy, we have to treat…
In this paper, we investigate stochastic versions of the Hopf-Lax formula which are based on compositions of the Hopf-Lax operator with the transition kernel of a L\'evy process taking values in a separable Banach space. We show that,…
In this paper, we study a stochastic optimal control problem under a type of consistent convex expectation dominated by G-expectation. By the separation theorem for convex sets, we get the representation theorems for this convex expectation…
In this paper, we consider a risk-averse control problem for diffusion processes, in which there is a partition of the admissible control strategy into two decision-making groups (namely, the {\it leader} and {\it follower}) with different…
We consider the problem of controlling an unknown linear dynamical system under adversarially changing convex costs and full feedback of both the state and cost function. We present the first computationally-efficient algorithm that attains…
In this article, we prove the existence of optimal risk-sensitive control with state constraints. We use near monotone assumption on the running cost to prove the existence of optimal risk-sensitive control.
We consider policy gradient methods for stochastic optimal control problem in continuous time. In particular, we analyze the gradient flow for the control, viewed as a continuous time limit of the policy gradient method. We prove the global…
This paper studies a time-changed stochastic control problem, where the underlying stochastic process is a L\'evy noise time-changed by an inverse subordinator. We establish a maximum principle theory for the time-changed stochastic control…
We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…
We consider stochastic systems involving general -- non-Gaussian and asymmetric -- stable processes. The random quantities, either a stochastic force or a waiting time in a random walk process, explicitly depend on the position. A…