Related papers: Representation of asymptotic values for nonexpansi…
We revisit the linear programming approach to deterministic, continuous time, infinite horizon discounted optimal control problems. In the first part, we relax the original problem to an infinite-dimensional linear program over a measure…
Model Predictive Control has emerged as a popular tool for robots to generate complex motions. However, the real-time requirement has limited the use of hard constraints and large preview horizons, which are necessary to ensure safety and…
The closed-loop stability and infinite-horizon performance of receding-horizon approximations are studied for non-stationary linear-quadratic regulator (LQR) problems. The approach is based on a lifted reformulation of the optimal control…
This paper considers linear-quadratic control of a non-linear dynamical system subject to arbitrary cost. I show that for this class of stochastic control problems the non-linear Hamilton-Jacobi-Bellman equation can be transformed into a…
This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…
We study infinite horizon control of continuous-time non-linear branching processes with almost sure extinction for general (positive or negative) discount. Our main goal is to study the link between infinite horizon control of these…
We consider a finite horizon stochastic optimal control problem for nearest-neighbor random walk $\{X_i\}$ on the set of integers. The cost function is the expectation of exponential of the path sum of a random stationary and ergodic…
An abstract framework guaranteeing the local continuous differentiability of the value function associated with optimal stabilization problems subject to abstract semilinear parabolic equations subject to a norm constraint on the controls…
We study quadratic optimal stochastic control problems with control dependent noise state equation perturbed by an affine term and with stochastic coefficients. Both infinite horizon case and ergodic case are treated. To this purpose we…
In this article we study ergodic problems in the whole space R m for viscous Hamilton-Jacobi Equations in the case of locally Lips-chitz continuous and coercive right-hand sides. We prove in particular the existence of a critical value…
In this paper, we investigate an interesting and important stopping problem mixed with stochastic controls and a \textit{nonsmooth} utility over a finite time horizon. The paper aims to develop new methodologies, which are significantly…
We study an ergodic problem associated to a non-local Hamilton-Jacobi equation defined on the whole space $\lambda-\mathcal{L}[u](x)+|Du(x)|^m=f(x)$ and determine whether (unbounded) solutions exist or not. We prove that there is a…
We present a dynamic programming-based solution to a stochastic optimal control problem up to a hitting time for a discrete-time Markov control process. Firstly, we determine an optimal control policy to steer the process toward a compact…
In Stochastic Optimal Control (SOC) one minimizes the average cost-to-go, that consists of the cost-of-control (amount of efforts), cost-of-space (where one wants the system to be) and the target cost (where one wants the system to arrive),…
For a class of Bellman equations in bounded domains we prove that sub- and supersolutions whose growth at the boundary is suitably controlled must be constant. The ellipticity of the operator is assumed to degenerate at the boundary and a…
We investigate the asymptotic properties of a finite-time horizon linear-quadratic optimal control problem driven by a multiscale stochastic process with multiplicative Brownian noise. We approach the problem by considering the associated…
We consider an optimal control problem arising in the context of economic theory of growth, on the lines of the works by Skiba (1978) and Askenazy - Le Van (1999). The economic framework of the model is intertemporal infinite horizon…
For a stochastic factor model we maximize the long-term growth rate of robust expected power utility with parameter $\lambda\in(0,1)$. Using duality methods the problem is reformulated as an infinite time horizon, risk-sensitive control…
We study the asymptotic behavior of the solutions to a family of discounted Hamilton Jacobi equations, posed in the Euclidean N dimensional space, when the discount factor goes to zero. The ambient space being noncompact, we introduce an…
This paper proves continuity of value functions in discounted periodic-review single-commodity total-cost inventory control problems with \revision{continuous inventory levels,} fixed ordering costs, possibly bounded inventory storage…