Related papers: Uniform value for some nonexpansive optimal contro…
We consider a class of closed loop stochastic optimal control problems in finite time horizon, in which the cost is an expectation conditional on the event that the process has not exited a given bounded domain. An important difficulty is…
In control theory, typically a nominal model is assumed based on which an optimal control is designed and then applied to an actual (true) system. This gives rise to the problem of performance loss due to the mismatch between the true model…
In an optimal control strategy, an important point is to define the cost of the control. Usually it is added to the control criterion and multiplied by a small coefficient denoted by $\varepsilon$ which is known as the marginal cost of the…
We establish structural properties of optimal stopping problems under time-consistent dynamic (coherent) risk measures, focusing on value function monotonicity and the existence of control limit (threshold) optimal policies. While such…
This paper describes the structure of optimal policies for discounted periodic-review single-commodity total-cost inventory control problems with fixed ordering costs for finite and infinite horizons. There are known conditions in the…
The long-time average behavior of the value function in the calculus of variations is known to be connected to the existence of the limit of the corresponding Abel means. Still in the Tonelli case, such a limit is in turn related to the…
Given a nonlinear control system, a target set, a nonnegative integral cost, and a continuous function $W$, we say that the system is globally asymptotically controllable to the target with W-regulated cost, whenever, starting from any…
We study global optimization of non-convex functions through optimal control theory. Our main result establishes that (quasi-)optimal trajectories of a discounted control problem converge globally and practically asymptotically to the set…
We study the infinite-horizon restless bandit problem with the average reward criterion, in both discrete-time and continuous-time settings. A fundamental goal is to efficiently compute policies that achieve a diminishing optimality gap as…
Economic Model Predictive Control has recently gained popularity due to its ability to directly optimize a given performance criterion, while enforcing constraint satisfaction for nonlinear systems. Recent research has developed both…
We present a general approach to prove existence of solutions for optimal control problems not based on typical convexity conditions which quite often are very hard, if not impossible, to check. By taking advantage of several relaxations of…
Limit distributions of likelihood ratio statistics are well-known to be discontinuous in the presence of nuisance parameters at the boundary of the parameter space, which lead to size distortions when standard critical values are used for…
In the paper [P. Cannarsa, C. Mendico, Asymptotic analysis for Hamilton-Jacobi- Bellman equations on Euclidean space, (2021) Arxiv], we proved the existence of the limit as the time horizon goes to infinity of the averaged value function of…
We consider a control problem where the state must reach asymptotically a target while paying an integral payoff with a non-negative Lagrangian. The dynamics is just continuous, and no assumptions are made on the zero level set of the…
We consider the control problem with \textit{exit time}. Unlike the Bolza and Mayer problems, in this problem the terminal time of the trajectories is not fixed, but it is the first time at which they reach a given closed subset -…
In the last decades, control problems with infinite horizons and discount factors have become increasingly central not only for economics but also for applications in artificial intelligence and machine learning. The strong links between…
This paper considers the infinite horizon optimal control problem for nonlinear systems. Under the condition of nonlinear controllability of the system to any terminal set containing the origin and forward invariance of the terminal set, we…
We consider the infinite-horizon average-reward restless bandit problem. We propose a novel \emph{two-set policy} that maintains two dynamic subsets of arms: one subset of arms has a nearly optimal state distribution and takes actions…
In this paper, we study asymptotic properties of problems of control of stochastic discrete time systems (also known as Markov decision processes) with time averaging and time discounting optimality criteria, and we establish that the…
For a control Cauchy problem $$\dot x= {f}(t,x,u,v) +\sum_{\alpha=1}^m g_\alpha(x) \dot u_\alpha,\quad x(a)=\bar x, $$ on an interval $[a,b]$, we propose a notion of limit solution $x,$ verifying the following properties: i) $x$ is defined…