Related papers: The Classical Stochastic Impulse Control Problem
We derive an algorithm in the spirit of Rogers and Davis & Burstein that leads to upper bounds for stochastic control problems. Our bounds complement lower biased estimates recently obtained in the work of Guyon & Henry-Labord\`ere. We…
We consider the problem of stabilization of a linear system, under state and control constraints, and subject to bounded disturbances and unknown parameters in the state matrix. First, using a simple least square solution and available…
The paper addresses a continuous-time continuous-space chance-constrained stochastic optimal control (SOC) problem where the probability of failure to satisfy given state constraints is explicitly bounded. We leverage the notion of exit…
The objective of this work is to study continuous-time Markov decision processes on a general Borel state space with both impulsive and continuous controls for the infinite-time horizon discounted cost. The continuous-time controlled…
This work provides a novel convergence analysis for stochastic optimization in terms of stopping times, addressing the practical reality that algorithms are often terminated adaptively based on observed progress. Unlike prior approaches,…
In this paper we propose a stochastic model predictive control (MPC) algorithm for linear discrete-time systems affected by possibly unbounded additive disturbances and subject to probabilistic constraints. Constraints are treated in…
Motivated by the recent interest in risk-aware control, we study a continuous-time control synthesis problem to bound the risk that a stochastic linear system violates a given specification. We use risk signal temporal logic as a…
Non-smooth dynamics driven by stochastic disturbance arise in a wide variety of engineering problems. Impulsive interventions are often employed to control stochastic systems; however, the modeling and analysis subject to execution delay…
In this paper, we study a class of stochastic time-inconsistent linear-quadratic (LQ) control problems with control input constraints. These problems are investigated within the more general framework associated with random coefficients.…
This paper considers an optimal impulse control problem of dynamical systems generated by a flow. The performance criteria are total costs over the infinite time horizon. Apart from the main performance to be minimized, there are multiple…
A widely used stochastic wave equation is the classical wave equation perturbed by a term of It\^o's integral. We show that this equation is not exactly controllable even if the controls are effective everywhere in both the drift and the…
We stabilize a prescribed cycle or an equilibrium of the difference equation using pulsed stochastic control. Our technique, inspired by the Kolmogorov's Law of Large Numbers, activates a stabilizing effect of stochastic perturbation and…
For a control Cauchy problem $$\dot x= {f}(t,x,u,v) +\sum_{\alpha=1}^m g_\alpha(x) \dot u_\alpha,\quad x(a)=\bar x, $$ on an interval $[a,b]$, we propose a notion of limit solution $x,$ verifying the following properties: i) $x$ is defined…
We consider a class of impulse control problems for general underlying strong Markov processes on the real line, which allows for an explicit solution. The optimal impulse times are shown to be of threshold type and the optimal threshold is…
We consider Tikhonov regularization of control-constrained optimal control problems. We present new a-priori estimates for the regularization error assuming measure and source-measure conditions. In the special case of bang-bang solutions,…
The use of coordinate processes for the modelling of impulse control for general Markov processes typically involves the construction of a probability measure on a countable product of copies of the path space. In addition, admissibility of…
We address a class of backward stochastic differential equations on a bounded interval, where the driving noise is a marked, or multivariate, point process. Assuming that the jump times are totally inaccessible and a technical condition…
We study a general class of elliptic free boundary problems equipped with a Dirichlet boundary condition. Our primary result establishes an optimal $C^{1,1}$-regularity estimate for $L^p$-strong solutions at points where the free and fixed…
In this article we use flatness improvement argument to study the regularity of the free boundary for the biharmonic obstacle problem with zero obstacle. Assuming that the solution is almost one-dimensional, and that the non-coincidence set…
We study the obstacle problem for parabolic operators of the type $\partial_t + L$, where $L$ is an elliptic integro-differential operator of order $2s$, such as $(-\Delta)^s$, in the supercritical regime $s \in (0,{1/2})$. The best result…