Related papers: A Solution Technique for L\'evy Driven Long Term A…
Relying on the careful study of a related problem in the calculus of variations, we study a class of optimal control problems in which the control lies on the acceleration, with state constraints on the position variable. In dimension one,…
We consider a nonlinear control system depending on two controls u and v, with dynamics affine in the (unbounded) derivative of u, and v appearing initially only in the drift term. Recently, motivated by applications to optimization…
This paper studies the long-time behavior of optimal solutions for a class of linear-convex optimal control problems. We focus on a partial exponential turnpike property, established without imposing controllability or stabilizability…
In this article we approach a class of stochastic reachability problems with state constraints from an optimal control perspective. Preceding approaches to solving these reachability problems are either confined to the deterministic setting…
We present the conditions under which the time-optimal control problem for a nonlinear non-autonomous linearizable system can be solved by the method of successive approximations, at each step of which a power Markov moment min-problem is…
We develop methods to solve general optimal stopping problems with opportunities to stop that arrive randomly. Such problems occur naturally in applications with market frictions. Pivotal to our approach is that our methods operate on…
We study an optimal process control problem with multiple assignable causes. The process is initially in-control but is subject to random transition to one of multiple out-of-control states due to assignable causes. The objective is to find…
In this paper, we investigate the effects of applying generalised (non-exponential) discounting on a long-run impulse control problem for a Feller-Markov process. We show that the optimal value of the discounted problem is the same as the…
In this paper we investigate a new class of growth rate maximization problems based on impulse control strategies such that the average number of trades per time unit does not exceed a fixed level. Moreover, we include proportional…
Motivated by classical considerations from risk theory, we investigate boundary crossing problems for refracted L\'evy processes. The latter is a L\'evy process whose dynamics change by subtracting off a fixed linear drift (of suitable…
The study is devoted to mathematical modeling and optimal control design of longitudinal motions of a rectilinear elastic rod. The control inputs are a force, which is normal to the cross section and distributed piecewise constantly along…
We consider a new type of optimal stopping problems where the absorbing boundary moves as the state process X attains new maxima S. More specifically, we set the absorbing boundary as S-b where b is a certain constant. This problem is…
For spectrally negative L\'evy processes, we prove several fluctuation results involving a general draw-down time, which is a downward exit time from a dynamic level that depends on the running maximum of the process. In particular, we find…
This paper studies a continuous-review backlogged inventory model considered by Helmes et al. (2015) but with discontinuous quantity-dependent setup cost for each order. In particular, the setup cost is characterized by a two-step function…
One of the fundamental assumptions in stochastic control of continuous time processes is that the dynamics of the underlying (diffusion) process is known. This is, however, usually obviously not fulfilled in practice. On the other hand,…
The paper presents a nonlinear state-feedback control design approach for long-time average cost control, where the control effort is assumed to be expensive. The approach is based on sum-of-squares and semi-definite programming techniques.…
We develop optimal control strategies for Autonomous Vehicles (AVs) that are required to meet complex specifications imposed by traffic laws and cultural expectations of reasonable driving behavior. We formulate these specifications as…
The long-run average payoff per transition (mean payoff) is the main tool for specifying the performance and dependability properties of discrete systems. The problem of constructing a controller (strategy) simultaneously optimizing several…
In this paper, we consider the control problem with the Average-Value-at-Risk (AVaR) criteria of the possibly unbounded $L^{1}$-costs in infinite horizon on a Markov Decision Process (MDP). With a suitable state aggregation and by choosing…
This paper studies the problem of optimally extracting nonrenewable natural resources. Taking into account the fact that the market values of the main natural resources i.e. oil, natural gas, copper,..., etc, fluctuate randomly following…