Related papers: An optimal stopping problem for spectrally negativ…
Constrained Markov processes, such as reflecting diffusions, behave as an unconstrained process in the interior of a domain but upon reaching the boundary are controlled in some way so that they do not leave the closure of the domain. In…
This paper deals with the general discounted impulse control problem of a piecewise deterministic Markov process. We investigate a new family of epsilon-optimal strategies. The construction of such strategies is explicit and only…
Nesterov's well-known scheme for accelerating gradient descent in convex optimization problems is adapted to accelerating stationary iterative solvers for linear systems. Compared with classical Krylov subspace acceleration methods, the…
We construct stationary max-infinitely divisible (max-id) processes from systems of randomly time-changed L\'evy particles. Classical examples without time change, such as the Brown-Resnick process, are, up to marginal transformations,…
We analyze a modified version of Nesterov accelerated gradient algorithm, which applies to affine fixed point problems with non self-adjoint matrices, such as the ones appearing in the theory of Markov decision processes with discounted or…
This paper attempts to study the optimal stopping time for semi-Markov processes (SMPs) under the discount optimization criteria with unbounded cost rates. In our work, we introduce an explicit construction of the equivalent semi-Markov…
We study a Markov decision problem in which the state space is the set of finite marked point configurations in the plane, the actions represent thinnings, the reward is proportional to the mark sum which is discounted over time, and the…
This paper considers an optimal impulse control problem of dynamical systems generated by a flow. The performance criteria are total costs over the infinite time horizon. Apart from the main performance to be minimized, there are multiple…
We suppose that a L\'evy process is observed at discrete time points. Starting from an asymptotically minimax family of estimators for the continuous part of the L\'evy Khinchine characteristics, i.e., the covariance, we derive a…
In this article, we study a nonlinear stochastic control problem perturbed by multiplicative Levy noise, where the nonlinear operator in divergence form satisfies p type growth with coercivity assumptions. By using Aldous tightness criteria…
We consider a class of impulse control problems for general underlying strong Markov processes on the real line, which allows for an explicit solution. The optimal impulse times are shown to be of threshold type and the optimal threshold is…
We define a class of reflected backward stochastic differential equation (RBSDE) driven by a marked point process (MPP) and a Brownian motion, where the solution is constrained to stay above a given c\`adl\`ag process. The MPP is only…
We study stationary max-stable processes $\{\eta(t)\colon t\in\mathbb R\}$ admitting a representation of the form $\eta(t)=\max_{i\in\mathbb N}(U_i+ Y_i(t))$, where $\sum_{i=1}^{\infty} \delta_{U_i}$ is a Poisson point process on $\mathbb…
Stochastic maximum principle of nonlinear controlled forward-backward systems, where the set of strict (classical) controls need not be convex and the diffusion coefficient depends explicitly on the variable control, is an open problem…
In this article we consider a toy example of an optimal stopping problem driven by fragmentation processes. We show that one can work with the concept of stopping lines to formulate the notion of an optimal stopping problem and moreover, to…
We use the geometry of suitably generalised potentials to solve risk-sensitive Markovian optimal stopping problems. As in the linear case due to Dynkin and Yushkievich (1967), the value function is the pointwise infimum of those functions…
We derive sufficient and necessary optimality conditions in terms of a stochastic maximum principle (SMP) for controls associated with cost functionals of mean-field type, under dynamics driven by a class of Markov chains of mean-field type…
In this paper we consider a control problem for a Partially Observable Piecewise Deterministic Markov Process of the following type: After the jump of the process the controller receives a noisy signal about the state and the aim is to…
This paper investigates the random horizon optimal stopping problem for measure-valued piecewise deterministic Markov processes (PDMPs). This is motivated by population dynamics applications, when one wants to monitor some characteristics…
We recall four open problems concerning constructing high-order matrix-exponential approximations for the infimum of a spectrally negative Levy process (with applications to first-passage/ruin probabilities, the waiting time distribution in…