相关论文: Fluctuation identities for omega-killed Markov add…

We consider a risk model with a counting process whose intensity is a Markovian shot-noise process, to resolve one of the disadvantages of the Cram\'er-Lundberg model, namely the constant jump intensity of the Poisson process. Due to this…

We consider a piecewise deterministic Markov decision process, where the expected exponential utility of total (nonnegative) cost is to be minimized. The cost rate, transition rate and post-jump distributions are under control. The state…

The infimum of an integrated current is its extreme value against the direction of its average flow. Using martingale theory, we show that the infima of integrated edge currents in time-homogeneous Markov jump processes are geometrically…

This paper deals with numerical solutions of maximizing expected utility from terminal wealth under a non-bankruptcy constraint. The wealth process is subject to shocks produced by a general marked point process. The problem of the agent is…

We consider statistical Markov Decision Processes where the decision maker is risk averse against model ambiguity. The latter is given by an unknown parameter which influences the transition law and the cost functions. Risk aversion is…

Certain Markov processes, or deterministic evolution equations, have the property that they are dual to a stochastic process that exhibits extinction versus unbounded growth, i.e., the total mass in such a process either becomes zero, or…

This paper studies a general L\'evy process model of the bail-out optimal dividend problem with an exponential time horizon, and further extends it to the regime-switching model. We first show the optimality of a double barrier strategy in…

In this work, we consider the optimal portfolio selection problem under hard constraints on trading volume amounts when the dynamics of the risky asset returns are governed by a discrete-time approximation of the Markov-modulated geometric…

We study the optimal stopping of an American call option in a random time-horizon under exponential spectrally negative L\'evy models. The random time-horizon is modeled as the so-called Omega default clock in insurance, which is the first…

A Markov chain model for spatially distributed autocatalytic systems with a quadratic reaction rate is considered. An approximate solution for the local probability distribution is obtained in the form of a perturbation expansion for the…

We find the variance-optimal equivalent martingale measure when multivariate assets are modeled by a regime-switching geometric Brownian motion, and the regimes are represented by a homogeneous continuous time Markov chain. Under this new…

We establish existence, uniqueness and regularity of solution results for a class of backward stochastic partial differential equations with singular terminal condition. The equation describes the value function of non-Markovian stochastic…

This tutorial describes recently developed general optimality conditions for Markov Decision Processes that have significant applications to inventory control. In particular, these conditions imply the validity of optimality equations and…

We study the computational complexity of central analysis problems for One-Counter Markov Decision Processes (OC-MDPs), a class of finitely-presented, countable-state MDPs. OC-MDPs are equivalent to a controlled extension of (discrete-time)…

We study long-term growth-optimal strategies on a simple market with linear proportional transaction costs. We show that several problems of this sort can be solved in closed form, and explicit the non-analytic dependance of optimal…

One of the most widely used methods for solving average cost MDP problems is the value iteration method. This method, however, is often computationally impractical and restricted in size of solvable MDP problems. We propose acceleration…

We consider killed Markov decision processes for countable models on a finite time-interval. Existence of a uniform $\varepsilon$-optimal policy is proven. We show the correctness of the fundamental equation. The optimal control problem is…

We study a class of multitype branching L\'evy processes, where particles move according to type-dependent L\'evy processes, switch types via an irreducible Markov chain, and branch according to type-dependent laws. This framework…

Motivated by a real failure dataset in a two-dimensional context, this paper presents an extension of the Markov modulated Poisson process (MMPP) to two dimensions. The one-dimensional MMPP has been proposed for the modeling of dependent…

In this paper we consider a modified version of the classical optimal dividends problem of de Finetti in which the dividend payments subject to a penalty at ruin. We assume that the risk process is modeled by a general spectrally positive…