Related papers: Occupied Processes: Going with the Flow
We derive a functional change of variable formula for {\it non-anticipative} functionals defined on the space of right continuous paths with left limits. The functional is only required to possess certain directional derivatives, which may…
We study an ordinary differential equation (ODE) arising as the many-server heavy-traffic fluid limit of a sequence of overloaded Markovian queueing models with two customer classes and two service pools. The system, known as the X model in…
We introduce a class of stochastic processes based on symmetric $\alpha$-stable processes. These are obtained by taking Markov processes and replacing the time parameter with the modulus of a symmetric $\alpha$-stable process. We call them…
IIn this paper we provide predictable and chaotic representations for It\^{o}-Markov additive processes $X$. Such a process is governed by a finite-state CTMC $J$ which allows one to modify the parameters of the It\^{o}-jump process (in…
We provide a suitable framework for the concept of finite quadratic variation for processes with values in a separable Banach space $B$ using the language of stochastic calculus via regularizations, introduced in the case $B= \R$ by the…
Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…
The continuous time stochastic process is a mainstream mathematical instrument modeling the random world with a wide range of applications involving finance, statistics, physics, and time series analysis, while the simulation and analysis…
We consider an orienteering problem (OP) where an agent needs to visit a series (possibly a subset) of depots, from which the maximal accumulated profits are desired within given limited time budget. Different from most existing works where…
In this paper we study the relationship between functional forward-backward stochastic systems and path-dependent PDEs. In the framework of functional It\^o calculus, we introduce a path-dependent PDE and prove that its solution is uniquely…
The problem of appropriately matching items subject to compatibility constraints arises in a number of important applications. While most of the literature on matching theory focuses on a static setting with a fixed number of items, several…
A semi-Markov process is one that changes states in accordance with a Markov chain but takes a random amount of time between changes. We consider the generalisation to semi-Markov processes of the classical Lamperti law for the occupation…
We establish It\^o's formula along flows of probability measures associated with general semimartingales; this generalizes existing results for flows of measures on It\^o processes. Our approach is to first establish It\^o's formula for…
In this paper, we consider the composition of two independent processes : one process corresponds to position and the other one to time. Such processes will be called iterated processes. We first propose an algorithm based on the Euler…
This work focuses on Exchangeable Occupancy Models (EOM) and their relations with the Uniform Order Statistics Property (UOSP) for point processes in discrete time. As our main purpose, we show how definitions and results presented in…
Stochastic processes time-changed by an inverse subordinator have been suggested as a way to model the price of assets in illiquid markets, where the jumps of the subordinator correspond to periods of time where one is unable to sell an…
In this article we study existence of pathwise stochastic integrals with respect to a general class of $n$-dimensional Gaussian processes and a wide class of adapted integrands. More precisely, we study integrands which are functions that…
In this paper we study coupled fully non-local equations, where a linear non-local operator jointly acts on the time and space variables. We establish existence and uniqueness of the solution. A maximum principle is proved and used to…
We are interested in risk constraints for infinite horizon discrete time Markov decision processes (MDPs). Starting with average reward MDPs, we show that increasing concave stochastic dominance constraints on the empirical distribution of…
We connect self-interacting processes, that is, stochastic processes where transitions depend on the time spent by a trajectory in each configuration, to Doob conditioning. In this way we demonstrate that Markov processes with constrained…
We show that a substantial portion of stochastic calculus can be developed along similar lines to ordinary calculus, with derivative-based concepts driving the development. We define a notion of stopping derivative, which is a form of right…