Related papers: Higher order PDE's and iterated Processes
We consider a stochastic, dynamic job scheduling problem, formulated as a queueing control problem, in which a single server processes jobs of different types that arrive according to independent Poisson processes. The problem is defined on…
In this work, we consider the stochastic Cauchy problem driven by the canonical $\alpha$-stable cylindrical L\'evy process. This noise naturally generalises the cylindrical Brownian motion or space-time Gaussian white noise. We derive a…
The complete physical understanding of the optimization of the thermodynamic work still is an important open problem in stochastic thermodynamics. We address this issue using the Hamiltonian approach of linear response theory in finite time…
The paper studies the First Order BSPDEs (Backward Stochastic Partial Differential Equations) suggested earlier for a case of multidimensional state domain with a boundary. These equations represent analogs of Hamilton-Jacobi-Bellman…
In this paper, a study of random times on filtered probability spaces is undertaken. The main message is that, as long as distributional properties of optional processes up to the random time are involved, there is no loss of generality in…
In the present work, we establish the approximation of nonlinear stochastic partial differential equation (SPDE) driven by cylindrical {\alpha}-stable L\'evy processes via modulation or amplitude equations. We study SPDEs with a cubic…
We introduce a generalized notion of semilinear elliptic partial differential equations where the corresponding second order partial differential operator $L$ has a generalized drift. We investigate existence and uniqueness of generalized…
We describe stochastic calculus in the context of processes that are driven by an adapted point process of locally finite intensity and are differentiable between jumps. This includes Markov chains as well as non-Markov processes. By…
We study algorithms to analyze a particular class of Markov population processes that is often used in epidemiology. More specifically, Markov binomial chains are the model that arises from stochastic time-discretizations of classical…
Mixed moving average processes appear in the ergodic decomposition of stationary symmetric \alpha-stable (S\alpha S) processes. They correspond to the dissipative part of "deterministic" flows generating S\alpha S processes (Rosinski,…
Correlated with the trend of increasing degrees of freedom in robotic systems is a similar trend of rising interest in Spatio-Temporal systems described by Partial Differential Equations (PDEs) among the robotics and control communities.…
We address stability of a class of Markovian discrete-time stochastic hybrid systems. This class of systems is characterized by the state-space of the system being partitioned into a safe or target set and its exterior, and the dynamics of…
We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of…
In this paper, we introduce a new simple approach to developing and establishing the convergence of splitting methods for a large class of stochastic differential equations (SDEs), including additive, diagonal and scalar noise types. The…
In this paper, we study forward-backward doubly stochastic differential equations driven by Brownian motions and Poisson process (FBDSDEP in short). Both the probabilistic interpretation for the solutions to a class of quasilinear…
We construct quadratic stochastic processes (QSP) (also known as Markov processes of cubic matrices) in continuous and discrete times. These are dynamical systems given by (a fixed type, called $\sigma$) stochastic cubic matrices satisfying…
We study a fairly general class of time-homogeneous stochastic evolutions driven by noises that are not white in time. As a consequence, the resulting processes do not have the Markov property. In this setting, we obtain constructive…
We investigate the process of eigenvalues of a symmetric matrix-valued process which upper diagonal entries are independent one-dimensional H\"older continuous Gaussian processes of order gamma in (1/2,1). Using the stochastic calculus with…
Markov Decision Processes (MDPs) have been used to formulate many decision-making problems in science and engineering. The objective is to synthesize the best decision (action selection) policies to maximize expected rewards (or minimize…
In this paper we study a class of combined regular and singular stochastic control problems that can be expressed as constrained BSDEs. In the Markovian case, this reduces to a characterization through a PDE with gradient constraint. But…