Related papers: Markovian Integral Equations
Given a general It\^o semimartingale, its Markovian projection is an It\^o process, with Markovian differential characteristics, that matches the one-dimensional marginal laws of the original process. We construct Markovian projections for…
We analyze asymptotically a differential-difference equation, that arises in a Markov-modulated fluid model. Here there are N identical sources that turn "on" and "off", and when "on" they generate fluid at unit rate into a buffer, which…
This paper is a step in the direction of understanding the behavior of non-intersecting Brownian motions on the real line, when the number of particles becomes large. Consider 2k non-intersecting Brownian motions, all starting at the…
We consider a piecewise deterministic Markov decision process, where the expected exponential utility of total (nonnegative) cost is to be minimized. The cost rate, transition rate and post-jump distributions are under control. The state…
We propose an analytic approach for the steady-state dynamics of Markov processes on locally tree-like graphs. It is based on time-translation invariant probability distributions for edge trajectories, which we encode in terms of infinite…
We propose a diffusion approximation method to the continuous-state Markov Decision Processes (MDPs) that can be utilized to address autonomous navigation and control in unstructured off-road environments. In contrast to most…
In terms of a nice reference probability measure, integrability conditions on the path-dependent drift are presented for (infinite-dimensional) degenerate PDEs to have regular positive solutions. To this end, the corresponding stochastic…
We provide necessary and sufficient conditions for convergence of exponential integrals of Markov additive processes. Other than in the classical L\'evy case studied by Erickson and Maller we have to distinguish between almost sure…
Recently, a class of stochastic processes known as piecewise deterministic Markov processes has been used to define continuous-time Markov chain Monte Carlo algorithms with a number of attractive properties, including compatibility with…
We prove a limit theorem for an integral functional of a Markov process. The Markovian dynamics is characterized by a linear Boltzmann equation modeling a one-dimensional test particle of mass $\lambda^{-1}\gg 1$ in an external periodic…
The infinite discrete stable Boltzmann maps are "heavy-tailed" generalisations of the well-known Uniform Infinite Planar Quadrangulation. Very efficient tools to study these objects are Markovian step-by-step explorations of the lattice…
The theory of monotonicity and duality is developed for general one-dimensional Feller processes. Moreover it is shown that local monotonicity conditions (conditions on the L\'evy kernel) are sufficient to prove the well-posedness of the…
This paper develops a class of robust weak Galerkin methods for the stationary incompressible convective Brinkman-Forchheimer equations. The methods adopt piecewise polynomials of degrees $m\ (m\geq1)$ and $m-1$ respectively for the…
We develop Markov categories as a framework for synthetic probability and statistics, following work of Golubtsov as well as Cho and Jacobs. This means that we treat the following concepts in purely abstract categorical terms: conditioning…
In this paper we study time-inhomogeneous affine processes beyond the common assumption of stochastic continuity. In this setting times of jumps can be both inaccessible and predictable. To this end we develop a general theory of finite…
Discrete dynamical systems over finite fields are investigated and their integrability is discussed. In particular, the discrete Painlev\'{e} equations and the discrete KdV equation are defined over finite fields and their special solutions…
The theory of one-dimensional stochastic differential equations driven by Brownian motion is classical and has been largely understood for several decades. For stochastic differential equations with jumps the picture is still incomplete,…
A distributional equation as a criterion for invariant measures of Markov processes associated to L\'evy-type operators is established. This is obtained via a characterization of infinitesimally invariant measures of the associated…
This article deals with the existence and the uniqueness of solutions to quadratic and superquadratic Markovian backward stochastic differential equations (BSDEs for short) with an unbounded terminal condition. Our results are deeply linked…
This paper studies three ways to construct a nonhomogeneous jump Markov process: (i) via a compensator of the random measure of a multivariate point process, (ii) as a minimal solution of the backward Kolmogorov equation, and (iii) as a…