Related papers: Time Averages of Markov Processes and Applications…
In this paper we develop a continuous-time sequential importance sampling (CIS) algorithm which eliminates time-discretisation errors and provides online unbiased estimation for continuous time Markov processes, in particular for…
This work concerns about forward-backward multivalued stochastic systems. First of all, we prove one average principle for general stochastic differential equations in the $L^{2p}$ ($p\geq 1$) sense. Moreover, for $p=1$ a convergence rate…
We describe an exact approach for calculating transition probabilities and waiting times in finite-state discrete-time Markov processes. All the states and the rules for transitions between them must be known in advance. We can then…
This paper introduces time-continuous numerical schemes to simulate stochastic differential equations (SDEs) arising in mathematical finance, population dynamics, chemical kinetics, epidemiology, biophysics, and polymeric fluids. These…
We show the variational convergence of an irreversible Markov jump process describing a finite stochastic particle system to the solution of a countable infinite system of deterministic time-inhomogeneous quadratic differential equations…
In papers by Yor, a remarkable class $(\Sigma)$ of submartingales is introduced, which, up to technicalities, are submartingales $(X_{t})_{t\geq0}$ whose increasing process is carried by the times $t$ such that $X_{t}=0$. These…
In a fractional Cauchy problem, the usual first order time derivative is replaced by a fractional derivative. The fractional derivative models time delays in a diffusion process. The order of the fractional derivative can be distributed…
Discretization of continuous stochastic processes is needed to numerically simulate them or to infer models from experimental time series. However, depending on the nature of the process, the same discretization scheme, if not accurate…
The infimum of an integrated current is its extreme value against the direction of its average flow. Using martingale theory, we show that the infima of integrated edge currents in time-homogeneous Markov jump processes are geometrically…
Semi-Markov processes play an important role in the effective description of partially accessible systems in stochastic thermodynamics. They occur, for instance, in coarse-graining procedures such as state lumping and when analyzing waiting…
The paper is focused on the numerical solution of stochastic reaction-diffusion problems. A special attention is addressed to the conservation of mean-square dissipativity in the time integration of the spatially discretized problem,…
The convective Brinkman-Forchheimer equations describe the motion of incompressible fluid flows in a saturated porous medium. This work examines the multiscale stochastic convective Brinkman-Forchheimer (SCBF) equations perturbed by…
We consider a finite state discrete time process X. Without loss of generality the finite state space can be identified with the set of unit vectors {e1, e2, . . . , eN} with ei = (0, . . . , 0, 1, 0, . . . , 0)0 2 RN. For a Markov chain…
The estimation of absorption time distributions of Markov jump processes is an important task in various branches of statistics and applied probability. While the time-homogeneous case is classic, the time-inhomogeneous case has recently…
We consider a two-dimensional Hamiltonian system perturbed by a small diffusion term, whose coefficient is state-dependent and non-degenerate. As a result, the process consists of the fast motion along the level curves and slow motion…
Self-normalized processes arise naturally in statistical applications. Being unit free, they are not affected by scale changes. Moreover, self-normalization often eliminates or weakens moment assumptions. In this paper we present several…
This paper studies a large number of homogeneous Markov decision processes where the transition probabilities and costs are coupled in the empirical distribution of states (also called mean-field). The state of each process is not known to…
Counting and uniform sampling of directed acyclic graphs (DAGs) from a Markov equivalence class are fundamental tasks in graphical causal analysis. In this paper, we show that these tasks can be performed in polynomial time, solving a…
For discrete-time stochastic processes, there is a close connection between return/waiting times and entropy. Such a connection cannot be straightforwardly extended to the continuous-time setting. Contrarily to the discrete-time case one…
The solution to a multivariate linear Stochastic Differential Equation (SDE) with constant initial state is well known to be a Gaussian Markov process, but its covariance kernel involves the solution to an integral equation in the general…