Related papers: Weak Convergence Methods for Approximation of Path…
We study systems of simple point processes that admit stochastic intensities. We represent these point processes as thinnings of Poisson measures and are interested in a convergence result of such systems. This result states that, if the…
In order to approximate a continuous time stochastic process by discrete time Markov chains one has several options to embed the Markov chains into continuous time processes. On the one hand there is the Markov embedding, which uses…
We discuss applications of a recently developed method for model reduction based on linear response theory of weakly coupled dynamical systems. We apply the weak coupling method to simple stochastic differential equations with slow and fast…
The purpose of this paper is to prove a weak convergence result for empirical processes indexed in general classes of functions and with an underlying $\alpha$-mixing sequence of random variables. In particular the uniformly boundedness…
We prove the almost sure weak convergence of a stochastic proximal point method for minimizing a convex integral function in the general nonlinear context of complete geodesic metric spaces of nonpositive curvature (so-called Hadamard…
We use the martingale convergence method to get the weak convergence theorem on general functionals of partial sums of independent heavy-tailed random variables. The limiting process is the stochastic integral driven by $\alpha-$stable…
Weak approximations have been developed to calculate the expectation value of functionals of stochastic differential equations, and various numerical discretization schemes (Euler, Milshtein) have been studied by many authors. We present a…
We prove convergence of the proximal policy gradient method for a class of constrained stochastic control problems with control in both the drift and diffusion of the state process. The problem requires either the running or terminal cost…
We introduce a notion of vague convergence for random marked metric measure spaces. Our main result shows that convergence of the moments of order $k \ge 1$ of a random marked metric measure space is sufficient to obtain its vague…
In this invited contribution, we revisit the stochastic shortest path problem, and show how recent results allow one to improve over the classical solutions: we present algorithms to synthesize strategies with multiple guarantees on the…
We consider autonomous stochastic ordinary differential equations (SDEs) and weak approximations of their solutions for a general class of sufficiently smooth path-dependent functionals f. Based on tools from functional It\^o calculus, such…
The aim of this paper is to approximate a finite-state Markov process by another process with fewer states, called herein the approximating process. The approximation problem is formulated using two different methods. The first method,…
Reinforced processes are known to provide a stochastic representation for the quasi-stationary distribution of a given killed Markov process - describing the killed Markov process at fixed time instants. In this paper we shall adapt the…
In this paper, we establish the theory of weak convergence (toward a normal distribution) for both single-chain and population stochastic approximation MCMC algorithms. Based on the theory, we give an explicit ratio of convergence rates for…
Topological measures and deficient topological measures are defined on open and closed subsets of a topological space, generalize regular Borel measures, and correspond to (non-linear in general) functionals that are linear on singly…
We propose a novel value function approximation technique for Markov decision processes. We consider the problem of compactly representing the state-action value function using a low-rank and sparse matrix model. The problem is to decompose…
Recently, for the joint partial sum and partial maxima processes constructed from linear processes with independent identically distributed innovations that are regularly varying with tail index $\alpha \in (0, 2)$, a functional limit…
Herein, a methodology is developed to replicate functions, measures and stochastic processes onto a compact metric space. Many results are easily established for the replica objects and then transferred back to the original ones. Two…
In this paper, we study the diffusion approximation for slow-fast stochastic differential equations with state-dependent switching, where the slow component $X^{\varepsilon}$ is the solution of a stochastic differential equation with…
In this paper, we investigate the construction of a diffusion process whose time-marginal densities are constrained to belong to a given set at all time. The construction is obtained from a penalization approximation to the constraint set,…