Related papers: Optimal Markovian coupling for finite activity L\'…
This paper deals with the long run average continuous control problem of piecewise deterministic Markov processes (PDMP's) taking values in a general Borel space and with compact action space depending on the state variable. The control…
In this paper, we study a continuous-time discounted jump Markov decision process with both controlled actions and observations. The observation is only available for a discrete set of time instances. At each time of observation, one has to…
We present a novel approach of coupling two multidimensional and non-degenerate It\^o processes $(X_t)$ and $(Y_t)$ which follow dynamics with different drifts. Our coupling is sticky in the sense that there is a stochastic process $(r_t)$,…
Poissonian ensembles of Markov loops on a finite graph define a random graph process in which the addition of a loop can merge more than two connected components. We study Markov loops on the complete graph derived from a simple random walk…
We study Markovian continuous-time random walk models for L\'evy flights and we show an example in which the convergence to stable densities is not guaranteed when jumps follow a bi-modal power-law distribution that is equal to zero in…
We study the convergence rate of translation-invariant discrete-time quantum dynamics on a one-dimensional lattice. We prove that the cumulative distributions function of the ballistically scaled position $X(n)/{n}$ after $n$ steps…
We propose a method for approximating solutions to optimization problems involving the global stability properties of parameter-dependent continuous-time autonomous dynamical systems. The method relies on an approximation of the…
In this paper, we explore different Markovian random walk strategies on networks with transition probabilities between nodes defined in terms of functions of the Laplacian matrix. We generalize random walk strategies with local information…
It is shown how to construct a successful co-adapted coupling of two copies of an $n$-dimensional Brownian motion $(B_1,...,B_n)$ while simultaneously coupling all corresponding copies of L\'{e}vy stochastic areas $\int B_i dB_j-\int B_j…
Both resources in the natural environment and concepts in a semantic space are distributed "patchily", with large gaps in between the patches. To describe people's internal and external foraging behavior, various random walk models have…
We consider nonparametric statistical inference for L\'evy processes sampled irregularly, at low frequency. The estimation of the jump dynamics as well as the estimation of the distributional density are investigated. Non-asymptotic risk…
Random walk is a fundamental concept with applications ranging from quantum physics to econometrics. Remarkably, one specific model of random walks appears to be ubiquitous across many fields as a tool to analyze transport phenomena in…
This paper slightly improves a classical result by Gangbo and McCann (1996) about the structure of optimal transport plans for costs that are concave functions of the Euclidean distance. Since the main difficulty for proving the existence…
We consider SDEs driven by multiplicative pure jump L\'{e}vy noises, where L\'evy processes are not necessarily comparable to $\alpha$-stable-like processes. By assuming that the SDE has a unique solution, we obtain gradient estimates of…
We introduce a framework to approximate a Markov Decision Process that stands on two pillars: state aggregation -- as the algorithmic infrastructure; and central-limit-theorem-type approximations -- as the mathematical underpinning of…
This work introduces and studies a new family of velocity jump Markov processes directly amenable to exact simulation with the following two properties: i) trajectories converge in law when a time-step parameter vanishes towards a given…
Time estimation is a fundamental task that underpins precision measurement, global navigation systems, financial markets, and the organisation of everyday life. Many biological processes also depend on time estimation by nanoscale clocks,…
In the present paper we obtain sufficient conditions for the existence of equivalent martingale measures for L\'{e}vy-driven moving averages and other non-Markovian jump processes. The conditions that we obtain are, under mild assumptions,…
L\'evy walk process is one of the most effective models to describe superdiffusion, which underlies some important movement patterns and has been widely observed in the micro and macro dynamics. From the perspective of random walk theory,…
Designing and optimizing different flows in networks is a relevant problem in many contexts. While a number of methods have been proposed in the physics and optimal transport literature for the one-commodity case, we lack similar results…