Related papers: T. E. Harris's contributions to recurrent Markov p…
We present a tractable non-independent increment process which provides a high modeling flexibility. The process lies on an extension of the so-called Harris chains to continuous time being stationary and Feller. We exhibit constructions,…
This is a review of current research in Markov chains as toric statistical models. Its content is mixture of background information, results from the relevant recent literature, new results, and work in progress.
Recently, the theoretical framework of stochastic thermodynamics has been revealed to be useful for macroscopic systems. However, despite its conceptual and practical importance, the connection to hydrodynamics has yet to be explored. In…
This brief article reviews stochastic processes as relevant to dynamical models of wave-function collapse, and is supplemental material for the review article arXiv:1204.4325
In this article, we derive a Stratonovich and Skorohod type change of variables formula for a multidimensional Gaussian process with low H\"older regularity (typically lower than 1/4). To this aim, we combine tools from rough paths theory…
We suggest to investigate certain non-standard (pseudo-)differential operators in order to construct and to study multi-parameter processes. Our approach will include "classical" multi-parameter Markov processes but will go eventually far…
In the development of stochastic integration and the theory of semimartingales, Markov processes have been a constant source of inspiration. Despite this historical interweaving, it turned out that semimartingales should be considered the…
We present a Markov-chain analysis of blockwise-stochastic algorithms for solving partially block-separable optimization problems. Our main contributions to the extensive literature on these methods are statements about the Markov operators…
Time-irreversible stochastic processes are frequently used in natural sciences to explain non-equilibrium phenomena and to design efficient stochastic algorithms. Our main goal in this thesis is to analyse their dynamics by means of large…
Given a semi-Markov law, using an additional parameter, we consider a family of stochastic flows corresponding to that law. Then we suitably select a particular flow, for which we obtain expressions of the meeting and merging probabilities…
This article presents a short and concise description of stochastic approximation algorithms in reinforcement learning of Markov decision processes. The algorithms can also be used as a suboptimal method for partially observed Markov…
Markov chains are studied in a formulation involving forces and fluxes. First, the iso-dissipation force recently introduced in the physics literature is investigated; we show that its non-uniqueness is linked to different notions of…
We introduce a novel type of random perturbation for the classical Lorenz flow in order to better model phenomena slowly varying in time such as anthropogenic forcing in climatology and prove stochastic stability for the unperturbed flow.…
Iteration of randomly chosen quadratic maps defines a Markov process: X_{n+1}=\epsilon_{n+1}X_n(1-X_n), where \epsilon_n are i.i.d. with values in the parameter space [0,4] of quadratic maps F_{\theta}(x)=\theta x(1-x). Its study is of…
We consider the Markov chain approximations for singular stable-like processes. First we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a necessary condition for weak convergence of these…
In this paper, the recurrent events that can occur more than one over the follow-up time have been modeled by phase-type distributions. We use the finite-state continuous-time Markov process with multi states for patients with recurrent…
The Law of the Iterated Logarithm for some Markov operators, which converge exponentially to the invariant measure, is established. The operators correspond to iterated function systems which, for example, may be used to generalize the cell…
These lecture notes present some new concentration inequalities for Feynman-Kac particle processes. We analyze different types of stochastic particle models, including particle profile occupation measures, genealogical tree based evolution…
We analyze and partially solve system of recurrences that can be derived from the properties of martingale orthogonal polynomials that characterize quadratic harnesses (QH). We also specify conditions for the existence of moments of one…
Spatial birth-and-death processes with a finite number of particles are obtained as unique solutions to certain stochastic equations. Conditions are given for existence and uniqueness of such solutions, as well as for continuous dependence…