English
Related papers

Related papers: From Markov Processes to Semimartingales

200 papers

In this paper, we consider a class of inhomogeneous semi-Markov processes directly based on intensity processes for marked point processes. We show that this class satisfies the semi-Markov properties defined elsewhere in the literature. We…

Probability · Mathematics 2015-04-14 Alexander Sokol

The paper studies stochastic integration with respect to Gaussian processes and fields. It is more convenient to work with a field than a process: by definition, a field is a collection of stochastic integrals for a class of deterministic…

Probability · Mathematics 2007-06-19 S. V. Lototsky , K. Stemmann

We introduce the minimal maximally predictive models ({\epsilon}-machines) of processes generated by certain hidden semi-Markov models. Their causal states are either hybrid discrete-continuous or continuous random variables and…

Statistical Mechanics · Physics 2017-05-24 Sarah E. Marzen , James P. Crutchfield

Multi-type Markov point processes offer a flexible framework for modelling complex multi-type point patterns where it is pertinent to capture both interactions between points as well as large scale trends depending on observed covariates.…

Methodology · Statistics 2025-10-15 Ib Thorsgaard Jensen , Jean-François Coeurjolly , Rasmus Waagepetersen

We classify the rare events of structured, memoryful stochastic processes and use this to analyze sequential and parallel generators for these events. Given a stochastic process, we introduce a method to construct a new process whose…

Statistical Mechanics · Physics 2017-04-05 C. Aghamohammadi , J. P. Crutchfield

We present an investigation of stochastic evolution in which a family of evolution equations in $L^1$ are driven by continuous-time Markov processes. These are examples of so-called piecewise deterministic Markov processes (PDMP's) on the…

Probability · Mathematics 2020-12-01 Paweł Klimasara , Michael C. Mackey , Andrzej Tomski , Marta Tyran-Kamińska

We start from the observation that, anytime two Markov generators share an eigenvalue, the function constructed from the product of the two eigenfunctions associated to this common eigenvalue is a duality function. We push further this…

Probability · Mathematics 2023-09-08 Frank Redig , Federico Sau

The deterministic analog of the Markov property of a time-homogeneous Markov process is the semigroup property of solutions of an autonomous differential equation. The semigroup property arises naturally when the solutions of a differential…

Dynamical Systems · Mathematics 2019-12-03 Jorge E. Cardona , Lev Kapitanski

We formally extend the notion of Markov order to open quantum processes by accounting for the instruments used to probe the system of interest at different times. Our description recovers the classical Markov order property in the…

Quantum Physics · Physics 2019-04-11 Philip Taranto , Felix A. Pollock , Simon Milz , Marco Tomamichel , Kavan Modi

Markov branching systems form a fundamental class of stochastic models that are extensively applied in biology, physics, finance, and other domains. These systems are distinguished by their continuous-time evolution and inherent branching…

We develop a general framework for extracting highly uniform bounds on local stability for stochastic processes in terms of information on fluctuations or crossings. This includes a large class of martingales: As a corollary of our main…

Probability · Mathematics 2024-08-05 Morenikeji Neri , Thomas Powell

A novel class of non-reversible Markov chain Monte Carlo schemes relying on continuous-time piecewise-deterministic Markov Processes has recently emerged. In these algorithms, the state of the Markov process evolves according to a…

Methodology · Statistics 2018-05-16 Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

The paper is devoted to a systematic study of the duality of processes in the sense that $E f(X_t^x,y)=E f (x, Y_t^y)$ for a certain $f$. This classical topic has well known applications in interacting particles, intertwining,…

Probability · Mathematics 2022-05-03 Vassili Kolokoltsov , RuiXin Lee

We use the global stochastic analysis tools introduced by P. A. Meyer and L. Schwartz to write down a stochastic generalization of the Hamilton equations on a Poisson manifold that, for exact symplectic manifolds, are characterized by a…

Probability · Mathematics 2007-10-08 Joan-Andreu Lázaro-Camí , Juan-Pablo Ortega

This work shows how exponential concentration inequalities for additive functionals of stochastic processes over a finite time interval can be derived from concentration inequalities for martingales. The approach is entirely probabilistic…

Probability · Mathematics 2020-07-14 Bob Pepin

The paper studies stochastic integration with respect to Gaussian processes and fields. It is more convenient to work with a field than a process: by definition, a field is a collection of stochastic integrals for a class of deterministic…

Probability · Mathematics 2007-10-15 S. V. Lototsky , K. Stemmann

Process mining is a well-established discipline of data analysis focused on the discovery of process models from information systems' event logs. Recently, an emerging subarea of process mining, known as stochastic process discovery, has…

Databases · Computer Science 2025-03-07 Anna Kalenkova , Lewis Mitchell , Matthew Roughan

This paper contributes to the study of a new and remarkable family of stochastic processes that we will term class $\Sigma^{r}(H)$. This class is potentially interesting because it unifies the study of two known classes: the class…

We study algorithms to analyze a particular class of Markov population processes that is often used in epidemiology. More specifically, Markov binomial chains are the model that arises from stochastic time-discretizations of classical…

Logic in Computer Science · Computer Science 2025-06-25 Alejandro Alarcón Gonzalez , Niel Hens , Tim Leys , Guillermo A. Pérez

It is common, when dealing with quantum processes involving a subsystem of a much larger composite closed system, to treat them as effectively memory-less (Markovian). While open systems theory tells us that non-Markovian processes should…

Quantum Physics · Physics 2019-05-02 Pedro Figueroa-Romero , Kavan Modi , Felix A. Pollock