English
Related papers

Related papers: Comparison of Markov processes by the martingale c…

200 papers

Existing studies on the degree correlation of evolving networks typically rely on differential equations and statistical analysis, resulting in only approximate solutions due to inherent randomness. To address this limitation, we propose an…

Computation · Statistics 2024-06-13 Yue Xiao , Xiaojun Zhang

We show a decomposition into the sum of a martingale and a deterministic quantity for time averages of the solutions to non-autonomous SDEs and for discrete-time Markov processes. In the SDE case the martingale has an explicit…

Probability · Mathematics 2018-02-08 Bob Pepin

The master equation and, more generally, Markov processes are routinely used as models for stochastic processes. They are often justified on the basis of randomization and coarse-graining assumptions. Here instead, we derive n-th order…

Statistical Mechanics · Physics 2012-09-27 Julian Lee , Steve Pressé

In this note we connect the notion of solutions of a martingale problem to the notion of a strongly continuous and locally equi-continuous semigroup on the space of bounded continuous functions equipped with the strict topology. This…

Probability · Mathematics 2020-10-01 Richard C. Kraaij

The literature on Bayesian methods for the analysis of discrete-time semi-Markov processes is sparse. In this paper, we introduce the semi-Markov beta-Stacy process, a stochastic process useful for the Bayesian non-parametric analysis of…

Statistics Theory · Mathematics 2020-07-24 Andrea Arfè , Stefano Peluso , Pietro Muliere

An infinite system of point particles placed in $\mathds{R}^d$ is studied. Its constituents perform random jumps with mutual repulsion described by a translation-invariant jump kernel and interaction potential, respectively. The pure states…

Probability · Mathematics 2021-03-18 Yuri Kozitsky , Michael Röckner

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

Given a semi-Markov law, using an additional parameter, we consider a family of stochastic flows corresponding to that law. Then we suitably select a particular flow, for which we obtain expressions of the meeting and merging probabilities…

Probability · Mathematics 2022-10-20 Anindya Goswami , Ravishankar Kapildev Yadav

In a recent work \cite{BG}, given a collection of continuous semimartingales, authors derive a semimartingale decomposition from the corresponding ranked processes in the case that the ranked processes can meet more than two original…

Probability · Mathematics 2008-12-02 Raouf Ghomrasni , Olivier Menoukeu Pamen

Sequential scaling is a prominent inference-time scaling paradigm, yet its performance improvements are typically modest and not well understood, largely due to the prevalence of heuristic, non-principled approaches that obscure clear…

Machine Learning · Computer Science 2026-02-03 Youkang Wang , Jian Wang , Rubing Chen , Tianyi Zeng , Xiao-Yong Wei , Qing Li

For an infinite system of particles arriving in and departing from a habitat $X$ -- a locally compact Polish space with a positive Radon measure $\chi$ -- a Markov process is constructed in an explicit way. Along with its location $x\in X$,…

Probability · Mathematics 2021-12-10 Dominika Jasinska , Yuri Kozitsky

Inference for partially observed Markov process models has been a longstanding methodological challenge with many scientific and engineering applications. Iterated filtering algorithms maximize the likelihood function for partially observed…

Statistics Theory · Mathematics 2012-11-26 Edward L. Ionides , Anindya Bhadra , Yves Atchadé , Aaron King

We consider Markov processes, which describe e.g. queueing network processes, in a random environment which influences the network by determining random breakdown of nodes, and the necessity of repair thereafter. Starting from an explicit…

Probability · Mathematics 2015-03-03 H. Daduna , R. Szekli

This is an expository review paper illustrating the ``martingale method'' for proving many-server heavy-traffic stochastic-process limits for queueing models, supporting diffusion-process approximations. Careful treatment is given to an…

Probability · Mathematics 2007-12-28 Guodong Pang , Rishi Talreja , Ward Whitt

The notion of a successful coupling of Markov processes, based on the idea that both components of the coupled system ``intersect'' in finite time with probability one, is extended to cover situations when the coupling is unnecessarily…

Probability · Mathematics 2007-05-23 Michael Blank , Sergey Pirogov

We investigate the concatenation of Markov processes. Our primary concern is to utilize processes constructed in this manner for Monte Carlo integration. To enable this using conventional methods, it is essential to demonstrate the Markov…

Probability · Mathematics 2024-10-24 Sascha Holl

Markov branching systems form a fundamental class of stochastic models that are extensively applied in biology, physics, finance, and other domains. These systems are distinguished by their continuous-time evolution and inherent branching…

It was recently proven that the correlation function of the stationary version of a reflected L\'evy process is nonnegative, nonincreasing and convex. In another branch of the literature it was established that the mean value of the…

Probability · Mathematics 2021-08-16 Offer Kella , Michel Mandjes

It is common, when dealing with quantum processes involving a subsystem of a much larger composite closed system, to treat them as effectively memory-less (Markovian). While open systems theory tells us that non-Markovian processes should…

Quantum Physics · Physics 2019-05-02 Pedro Figueroa-Romero , Kavan Modi , Felix A. Pollock

Suppose that $X_1, \ldots , X_n$ are continuous semimartingales that are reversible and have nondegenerate crossings. Then the corresponding rank processes can be represented by generalized Stratonovich integrals, and this representation…

Probability · Mathematics 2017-05-02 Robert Fernholz