English
Related papers

Related papers: A Markov jump process associated with the matrix-e…

200 papers

We propose a Bayesian inference approach for a class of latent Markov models. These models are widely used for the analysis of longitudinal categorical data, when the interest is in studying the evolution of an individual unobservable…

Methodology · Statistics 2011-01-05 Francesco Bartolucci , Silvia Pandolfi

The infinitesimal transition probability operator for a continuous-time discrete-state Markov process, $\mathcal{Q}$, can be decomposed into a symmetric and a skew-symmetric parts. As recently shown for the case of diffusion processes,…

Mathematical Physics · Physics 2013-04-09 Hong Qian

We investigate a piecewise-deterministic Markov process, evolving on a Polish metric space, whose deterministic behaviour between random jumps is governed by some semi-flow, and any state right after the jump is attained by a randomly…

Probability · Mathematics 2020-12-04 Dawid Czapla , Sander C. Hille , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

For a wide class of continuous-time Markov processes, including all irreducible hypoelliptic diffusions evolving on an open, connected subset of $\RL^d$, the following are shown to be equivalent: (i) The process satisfies (a slightly weaker…

Probability · Mathematics 2016-04-27 Ioannis Kontoyiannis , Sean P. Meyn

The evolution of a continuous time Markov process with a finite number of states is usually calculated by the Master equation - a linear differential equations with a singular generator matrix. We derive a general method for reducing the…

Quantitative Methods · Quantitative Biology 2012-07-19 Daniel Soudry , Ron Meir

The limits of scaled relative entropies between probability distributions associated with N-particle weakly interacting Markov processes are considered. The convergence of such scaled relative entropies is established in various settings.…

Probability · Mathematics 2015-02-16 Amarjit Budhiraja , Paul Dupuis , Markus Fischer , Kavita Ramanan

A rescaled Markov chain converges uniformly in probability to the solution of an ordinary differential equation, under carefully specified assumptions. The presentation is much simpler than those in the outside literature. The result may be…

Probability · Mathematics 2007-05-23 R. W. R. Darling

A key goal in the design of probabilistic inference algorithms is identifying and exploiting properties of the distribution that make inference tractable. Lifted inference algorithms identify symmetry as a property that enables efficient…

Artificial Intelligence · Computer Science 2019-07-02 Steven Holtzen , Todd Millstein , Guy Van den Broeck

Branching processes are a class of continuous-time Markov chains (CTMCs) with ubiquitous applications. A general difficulty in statistical inference under partially observed CTMC models arises in computing transition probabilities when the…

Computation · Statistics 2015-03-10 Jason Xu , Vladimir N. Minin

We build optimal exponential bounds for the probabilities of large deviations of sums \sum_{k=1}^nf(X_k) where (X_k) is a finite reversible Markov chain and f is an arbitrary bounded function. These bounds depend only on the stationary mean…

Probability · Mathematics 2007-05-23 Carlos A. Leon , Francois Perron

In the context of Markov evolution, we present two original approaches to obtain Generalized Fluctuation-Dissipation Theorems (GFDT), by using the language of stochastic derivatives and by using a family of exponential martingales…

Statistical Mechanics · Physics 2013-12-04 Raphael Chetrite , Shamik Gupta

In this paper we study an asymptotic expansion for the distribution of a random motion of a particle driven by a Markov process in diffusion approximation. We show that the singularly perturbed equation of a Markovian random motion can be…

Probability · Mathematics 2012-03-21 A. Pogorui

We discuss a Markov jump process regarded as a variant of the CIR (Cox-Ingersoll-Ross) model and its infinite-dimensional extension. These models belong to a class of measure-valued branching processes with immigration, whose jump…

Probability · Mathematics 2014-07-18 Kenji Handa

Starting at the mesoscopic level with a general formulation of stochastic thermodynamics in terms of Markov jump processes, we identify the scaling conditions that ensure the emergence of a (typically nonlinear) deterministic dynamics and…

Statistical Mechanics · Physics 2025-05-26 Gianmaria Falasco , Massimiliano Esposito

We consider a class of stochastic dynamical systems, called piecewise deterministic Markov processes, with states $(x, \s)\in \O\times \G$, $\O$ being a region in $\bbR^d$ or the $d$--dimensional torus, $\G$ being a finite set. The…

Statistical Mechanics · Physics 2009-02-25 Alessandra Faggionato , Davide Gabrielli , Marco Ribezzi Crivellari

Studying the subexponential convergence towards equilibrium of a strong Markov process, we exhibit an intermediate Lyapunov condition equivalent to the control of some moment of a hitting time. This provides a link, similar (although more…

Probability · Mathematics 2021-08-03 Armand Bernou

In order to describe the extremal behaviour of some stochastic process $X$, approaches from univariate extreme value theory are typically generalized to the spatial domain. In particular, generalized peaks-over-threshold approaches allow…

Methodology · Statistics 2026-01-01 Max Thannheimer , Marco Oesting

We are interested in the connection between a metastable continuous state space Markov process (satisfying e.g. the Langevin or overdamped Langevin equation) and a jump Markov process in a discrete state space. More precisely, we use the…

Probability · Mathematics 2017-02-08 Giacomo Di Gesù , Tony Lelièvre , Dorian Le Peutrec , Boris Nectoux

Large deviation theory is a branch of probability theory that is devoted to a study of the "rate" at which empirical estimates of various quantities converge to their true values. The object of study in this paper is the rate at which…

Statistics Theory · Mathematics 2013-09-17 Mathukumalli Vidyasagar

We introduce a theory of probability in $\lambda$-rings designed to efficiently describe random variables valued in multisets of complex numbers, varieties over a field, or other similar enriched settings. A key role is played by the…

Number Theory · Mathematics 2025-06-10 Sean Howe