English
Related papers

Related papers: Flowgraph Models and Analysis for Markov Jump Proc…

200 papers

Stochastic reaction networks are mathematical models with a wide range of applications in biochemistry, ecology, and epidemiology, and are often complex to analyze. Except for some special cases, it is generally difficult to predict how the…

Probability · Mathematics 2026-04-02 Daniele Cappelletti , Giulio Cuniberti , Paola Siri

We consider the application of fluctuation relations to the dynamics of coarse-grained systems, as might arise in a hypothetical experiment in which a system is monitored with a low-resolution measuring apparatus. We analyze a stochastic,…

Statistical Mechanics · Physics 2007-09-19 Saar Rahav , Christopher Jarzynski

We propose a general framework for studying jump-diffusion systems driven by both Gaussian noise and a jump process with state-dependent intensity. Of particular natural interest are the jump locations: the system evaluated at the jump…

Statistical Mechanics · Physics 2018-09-28 Christopher E. Miles , James P. Keener

The aim of this study is to extend the scope and applicability of the level-crossing method to discrete-time stochastic processes and generalize it to enable us to study multiple discrete-time stochastic processes. In previous versions of…

Data Analysis, Statistics and Probability · Physics 2016-09-15 Tayeb Jamali , G. R. Jafari , S. Vasheghani Farahani

An approach to analyse the properties of a particle system is to compare it with different processes to understand when one of them is larger than other ones. The main technique for that is coupling, which may not be easy to construct. We…

Probability · Mathematics 2011-02-22 Davide Borrello

For a continuous-time Markov process, we characterize the law of the first jump location when started from an arbitrary initial distribution, in terms of the invariant distribution of an auxiliary Markov process. This could be of interest…

Probability · Mathematics 2019-08-23 Andi Q. Wang , David Steinsaltz

Small nonequelibrium systems driven by an external periodic protocol can be described by Markov processes with time-periodic transition rates. In general, current fluctuations in such small systems are large and may play a crucial role. We…

Statistical Mechanics · Physics 2018-06-21 Andre C Barato , Raphael Chetrite

This paper deals a continuous-time state-dependent jump linear system, a particular kind of stochastic switching system. In particular, we consider a situation when the transition rate of the random jump process depends on the state…

Systems and Control · Computer Science 2016-11-26 Shaikshavali Chitraganti , Samir Aberkane , Christophe Aubrun

This paper introduces a novel methodology for the identification of switching dynamics for switched autoregressive linear models. Switching behavior is assumed to follow a Markov model. The system's outputs are contaminated by possibly…

Signal Processing · Electrical Eng. & Systems 2019-03-28 Sarah Hojjatinia , Constantino M. Lagoa

Hidden Markov jump processes are an attractive approach for modeling clinical disease progression data because they are explainable and capable of handling both irregularly sampled and noisy data. Most applications in this context consider…

Methodology · Statistics 2019-10-15 Rui Meng , Soper Braden , Jan Nygard , Mari Nygrad , Herbert Lee

State-switching models such as hidden Markov models or Markov-switching regression models are routinely applied to analyse sequences of observations that are driven by underlying non-observable states. Coupled state-switching models extend…

In this paper we study the dynamics of stochastic microorganism flocculation models. Given the strong influence of environmental and seasonal fluctuations that are present in these models, we propose a stochastic model that includes…

Probability · Mathematics 2025-11-18 Alexandru Hening , Nguyen T. Hieu , Dang H. Nguyen , Nhu Nguyen

The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial…

Probability · Mathematics 2023-11-03 Martin Bladt , Oscar Peralta

This paper aims to derive a quantitative model to evaluate the impact of information flow on the effectiveness of disaster response. At the core of the model is a specialized absorbing Markov chain that models the process of delivering…

Social and Information Networks · Computer Science 2020-07-07 Yitong Li , Wenying Ji

Biochemical reactions can happen on different time scales and also the abundance of species in these reactions can be very different from each other. Classical approaches, such as deterministic or stochastic approach, fail to account for or…

Quantitative Methods · Quantitative Biology 2014-09-16 Arnab Ganguly , Derya Altintan , Heinz Koeppl

Simulating transition dynamics between metastable states is a fundamental challenge in dynamical systems and stochastic processes with wide real-world applications in understanding protein folding, chemical reactions and neural activities.…

Machine Learning · Computer Science 2024-10-22 Haibo Wang , Yuxuan Qiu , Yanze Wang , Rob Brekelmans , Yuanqi Du

In this paper, we consider queueing systems where the dynamics are non-stationary and state-dependent. For performance analysis of these systems, fluid and diffusion models have been typically used. Although they are proven to be…

Probability · Mathematics 2016-09-08 Young Myoung Ko , Natarajan Gautam

We introduce a cellular automaton model coupled with a transport equation for flows on graphs. The direction of the flow is described by a switching process where the switching probability dynamically changes according to the value of the…

Cellular Automata and Lattice Gases · Physics 2013-07-02 Pierre Degond , Michael Herty , Jian-Guo Liu

The parameters of a discrete stationary Markov model are transition probabilities between states. Traditionally, data consist in sequences of observed states for a given number of individuals over the whole observation period. In such a…

Computation · Statistics 2012-04-30 Alberto Pasanisi , Shuai Fu , Nicolas Bousquet

Modeling turbulent flows by a random Fourier decomposition is a classical procedure in order to use simplified models of turbulence in heat transport and other applications. We carefully investigate the Fourier time series of…

Mathematical Physics · Physics 2026-05-14 Paolo Cifani , Franco Flandoli , Andrea Zanoni