English
Related papers

Related papers: Effective computational methods for hybrid stochas…

200 papers

We develop a new bidirectional algorithm for estimating Markov chain multi-step transition probabilities: given a Markov chain, we want to estimate the probability of hitting a given target state in $\ell$ steps after starting from a given…

Data Structures and Algorithms · Computer Science 2015-11-05 Siddhartha Banerjee , Peter Lofgren

In the first part of this paper we study approximations of trajectories of Piecewise Deter-ministic Processes (PDP) when the flow is not explicit by the thinning method. We also establish a strong error estimate for PDPs as well as a weak…

Probability · Mathematics 2022-02-10 Vincent Lemaire , Michèle Thieullen , Nicolas Thomas

We study individual-based dynamics in finite populations, subject to randomly switching environmental conditions. These are inspired by models in which genes transition between on and off states, regulating underlying protein dynamics.…

Statistical Mechanics · Physics 2016-05-18 Peter G. Hufton , Yen Ting Lin , Tobias Galla , Alan J. McKane

We consider a stochastic model of gene expression in which transcription depends on a multistate promoter, including the famous two-state model and refractory promoters as special cases, and focus on deriving the exact stationary…

Probability · Mathematics 2019-08-05 Ulysse Herbach

We propose a class of discrete state sampling algorithms based on Nesterov's accelerated gradient method, which extends the classical Metropolis-Hastings (MH) algorithm. The evolution of the discrete states probability distribution governed…

Optimization and Control · Mathematics 2026-02-10 Bohan Zhou , Shu Liu , Xinzhe Zuo , Wuchen Li

The probability distribution describing the state of a Stochastic Reaction Network evolves according to the Chemical Master Equation (CME). It is common to estimated its solution using Monte Carlo methods such as the Stochastic Simulation…

Quantitative Methods · Quantitative Biology 2015-06-18 Benjamin Hepp , Ankit Gupta , Mustafa Khammash

Many physical and chemical processes, such as folding of biopolymers, are best described as dynamics on large combinatorial energy landscapes. A concise approximate description of dynamics is obtained by partitioning the micro-states of the…

Biomolecules · Quantitative Biology 2011-01-19 Martin Mann , Konstantin Klemm

Particle Markov Chain Monte Carlo methods are used to carry out inference in non-linear and non-Gaussian state space models, where the posterior density of the states is approximated using particles. Current approaches usually perform…

Computation · Statistics 2019-09-30 Eduardo F. Mendes , Christopher K. Carter , David Gunawan , Robert Kohn

Multivariate Hawkes Processes (MHPs) are a class of point processes that can account for complex temporal dynamics among event sequences. In this work, we study the accuracy and computational efficiency of three classes of algorithms which,…

Computation · Statistics 2025-02-24 Alex Ziyu Jiang , Abel Rodríguez

The need to calibrate increasingly complex statistical models requires a persistent effort for further advances on available, computationally intensive Monte Carlo methods. We study here an advanced version of familiar Markov Chain Monte…

Methodology · Statistics 2015-03-20 Alexandros Beskos , Konstantinos Kalogeropoulos , Erik Pazos

In this article we consider computing expectations w.r.t.~probability laws associated to a certain class of stochastic systems. In order to achieve such a task, one must not only resort to numerical approximation of the expectation, but…

Computation · Statistics 2017-10-30 Ajay Jasra , Kengo Kamatani , Kody Law , Yan Zhou

We present an investigation of stochastic evolution in which a family of evolution equations in $L^1$ are driven by continuous-time Markov processes. These are examples of so-called piecewise deterministic Markov processes (PDMP's) on the…

Probability · Mathematics 2020-12-01 Paweł Klimasara , Michael C. Mackey , Andrzej Tomski , Marta Tyran-Kamińska

Modern signal processing (SP) methods rely very heavily on probability and statistics to solve challenging SP problems. SP methods are now expected to deal with ever more complex models, requiring ever more sophisticated computational…

We consider a class of piecewise-deterministic Markov processes where the state evolves according to a linear dynamical system. This continuous time evolution is interspersed by discrete events that occur at random times and change (reset)…

Systems and Control · Computer Science 2017-11-15 Mohammad Soltani , Abhyudai Singh

Piecewise-deterministic Markov processes (PDMPs) offer a powerful stochastic modeling framework that combines deterministic trajectories with random perturbations at random times. Estimating their local characteristics (particularly the…

Methodology · Statistics 2025-12-29 Romain Azaïs , Solune Denis

We present a numerical approximation technique for the analysis of continuous-time Markov chains that describe networks of biochemical reactions and play an important role in the stochastic modeling of biological systems. Our approach is…

Quantitative Methods · Quantitative Biology 2010-05-06 Thomas A. Henzinger , Maria Mateescu , Linar Mikeev , Verena Wolf

Hybrid systems whose mode dynamics are governed by non-linear ordinary differential equations (ODEs) are often a natural model for biological processes. However such models are difficult to analyze. To address this, we develop a…

Systems and Control · Computer Science 2015-06-23 Benjamin M. Gyori , Bing Liu , Soumya Paul , R. Ramanathan , P. S. Thiagarajan

The dynamics of short-lived mRNA results in bursts of protein production in gene regulatory networks. We investigate the propagation of bursting noise between different levels of mathematical modelling, and demonstrate that conventional…

Molecular Networks · Quantitative Biology 2016-01-14 Yen Ting Lin , Tobias Galla

Biochemical reaction networks are often modelled using discrete-state, continuous-time Markov chains. System statistics of these Markov chains usually cannot be calculated analytically and therefore estimates must be generated via…

Quantitative Methods · Quantitative Biology 2016-04-19 Daniel Wilson , Ruth E. Baker

Markov chain Monte Carlo (MCMC) is widely used for Bayesian inference in models of complex systems. Performance, however, is often unsatisfactory in models with many latent variables due to so-called poor mixing, necessitating development…

Methodology · Statistics 2019-10-25 C. M. Pooley , S. C. Bishop , A. Doeschl-Wilson , G. Marion