English
Related papers

Related papers: Markov chain aggregation and its application to ru…

200 papers

Finite stochastic Markov models play a major role for modelling biochemical pathways. Such models are a coarse-grained description of the underlying microscopic dynamics and can be considered mesoscopic. The level of coarse-graining is to a…

Biological Physics · Physics 2012-06-05 Bernhard Altaner , Jürgen Vollmer

Molecular dynamics simulations have the potential to provide atomic-level detail and insight to important questions in chemical physics that cannot be observed in typical experiments. However, simply generating a long trajectory is…

Chemical Physics · Physics 2015-06-22 Christian R. Schwantes , Robert T. McGibbon , Vijay S. Pande

A stochastic model for a chemical reaction network is embedded in a one-parameter family of models with species numbers and rate constants scaled by powers of the parameter. A systematic approach is developed for determining appropriate…

Probability · Mathematics 2010-11-09 Hye-Won Kang , Thomas G. Kurtz

Building upon the rule-algebraic stochastic mechanics framework, we present new results on the relationship of stochastic rewriting systems described in terms of continuous-time Markov chains, their embedded discrete-time Markov chains and…

Logic in Computer Science · Computer Science 2021-02-05 Nicolas Behr

Predictive constructions are a powerful way of characterizing the probability law of stochastic processes with certain forms of invariance, such as exchangeability or Markov exchangeability. When de Finetti-like representation theorems are…

Methodology · Statistics 2015-11-16 Sandra Fortini , Sonia Petrone

The large-scale properties of chemical reaction systems, such as the metabolism, can be studied with graph-based methods. To do this, one needs to reduce the information -- lists of chemical reactions -- available in databases. Even for the…

Molecular Networks · Quantitative Biology 2009-09-25 Petter Holme

Molecular simulations can provide microscopic insight into the physical and chemical driving forces of complex molecular processes. Despite continued advancement of simulation methodology, model errors may lead to inconsistencies between…

Chemical Physics · Physics 2016-02-12 Joseph F. Rudzinski , Kurt Kremer , Tristan Bereau

The linear response of a dynamical system refers to changes to properties of the system when small external perturbations are applied. We consider the little-studied question of selecting an optimal perturbation so as to (i) maximise the…

Dynamical Systems · Mathematics 2018-04-04 Fadi Antown , Davor Dragičević , Gary Froyland

Coarse-graining techniques play a central role in reducing the complexity of stochastic models, and are typically characterised by a mapping which projects the full state of the system onto a smaller set of variables which captures the…

Probability · Mathematics 2023-09-28 Bastian Hilder , Upanshu Sharma

For Markov processes evolving on multiple time-scales a combination of large component scalings and averaging of rapid fluctuations can lead to useful limits for model approximation. A general approach to proving a law of large numbers to a…

Probability · Mathematics 2020-12-29 Lea Popovic

In this work, we present a general method to establish properties of multi-dimensional continuous-time Markov chains representing stochastic reaction networks. This method consists of grouping states together (via a partition of the state…

Probability · Mathematics 2025-05-27 Guillaume Ballif , Laurent Pfeiffer , Jakob Ruess

Markov chain Monte Carlo (MCMC) algorithms provide a very general recipe for estimating properties of complicated distributions. While their use has become commonplace and there is a large literature on MCMC theory and practice, MCMC users…

Computation · Statistics 2012-05-03 Murali Haran , Luke Tierney

We study the stochastic dynamics of a system of interacting species in a stochastic environment by means of a continuous-time Markov chain with transition rates depending on the state of the environment. Models of gene regulation in systems…

Dynamical Systems · Mathematics 2019-12-03 Daniele Cappelletti , Abhishek Pal Majumder , Carsten Wiuf

Chemically active mixtures exhibit complex patterns that emerge from the interplay of physical interactions and reactions among components. Individually, these two processes are well-understood: Physical interactions can give rise to phase…

Soft Condensed Matter · Physics 2026-04-30 Chengjie Luo , Yicheng Qiang , Guido L. A. Kusters , David Zwicker

Given a strongly stationary Markov chain and a finite set of stopping rules, we prove the existence of a polynomial algorithm which projects the Markov chain onto a minimal Markov chain without redundant information. Markov complexity is…

Probability · Mathematics 2007-05-23 Giacomo Aletti

We consider stochastic reaction networks modeled by continuous-time Markov chains. Such reaction networks often contain many reactions, potentially occurring at different time scales, and have unknown parameters (kinetic rates, total…

Probability · Mathematics 2023-02-20 Linard Hoessly , Carsten Wiuf

We propose a Markov chain simulation method to generate simple connected random graphs with a specified degree sequence and level of clustering. The networks generated by our algorithm are random in all other respects and can thus serve as…

Discrete Mathematics · Computer Science 2010-02-09 Shweta Bansal , Shashank Khandelwal , Lauren Ancel Meyers

In networking applications, one often wishes to obtain estimates about the number of objects at different parts of the network (e.g., the number of cars at an intersection of a road network or the number of packets expected to reach a node…

Social and Information Networks · Computer Science 2020-06-22 Harshal A. Chaudhari , Michael Mathioudakis , Evimaria Terzi

Traditional methods for unsupervised learning of finite mixture models require to evaluate the likelihood of all components of the mixture. This becomes computationally prohibitive when the number of components is large, as it is, for…

Machine Learning · Computer Science 2021-10-12 Milan Papež , Tomáš Pevný , Václav Šmídl

Model reduction of Markov processes is a basic problem in modeling state-transition systems. Motivated by the state aggregation approach rooted in control theory, we study the statistical state compression of a discrete-state Markov chain…

Machine Learning · Statistics 2019-11-26 Anru Zhang , Mengdi Wang