English
Related papers

Related papers: Continuous Time Markov Networks

200 papers

There has been an increasing interest in modeling continuous-time dynamics of temporal graph data. Previous methods encode time-evolving relational information into a low-dimensional representation by specifying discrete layers of neural…

Machine Learning · Computer Science 2022-06-01 Jin Guo , Zhen Han , Zhou Su , Jiliang Li , Volker Tresp , Yuyi Wang

Continuous-time Markov chains are used to model stochastic systems where transitions can occur at irregular times, e.g., birth-death processes, chemical reaction networks, population dynamics, and gene regulatory networks. We develop a…

Machine Learning · Statistics 2022-12-13 Majerle Reeves , Harish S. Bhat

The emergence and progression of multiple chronic conditions (MCC) over time often form a dynamic network that depends on patient's modifiable risk factors and their interaction with non-modifiable risk factors and existing conditions.…

Complex systems made of interacting elements are commonly abstracted as networks, in which nodes are associated with dynamic state variables, whose evolution is driven by interactions mediated by the edges. Markov processes have been the…

Physics and Society · Physics 2017-01-30 Vsevolod Salnikov , Michael T. Schaub , Renaud Lambiotte

We study time-changed Markov processes to speed up the convergence of Markov chain Monte Carlo (MCMC) algorithms. The time-changed process is defined by adjusting the speed of time of a base process via a user-chosen, state-dependent…

Computation · Statistics 2025-04-08 Andrea Bertazzi , Giorgos Vasdekis

Continuous Time Markov Chain (CMTC) is widely used to describe and analyze systems in several knowledge areas. Steady state availability is one important analysis that can be made through Markov chain formalism that allows researchers…

Performance · Computer Science 2017-01-24 Eduardo M. Vasconcelos

Probabilistic Boolean Networks (PBNs) have been previously proposed so as to gain insights into complex dy- namical systems. However, identification of large networks and of the underlying discrete Markov Chain which describes their…

Machine Learning · Computer Science 2018-01-24 Ifigeneia Apostolopoulou , Diana Marculescu

Biological brains demonstrate complex neural activity, where neural dynamics are critical to how brains process information. Most artificial neural networks ignore the complexity of individual neurons. We challenge that paradigm. By…

Machine Learning · Computer Science 2025-10-06 Luke Darlow , Ciaran Regan , Sebastian Risi , Jeffrey Seely , Llion Jones

We study the problem of finite-horizon probabilistic invariance for discrete-time Markov processes over general (uncountable) state spaces. We compute discrete-time, finite-state Markov chains as formal abstractions of general Markov…

Systems and Control · Computer Science 2015-07-03 Sadegh Esmaeil Zadeh Soudjani , Alessandro Abate , Rupak Majumdar

In this paper, it is presented a methodology for implementing arbitrarily constructed time-homogenous Markov chains with biochemical systems. Not only discrete but also continuous-time Markov chains are allowed to be computed. By employing…

Molecular Networks · Quantitative Biology 2018-02-16 Chuan Zhang , Ziyuan Shen , Wei Wei , Jing Zhao , Zaichen Zhang , Xiaohu You

We present a Metropolis-Hastings Markov chain Monte Carlo (MCMC) algorithm for detecting hidden variables in a continuous time Bayesian network (CTBN), which uses reversible jumps in the sense defined by (Green 1995). In common with several…

Methodology · Statistics 2014-03-18 Blazej Miasojedow , Wojciech Niemiro , John Noble , Krzysztof Opalski

From genetic regulatory networks to nervous systems, the interactions between elements in biological networks often take a sigmoidal or S-shaped form. This paper develops a probabilistic characterization of the parameter space of…

Neurons and Cognition · Quantitative Biology 2010-10-11 Randall D. Beer , Bryan Daniels

We define an evolving in-time Bayesian neural network called a Hidden Markov Neural Network, which addresses the crucial challenge in time-series forecasting and continual learning: striking a balance between adapting to new data and…

Machine Learning · Statistics 2025-01-17 Lorenzo Rimella , Nick Whiteley

Inspired by the human ability to understand and predict others, we study the applicability of Conditional Neural Processes (CNP) to the task of self-supervised multimodal action prediction in robotics. Following recent results regarding the…

Robotics · Computer Science 2026-04-10 Marco Gabriele Fedozzi , Yukie Nagai , Francesco Rea , Alessandra Sciutti

Labeled continuous-time Markov chains (CTMCs) describe processes subject to random timing and partial observability. In applications such as runtime monitoring, we must incorporate past observations. The timing of these observations matters…

Logic in Computer Science · Computer Science 2024-01-30 Thom Badings , Matthias Volk , Sebastian Junges , Marielle Stoelinga , Nils Jansen

We are interested in the analysis of very large continuous-time Markov chains (CTMCs) with many distinct rates. Such models arise naturally in the context of reliability analysis, e.g., of computer network performability analysis, of power…

Logic in Computer Science · Computer Science 2015-07-24 Ernst Moritz Hahn , Holger Hermanns , Ralf Wimmer , Bernd Becker

In this paper we develop the elements of the theory of algorithmic randomness in continuous-time Markov chains (CTMCs). Our main contribution is a rigorous, useful notion of what it means for an individual trajectory of a CTMC to be random.…

Information Theory · Computer Science 2025-10-21 Xiang Huang , Jack H. Lutz , Neil Lutz , Andrei N. Migunov

This paper provides full classification of dynamics for continuous time Markov chains (CTMCs) on the non-negative integers with polynomial transition rate functions. Such stochastic processes are abundant in applications, in particular in…

Probability · Mathematics 2021-12-01 Chuang Xu , Mads Christian Hansen , Carsten Wiuf

This article presents an algorithm that allows modeling of biological networks in a qualitative framework with continuous time. Mathematical modeling is used as a systems biology tool to answer biological questions, and more precisely, to…

Molecular Networks · Quantitative Biology 2012-05-30 Gautier Stoll , Eric Viara , Emmanuel Barillot , Laurence Calzone

Temporal networks are widely used models for describing the architecture of complex systems. Network memory -- that is the dependence of a temporal network's structure on its past -- has been shown to play a prominent role in diffusion,…

Physics and Society · Physics 2020-04-28 Oliver E. Williams , Lucas Lacasa , Ana P. Millán , Vito Latora