English
Related papers

Related papers: Continuous Time Markov Networks

200 papers

Big networks express various large-scale networks in many practical areas such as computer networks, internet of things, cloud computation, manufacturing systems, transportation networks, and healthcare systems. This paper analyzes such big…

Systems and Control · Computer Science 2016-04-06 Quan-Lin Li

We introduce a new class of time-continuous recurrent neural network models. Instead of declaring a learning system's dynamics by implicit nonlinearities, we construct networks of linear first-order dynamical systems modulated via nonlinear…

Machine Learning · Computer Science 2020-12-16 Ramin Hasani , Mathias Lechner , Alexander Amini , Daniela Rus , Radu Grosu

Monte Carlo (MC) simulations of transport in random porous networks indicate that for high variances of the log-normal permeability distribution, the transport of a passive tracer is non-Fickian. Here we model this non-Fickian dispersion in…

Computational Physics · Physics 2018-08-01 Amir H. Delgoshaie , Patrick Jenny , Hamdi A. Tchelepi

In many dynamical systems in nature, the law of the dynamics changes along with the temporal evolution of the system. These changes are often associated with the occurrence of certain events. The timing of occurrence of these events…

Probability · Mathematics 2021-07-12 S. Gallo , G. Iacobelli , G. Ost , D. Y. Takahashi

A continuous-time Markov chain (CTMC) execution is a continuous class of probability distributions over states. This paper proposes a probabilistic linear-time temporal logic, namely continuous-time linear logic (CLL), to reason about the…

Logic in Computer Science · Computer Science 2022-04-15 Ji Guan , Nengkun Yu

Information-theoretic quantities play a crucial role in understanding non-linear relationships between random variables and are widely used across scientific disciplines. However, estimating these quantities remains an open problem,…

Machine Learning · Computer Science 2025-02-28 Alberto Foresti , Giulio Franzese , Pietro Michiardi

Convolutional architectures have recently been shown to be competitive on many sequence modelling tasks when compared to the de-facto standard of recurrent neural networks (RNNs), while providing computational and modeling advantages due to…

Machine Learning · Computer Science 2019-02-19 Emre Aksan , Otmar Hilliges

Continuous Time Markov Chains (CTMC) have been used extensively to model reliability of storage systems. While the exponentially distributed sojourn time of Markov models is widely known to be unrealistic (and it is necessary to consider…

Performance · Computer Science 2015-03-30 Prasenjit Karmakar , K. Gopinath

Branching processes are a class of continuous-time Markov chains (CTMCs) with ubiquitous applications. A general difficulty in statistical inference under partially observed CTMC models arises in computing transition probabilities when the…

Computation · Statistics 2015-03-10 Jason Xu , Vladimir N. Minin

Sequential data naturally arises from user engagement on digital platforms like social media, music streaming services, and web navigation, encapsulating evolving user preferences and behaviors through continuous information streams. A…

Machine Learning · Computer Science 2024-02-28 Fabian Spaeh , Charalampos E. Tsourakakis

We propose a Bayesian hidden Markov model for analyzing time series and sequential data where a special structure of the transition probability matrix is embedded to model explicit-duration semi-Markovian dynamics. Our formulation allows…

Methodology · Statistics 2022-05-23 Beniamino Hadj-Amar , Jack Jewson , Mark Fiecas

Time bounded reachability is a fundamental problem in model checking continuous-time Markov chains (CTMCs) and Markov decision processes (CTMDPs) for specifications in continuous stochastic logics. It can be computed by numerically solving…

Systems and Control · Electrical Eng. & Systems 2020-01-07 Mahmoud Salamati , Sadegh Soudjani , Rupak Majumdar

Stochastic processes that involve the creation of objects and relations over time are widespread, but relatively poorly studied. For example, accurate fault diagnosis in factory assembly processes requires inferring the probabilities of…

Artificial Intelligence · Computer Science 2011-09-13 P. Domingos , S. Sanghai , D. Weld

This paper introduces a novel approach for modelling time-varying connectivity in neuroimaging data, focusing on the slow fluctuations in synaptic efficacy that mediate neuronal dynamics. Building on the framework of Dynamic Causal…

Neurons and Cognition · Quantitative Biology 2024-12-05 Johan Medrano , Karl J. Friston , Peter Zeidman

Many problems of practical interest rely on Continuous-time Markov chains~(CTMCs) defined over combinatorial state spaces, rendering the computation of transition probabilities, and hence probabilistic inference, difficult or impossible…

Modeling spatiotemporal dynamical systems is a fundamental challenge in machine learning. Transformer models have been very successful in NLP and computer vision where they provide interpretable representations of data. However, a…

Machine Learning · Computer Science 2023-08-01 Antonio H. de O. Fonseca , Emanuele Zappala , Josue Ortega Caro , David van Dijk

Complex networks have played an important role in describing real complex systems since the end of the last century. Recently, research on real-world data sets reports intermittent interaction among social individuals. In this paper, we pay…

Social and Information Networks · Computer Science 2025-11-25 Ziyan Zeng , Minyu Feng , Jürgen Kurths

A central task in many applications is reasoning about processes that change over continuous time. Continuous-Time Bayesian Networks is a general compact representation language for multi-component continuous-time processes. However, exact…

Artificial Intelligence · Computer Science 2012-06-18 Tal El-Hay , Nir Friedman , Raz Kupferman

We propose a method to approximate continuous-time, continuous-state stochastic processes by a discrete-time Markov chain defined on a nonuniform grid. Our method provides exact moment matching for processes whose first and second moments…

Probability · Mathematics 2025-11-27 Do Hyun Kim , Ahmet Cetinkaya

Over the past two decades, there has been a tremendous increase in the growth of representation learning methods for graphs, with numerous applications across various fields, including bioinformatics, chemistry, and the social sciences.…

Machine Learning · Computer Science 2023-12-21 Abdulkadir Celikkanat , Nikolaos Nakis , Morten Mørup