English
Related papers

Related papers: How to Apply Markov Chains for Modeling Sequential…

200 papers

Markov chains are a common framework for individual-based state and time discrete models in ecology and evolution. Their use, however, is largely limited to systems with a low number of states, since the transition matrices involved pose…

Quantitative Methods · Quantitative Biology 2014-07-10 Katja Reichel , Valentin Bahier , Cédric Midoux , Jean-Pierre Masson , Solenn Stoeckel

In networking applications, one often wishes to obtain estimates about the number of objects at different parts of the network (e.g., the number of cars at an intersection of a road network or the number of packets expected to reach a node…

Social and Information Networks · Computer Science 2020-06-22 Harshal A. Chaudhari , Michael Mathioudakis , Evimaria Terzi

We argue that ontology-structured knowledge graphs can play a crucial role in generating predictions about future events. By leveraging the semantic framework provided by Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), we…

Artificial Intelligence · Computer Science 2025-09-22 Forrest Hare , Alec Sculley , Cameron Stockton

Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…

Probability · Mathematics 2021-04-13 Suryadeepto Nag

Predicting relative risk (RR) of spatial clusters is a complex task in public health that can be achieved through various statistical and machine-learning methods for different time intervals. However, high-resolution longitudinal data is…

Methodology · Statistics 2025-12-23 Lyza Iamrache , Kamel Rekab , Majid Bani-Yagoub , Julia Pluta , Abdelghani Mehailia

We introduce the Markovian Pre-trained Transformer (MPT) for next-item recommendation, a transferable model fully pre-trained on synthetic Markov chains, yet capable of achieving state-of-the-art performance by fine-tuning a lightweight…

Information Retrieval · Computer Science 2026-01-14 Cong Xu , Guoliang Li , Jun Wang , Wei Zhang

Markov chains are a class of probabilistic models that have achieved widespread application in the quantitative sciences. This is in part due to their versatility, but is compounded by the ease with which they can be probed analytically.…

Machine Learning · Computer Science 2023-12-18 Eddie Seabrook , Laurenz Wiskott

Chain-of-Thought (CoT) prompting is a widely used inference-time technique for improving reasoning, yet its gains are uneven across tasks. We analyze when and why CoT helps by modeling the step-wise reasoning trajectory as a Markov chain.…

Machine Learning · Computer Science 2026-03-03 Zihan Wang , Yijun Dong , Qi Lei

We introduce a framework for the modeling of sequential data capturing pathways of varying lengths observed in a network. Such data are important, e.g., when studying click streams in information networks, travel patterns in transportation…

Social and Information Networks · Computer Science 2017-11-20 Ingo Scholtes

This paper shows how we combine and adapt methods from elite training, future studies, and collaborative design, and apply them to address significant problems in social networks. We focus on three such methods: we use Project Action…

Social and Information Networks · Computer Science 2022-04-07 Joseph Corneli , Alex Murphy , Raymond S. Puzio , Leo Vivier , Noorah Alhasan , Charles J. Danoff , Vitor Bruno , Charlotte Pierce

Modeling the time evolution of discrete sets of items (e.g., genetic mutations) is a fundamental problem in many biomedical applications. We approach this problem through the lens of continuous-time Markov chains, and show that the…

Machine Learning · Computer Science 2021-07-08 Alkis Gotovos , Rebekka Burkholz , John Quackenbush , Stefanie Jegelka

Data mining is the task of discovering interesting patterns from large amounts of data. There are many data mining tasks, such as classification, clustering, association rule mining, and sequential pattern mining. Sequential pattern mining…

Databases · Computer Science 2010-02-08 Mahdi Esmaeili , Fazekas Gabor

In evolving complex systems such as air traffic and social organizations, collective effects emerge from their many components' dynamic interactions. While the dynamic interactions can be represented by temporal networks with nodes and…

Social and Information Networks · Computer Science 2017-09-21 Tiago P. Peixoto , Martin Rosvall

Object-centric process mining is a new paradigm with more realistic assumptions about underlying data by considering several case notions, e.g., an order handling process can be analyzed based on order, item, package, and route case…

Artificial Intelligence · Computer Science 2022-12-06 Amin Jalali

Known for its decentralized and tamper-aware properties, blockchain is attractive to enhance the infrastructure of systems that have been constrained by traditionally centralized and vendor-locked environments. Although blockchain has…

Cryptography and Security · Computer Science 2020-10-06 Peng Zhang , Douglas C. Schmidt , Jules White

We consider the analysis of sets of categorical sequences consisting of piecewise homogeneous Markov segments. The sequences are assumed to be governed by a common underlying process with segments occurring in the same order for each…

Methodology · Statistics 2015-04-08 Petter Arnesen , Tracy Holsclaw , Padhraic Smyth

In the companion paper of this set (Capitan and Cuesta, 2010) we have developed a full analytical treatment of the model of species assembly introduced in Capitan et al. (2009). This model is based on the construction of an assembly graph…

Populations and Evolution · Quantitative Biology 2015-02-18 Jose A. Capitan , Jose A. Cuesta , Jordi Bascompte

Continuous-time Markov chains are used to model stochastic systems where transitions can occur at irregular times, e.g., birth-death processes, chemical reaction networks, population dynamics, and gene regulatory networks. We develop a…

Machine Learning · Statistics 2022-12-13 Majerle Reeves , Harish S. Bhat

Despite the remarkable progress of multimodal large language models (MLLMs), they continue to face challenges in achieving competitive performance on ordinal regression (OR; a.k.a. ordinal classification). To address this issue, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Jinhong Wang , Shuo Tong , Jian liu , Dongqi Tang , Weiqiang Wang , Wentong Li , Hongxia Xu , Danny Chen , Jintai Chen , Jian Wu

Link prediction requires predicting which new links are likely to appear in a graph. Being able to predict unseen links with good accuracy has important applications in several domains such as social media, security, transportation, and…

Social and Information Networks · Computer Science 2020-06-08 Ghadeer Abuoda , Gianmarco De Francisci Morales , Ashraf Aboulnaga