English
Related papers

Related papers: Variable length Markov chains and dynamical source…

200 papers

One-dimensional run-and-tumble processes may converge towards some localized non-equilibrium steady state when the two velocities and/or the two switching rates are space-dependent. A long dynamical trajectory can be then analyzed via the…

Statistical Mechanics · Physics 2021-08-23 Cecile Monthus

Stochastic models of evolution (Markov random fields on trivalent trees) generally assume that different characters (different runs of the stochastic process) are independent and identically distributed. In this paper we take the first…

Populations and Evolution · Quantitative Biology 2014-10-28 Deeparnab Chakrabarty , Sampath Kannan , Kevin Tian

Multivariate extreme value distributions are a common choice for modelling multivariate extremes. In high dimensions, however, the construction of flexible and parsimonious models is challenging. We propose to combine bivariate max-stable…

Methodology · Statistics 2024-12-25 Shuang Hu , Zuoxiang Peng , Johan Segers

Markov decision processes (MDPs) are a popular model for decision-making in the presence of uncertainty. The conventional view of MDPs in verification treats them as state transformers with probabilities defined over sequences of states and…

Formal Languages and Automata Theory · Computer Science 2025-07-25 Yun Chen Tsai , Kittiphon Phalakarn , S. Akshay , Ichiro Hasuo

Efficient automatic protein classification is of central importance in genomic annotation. As an independent way to check the reliability of the classification, we propose a statistical approach to test if two sets of protein domain…

Parametric Interval Markov Chains (pIMCs) are a specification formalism that extend Markov Chains (MCs) and Interval Markov Chains (IMCs) by taking into account imprecision in the transition probability values: transitions in pIMCs are…

Logic in Computer Science · Computer Science 2017-06-02 Anicet Bart , Benoit Delahaye , Didier Lime , Eric Monfroy , Charlotte Truchet

Parse trees are fundamental syntactic structures in both computational linguistics and compilers construction. We argue in this paper that, in both fields, there are good incentives for model-checking sets of parse trees for some word…

Logic in Computer Science · Computer Science 2013-08-23 Anudhyan Boral , Sylvain Schmitz

We analyze the properties of degree-preserving Markov chains based on elementary edge switchings in undirected and directed graphs. We give exact yet simple formulas for the mobility of a graph (the number of possible moves) in terms of its…

Disordered Systems and Neural Networks · Physics 2012-03-12 E. S. Roberts , A. Annibale , A. C. C. Coolen

In many insurance contexts, dependence between risks of a portfolio may arise from their frequencies. We investigate a dependent risk model in which we assume the vector of count variables to be a tree-structured Markov random field with…

Methodology · Statistics 2026-02-03 Hélène Cossette , Benjamin Côté , Alexandre Dubeau , Etienne Marceau

Large language models (LLMs) are trained on enormous amounts of data and encode knowledge in their parameters. We propose a pipeline to elicit causal relationships from LLMs. Specifically, (i) we sample many documents from LLMs on a given…

Machine Learning · Computer Science 2026-03-05 Takashi Kameyama , Masahiro Kato , Yasuko Hio , Yasushi Takano , Naoto Minakawa

Stochastic reaction networks are mathematical models with a wide range of applications in biochemistry, ecology, and epidemiology, and are often complex to analyze. Except for some special cases, it is generally difficult to predict how the…

Probability · Mathematics 2026-04-02 Daniele Cappelletti , Giulio Cuniberti , Paola Siri

We present an investigation of stochastic evolution in which a family of evolution equations in $L^1$ are driven by continuous-time Markov processes. These are examples of so-called piecewise deterministic Markov processes (PDMP's) on the…

Probability · Mathematics 2020-12-01 Paweł Klimasara , Michael C. Mackey , Andrzej Tomski , Marta Tyran-Kamińska

Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which…

Probability · Mathematics 2021-08-03 Alain Durmus , Arnaud Guillin , Pierre Monmarché

In some problems there is information about the destination of a moving object. An example is an airliner flying from an origin to a destination. Such problems have three main components: an origin, a destination, and motion in between. To…

Systems and Control · Computer Science 2021-03-16 Reza Rezaie , X. Rong Li

Accessibility percolation is a new type of percolation problem inspired by evolutionary biology. To each vertex of a graph a random number is assigned and a path through the graph is called accessible if all numbers along the path are in…

Statistical Mechanics · Physics 2013-04-04 Stefan Nowak , Joachim Krug

Triplet Markov chains are general generative models for sequential data which take into account three kinds of random variables: (noisy) observations, their associated discrete labels and latent variables which aim at strengthening the…

Machine Learning · Statistics 2023-09-08 Katherine Morales , Yohan Petetin

This paper presents a novel theoretical Monte Carlo Markov chain procedure in the framework of graphs. It specifically deals with the construction of a Markov chain whose empirical distribution converges to a given reference one. The Markov…

Probability · Mathematics 2019-07-02 Roy Cerqueti , Emilio De Santis

We study a problem of model selection for data produced by two different context tree sources. Motivated by linguistic questions, we consider the case where the probabilistic context trees corresponding to the two sources are finite and…

Statistics Theory · Mathematics 2013-08-12 Antonio Galves , Aurélien Garivier , Elisabeth Gassiat

A discrete time branching process where the offspring distribution is generation-dependent, and the number of reproductive individuals is controlled by a random mechanism is considered. This model is a Markov chain but, in general, the…

Probability · Mathematics 2024-01-30 Miguel González , Carmen Minuesa , Manuel Mota , Inés del Puerto , Alfonso Ramos

We study the properties of a subclass of stochastic processes called discrete time nonlinear Markov chains with an aggregator, which naturally appear in various topics such as strategic queueing systems, inventory dynamics, opinion…

Probability · Mathematics 2025-12-24 Bar Light