English
Related papers

Related papers: Verifying Reachability Properties in Markov Chains…

200 papers

Probabilistic programs with mixed support (both continuous and discrete latent random variables) commonly appear in many probabilistic programming systems (PPSs). However, the existence of the discrete random variables prohibits many basic…

Machine Learning · Computer Science 2020-03-06 David Tolpin , Yuan Zhou , Hongseok Yang

The applicability of model checking is hindered by the state space explosion problem in combination with limited amounts of main memory. To extend its reach, the large available capacities of secondary storage such as hard disks can be…

Logic in Computer Science · Computer Science 2016-05-20 Arnd Hartmanns , Holger Hermanns

This paper presents a simple algorithm to check whether reachability probabilities in parametric Markov chains are monotonic in (some of) the parameters. The idea is to construct - only using the graph structure of the Markov chain and…

Logic in Computer Science · Computer Science 2019-07-22 Jip Spel , Sebastian Junges , Joost-Pieter Katoen

Reliability in terms of functional properties from the safety-liveness spectrum is an indispensable requirement of low-level operating-system (OS) code. However, with evermore complex and thus less predictable hardware, quantitative and…

Probabilistic model checking traditionally verifies properties on the expected value of a measure of interest. This restriction may fail to capture the quality of service of a significant proportion of a system's runs, especially when the…

Artificial Intelligence · Computer Science 2025-02-10 Xiaotong Ji , Hanchun Wang , Antonio Filieri , Ilenia Epifani

Systems of interacting continuous-time Markov chains are a powerful model class, but inference is typically intractable in high dimensional settings. Auxiliary information, such as noisy observations, is typically only available at discrete…

Machine Learning · Statistics 2026-04-21 Giosue Migliorini , Padhraic Smyth

We study the problem of formalizing and checking probabilistic hyperproperties for models that allow nondeterminism in actions. We extend the temporal logic \HyperPCTL, which has been previously introduced for discrete-time Markov chains,…

Logic in Computer Science · Computer Science 2020-07-17 Erika Abraham , Ezio Bartocci , Borzoo Bonakdarpour , Oyendrila Dobe

Probabilistic model checking mainly concentrates on techniques for reasoning about the probabilities of certain path properties or expected values of certain random variables. For the quantitative system analysis, however, there is also…

Logic in Computer Science · Computer Science 2013-01-11 Michael Ummels , Christel Baier

Affine systems reachability is the basis of many verification methods. With further computation, methods exist to reason about richer models with inputs, nonlinear differential equations, and hybrid dynamics. As such, the scalability of…

Numerical Analysis · Computer Science 2019-03-07 Stanley Bak , Hoang-Dung Tran , Taylor T. Johnson

Inference for continuous-time Markov chains (CTMCs) becomes challenging when the process is only observed at discrete time points. The exact likelihood is intractable, and existing methods often struggle even in medium-dimensional…

Methodology · Statistics 2025-07-23 Tao Tang , Lachlan Astfalck , David Dunson

Markov chains are a natural and well understood tool for describing one-dimensional patterns in time or space. We show how to infer $k$-th order Markov chains, for arbitrary $k$, from finite data by applying Bayesian methods to both…

Statistics Theory · Mathematics 2009-11-13 Christopher C. Strelioff , James P. Crutchfield , Alfred W. Hubler

This paper presents a novel approach for augmenting proof-based verification with performance-style analysis of the kind employed in state-of-the-art model checking tools for probabilistic systems. Quantitative safety properties usually…

Logic in Computer Science · Computer Science 2009-12-11 Ukachukwu Ndukwu

We present an algorithm that can efficiently compute a broad class of inferences for discrete-time imprecise Markov chains, a generalised type of Markov chains that allows one to take into account partially specified probabilities and other…

Probability · Mathematics 2019-07-02 Natan T'Joens , Thomas Krak , Jasper De Bock , Gert de Cooman

Model-checking techniques have been extended to analyze quantum programs and communication protocols represented as quantum Markov chains, an extension of classical Markov chains. To specify qualitative temporal properties, a subspace-based…

Quantum Physics · Physics 2024-05-10 Ji Guan , Yuan Feng , Andrea Turrini , Mingsheng Ying

The possibility of errors in human-engineered formal verification software, such as model checkers, poses a serious threat to the purpose of these tools. An established approach to mitigate this problem are certificates -- lightweight,…

Logic in Computer Science · Computer Science 2025-01-22 Krishnendu Chatterjee , Tim Quatmann , Maximilian Schäffeler , Maximilian Weininger , Tobias Winkler , Daniel Zilken

We propose an improvement of the famous IC3 algorithm for model checking safety properties of finite state systems. We collect models computed by the SAT-solver during the clause propagation phase of the algorithm and use them as witnesses…

Logic in Computer Science · Computer Science 2013-07-19 Martin Suda

To date, most probabilistic reasoning systems have relied on a fixed belief network constructed at design time. The network is used by an application program as a representation of (in)dependencies in the domain. Probabilistic inference…

Artificial Intelligence · Computer Science 2013-03-25 Robert P. Goldman , John S. Breese

Probabilistic inference provides a language for describing how organisms may learn from and adapt to their environment. The computations needed to implement probabilistic inference often require specific representations, akin to having the…

Molecular Networks · Quantitative Biology 2018-06-28 Yarden Katz , Michael Springer , Walter Fontana

Markov chains and Markov decision processes (MDPs) are well-established probabilistic models. While finite Markov models are well-understood, analysing their infinite counterparts remains a significant challenge. Decisiveness has proven to…

Logic in Computer Science · Computer Science 2025-04-23 Nathalie Bertrand , Patricia Bouyer , Thomas Brihaye , Paulin Fournier , Pierre Vandenhove

Probabilistic Logic Programming (PLP) languages enable programmers to specify systems that combine logical models with statistical knowledge. The inference problem, to determine the probability of query answers in PLP, is intractable in…

Artificial Intelligence · Computer Science 2014-03-25 Arun Nampally , C. R. Ramakrishnan