English
Related papers

Related papers: Faster Statistical Model Checking for Unbounded Te…

200 papers

Many complex systems can be described by population models, in which a pool of agents interacts and produces complex collective behaviours. We consider the problem of verifying formal properties of the underlying mathematical representation…

Logic in Computer Science · Computer Science 2017-11-13 Luca Bortolussi , Roberta Lanciani , Laura Nenzi

Time bounded reachability is a fundamental problem in model checking continuous-time Markov chains (CTMCs) and Markov decision processes (CTMDPs) for specifications in continuous stochastic logics. It can be computed by numerically solving…

Systems and Control · Electrical Eng. & Systems 2020-01-07 Mahmoud Salamati , Sadegh Soudjani , Rupak Majumdar

There has been an increasing demand for formal methods in the design process of safety-critical synthetic genetic circuits. Probabilistic model checking techniques have demonstrated significant potential in analyzing the intrinsic…

Emerging Technologies · Computer Science 2019-01-24 Thakur Neupane , Zhen Zhang , Curtis Madsen , Hao Zheng , Chris J. Myers

We revisit the symbolic verification of Markov chains with respect to finite horizon reachability properties. The prevalent approach iteratively computes step-bounded state reachability probabilities. By contrast, recent advances in…

Logic in Computer Science · Computer Science 2021-07-01 Steven Holtzen , Sebastian Junges , Marcell Vazquez-Chanlatte , Todd Millstein , Sanjit A. Seshia , Guy Van Den Broeck

Many embedded and real-time systems have a inherent probabilistic behaviour (sensors data, unreliable hardware,...). In that context, it is crucial to evaluate system properties such as "the probability that a particular hardware fails".…

Software Engineering · Computer Science 2015-09-22 Van Chan Ngo , Axel Legay , Jean Quilbeuf

This paper presents a methodology for temporal logic verification of discrete-time stochastic systems. Our goal is to find a lower bound on the probability that a complex temporal property is satisfied by finite traces of the system.…

Systems and Control · Computer Science 2019-11-22 Pushpak Jagtap , Sadegh Soudjani , Majid Zamani

We present a novel method for computing reachability probabilities of parametric discrete-time Markov chains whose transition probabilities are fractions of polynomials over a set of parameters. Our algorithm is based on two key…

Software Engineering · Computer Science 2014-03-28 Nils Jansen , Florian Corzilius , Matthias Volk , Ralf Wimmer , Erika Ábrahám , Joost-Pieter Katoen , Bernd Becker

Probabilistic model checking mainly concentrates on techniques for reasoning about the probabilities of certain path properties or expected values of certain random variables. For the quantitative system analysis, however, there is also…

Logic in Computer Science · Computer Science 2013-01-11 Michael Ummels , Christel Baier

We present a new method for statistical verification of quantitative properties over a partially unknown system with actions, utilising a parameterised model (in this work, a parametric Markov decision process) and data collected from…

Machine Learning · Computer Science 2017-07-06 Elizabeth Polgreen , Viraj Wijesuriya , Sofie Haesaert , Alessandro Abate

The majority of existing probabilistic model checking case studies are based on well understood theoretical models and distributions. However, real-life probabilistic systems usually involve distribution parameters whose values are obtained…

Software Engineering · Computer Science 2013-08-29 Guoxin Su , David S. Rosenblum

In this work, we study a natural nonparametric estimator of the transition probability matrices of a finite controlled Markov chain. We consider an offline setting with a fixed dataset, collected using a so-called logging policy. We develop…

Machine Learning · Statistics 2026-03-17 Imon Banerjee , Harsha Honnappa , Vinayak Rao

Unambiguous automata are nondeterministic automata in which every word has at most one accepting run. In this paper we give a polynomial-time algorithm for model checking discrete-time Markov chains against \omega-regular specifications…

Logic in Computer Science · Computer Science 2023-04-10 Christel Baier , Stefan Kiefer , Joachim Klein , David Müller , James Worrell

We derive a finite-sample probabilistic bound on the parameter estimation error of a system identification algorithm for Linear Switched Systems. The algorithm estimates Markov parameters from a single trajectory and applies a variant of…

Machine Learning · Computer Science 2025-05-19 Daniel Racz , Mihaly Petreczky , Balint Daroczy

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

Probabilistic model checking can provide formal guarantees on the behavior of stochastic models relating to a wide range of quantitative properties, such as runtime, energy consumption or cost. But decision making is typically with respect…

Logic in Computer Science · Computer Science 2024-03-19 Ingy Elsayed-Aly , David Parker , Lu Feng

Verification of temporal logic properties plays a crucial role in proving the desired behaviors of hybrid systems. In this paper, we propose an interval method for verifying the properties described by a bounded linear temporal logic. We…

Logic in Computer Science · Computer Science 2015-07-15 Daisuke Ishii , Naoki Yonezaki , Alexandre Goldsztejn

Markov automata combine non-determinism, probabilistic branching, and exponentially distributed delays. This compositional variant of continuous-time Markov decision processes is used in reliability engineering, performance evaluation and…

Logic in Computer Science · Computer Science 2017-05-11 Tim Quatmann , Sebastian Junges , Joost-Pieter Katoen

We study black-box testing for stochastic systems and arbitrary $\omega$-regular specifications, explicitly including liveness properties. We are given a finite-state probabilistic system that we can only execute from the initial state. We…

Formal Languages and Automata Theory · Computer Science 2024-06-05 Javier Esparza , Vincent Grande

The cover time of a Markov chain on a finite state space is the expected time until all states are visited. We show that if the cover time of a discrete-time Markov chain with rational transitions probabilities is bounded, then it is a…

Probability · Mathematics 2024-01-30 John Sylvester

Given its ability to analyse stochastic models ranging from discrete and continuous-time Markov chains to Markov decision processes and stochastic games, probabilistic model checking (PMC) is widely used to verify system dependability and…

Logic in Computer Science · Computer Science 2025-03-26 Radu Calinescu , Sinem Getir Yaman , Simos Gerasimou , Gricel Vázquez , Micah Bassett