English
Related papers

Related papers: Verifying Reachability Properties in Markov Chains…

200 papers

Scientific software is, by its very nature, complex. It is mathematical and highly optimized which makes it prone to subtle bugs not as easily detected by traditional testing. We outline how symbolic execution can be used to write tests…

Software Engineering · Computer Science 2025-10-16 Alexander C. Wilton

In this paper, we present a novel iterative Monte Carlo method for approximating the stationary probability of a single state of a positive recurrent Markov chain. We utilize the characterization that the stationary probability of a state…

Data Structures and Algorithms · Computer Science 2015-12-11 Christina E. Lee , Asuman Ozdaglar , Devavrat Shah

Markov processes are used in a wide range of disciplines, including finance. The transition densities of these processes are often unknown. However, the conditional characteristic functions are more likely to be available, especially for…

Statistics Theory · Mathematics 2013-02-04 Song X. Chen , Liang Peng , Cindy L. Yu

The Pairwise Markov Chain (PMC) is a probabilistic graphical model extending the well-known Hidden Markov Model. This model, although highly effective for many tasks, has been scarcely utilized for continuous value prediction. This is…

Machine Learning · Statistics 2025-08-12 Elie Azeraf

We consider the safety evaluation of discrete time, stochastic systems over a finite horizon. Therefore, we discuss and link probabilistic invariance with reachability as well as reach-avoid problems. We show how to efficiently compute…

Systems and Control · Electrical Eng. & Systems 2023-04-17 Niklas Schmid , John Lygeros

Mechanisms for the automation of uncertainty are required for expert systems. Sometimes these mechanisms need to obey the properties of probabilistic reasoning. A purely numeric mechanism, like those proposed so far, cannot provide a…

Artificial Intelligence · Computer Science 2013-04-15 Alan Bundy

When employing mechanistic models to study biological phenomena, practical parameter identifiability is important for making accurate predictions across wide range of unseen scenarios, as well as for understanding the underlying mechanisms.…

Quantitative Methods · Quantitative Biology 2023-10-19 Yue Liu , Kevin Suh , Philip K. Maini , Daniel J. Cohen , Ruth E. Baker

We comment on some conceptual and and technical problems related to computational mechanics, point out some errors in several papers, and straighten out some wrong priority claims. We present explicitly the correct algorithm for…

Data Analysis, Statistics and Probability · Physics 2018-04-09 Peter Grassberger

Automated fault localization is an important issue in model validation and verification. It helps the end users in analyzing the origin of failure. In this work, we show the early experiments with probabilistic analysis approaches in fault…

Software Engineering · Computer Science 2016-11-21 Ning Ge , Marc Pantel , Xavier Crégut

We develop a new bidirectional algorithm for estimating Markov chain multi-step transition probabilities: given a Markov chain, we want to estimate the probability of hitting a given target state in $\ell$ steps after starting from a given…

Data Structures and Algorithms · Computer Science 2015-11-05 Siddhartha Banerjee , Peter Lofgren

Markov chains are a class of probabilistic models that have achieved widespread application in the quantitative sciences. This is in part due to their versatility, but is compounded by the ease with which they can be probed analytically.…

Machine Learning · Computer Science 2023-12-18 Eddie Seabrook , Laurenz Wiskott

We propose a simple technique for verifying probabilistic models whose transition probabilities are parametric. The key is to replace parametric transitions by nondeterministic choices of extremal values. Analysing the resulting…

Logic in Computer Science · Computer Science 2016-05-27 Tim Quatmann , Christian Dehnert , Nils Jansen , Sebastian Junges , Joost-Pieter Katoen

We consider concurrent systems consisting of a finite but unknown number of components, that are replicated instances of a given set of finite state automata. The components communicate by executing interactions which are simultaneous…

Formal Languages and Automata Theory · Computer Science 2019-02-08 Marius Bozga , Radu Iosif , Joseph Sifakis

Many algorithms are specified with respect to a fixed but unspecified parameter. Examples of this are especially common in cryptography, where protocols often feature a security parameter such as the bit length of a secret key. Our aim is…

Logic in Computer Science · Computer Science 2025-10-28 Alessandro Di Giorgio , Pawel Sobocinski , Niels Voorneveld

Mathematical models are invaluable for understanding and predicting how biological systems behave, although their construction requires specifying mechanisms and relationships that are often not perfectly known. In the presence of multiple…

Deterministic graph grammars generate regular graphs, that form a structural extension of configuration graphs of pushdown systems. In this paper, we study a probabilistic extension of regular graphs obtained by labelling the terminal arcs…

Formal Languages and Automata Theory · Computer Science 2010-11-02 Nathalie Bertrand , Christophe Morvan

Reachability analysis has been a prominent way to provide safety guarantees for neurally controlled autonomous systems, but its direct application to neural perception components is infeasible due to imperfect or intractable perception…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Yuang Geng , Thomas Waite , Trevor Turnquist , Radoslav Ivanov , Ivan Ruchkin

Neural network design has utilized flexible nonlinear processes which can mimic biological systems, but has suffered from a lack of traceability in the resulting network. Graphical probabilistic models ground network design in probabilistic…

Machine Learning · Computer Science 2015-06-19 Kenric P. Nelson , Madalina Barbu , Brian J. Scannell

This paper proposes a computationally efficient framework, based on interval analysis, for rigorous verification of nonlinear continuous-time dynamical systems with neural network controllers. Given a neural network, we use an existing…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Saber Jafarpour , Akash Harapanahalli , Samuel Coogan

The machine learning community has recently put effort into quantized or low-precision arithmetics to scale large models. This paper proposes performing probabilistic inference in the quantized, discrete parameter space created by these…

Machine Learning · Computer Science 2025-08-20 Aleksanteri Sladek , Martin Trapp , Arno Solin