English
Related papers

Related papers: Probabilistic verification of partially observable…

200 papers

We present a general framework for classifying partially observed dynamical systems based on the idea of learning in the model space. In contrast to the existing approaches using model point estimates to represent individual data items, we…

Machine Learning · Statistics 2017-04-19 Yuan Shen , Peter Tino , Krasimira Tsaneva-Atanasova

There is a scalability gap between probabilistic and non-probabilistic verification. Probabilistic model checking tools are based either on explicit engines or on (Multi-Terminal) Binary Decision Diagrams. These structures are complemented…

Logic in Computer Science · Computer Science 2019-09-20 Elizabeth Polgreen , Martin Brain , Martin Fraenzle , Alessandro Abate

The parameters of a discrete stationary Markov model are transition probabilities between states. Traditionally, data consist in sequences of observed states for a given number of individuals over the whole observation period. In such a…

Computation · Statistics 2012-04-30 Alberto Pasanisi , Shuai Fu , Nicolas Bousquet

We present a new method for statistical verification of quantitative properties over a partially unknown system with actions, utilising a parameterised model (in this work, a parametric Markov decision process) and data collected from…

Machine Learning · Computer Science 2017-07-06 Elizabeth Polgreen , Viraj Wijesuriya , Sofie Haesaert , Alessandro Abate

Probabilistic modeling provides the capability to represent and manipulate uncertainty in data, models, predictions and decisions. We are concerned with the problem of learning probabilistic models of dynamical systems from measured data.…

Computation · Statistics 2018-03-14 Thomas B. Schön , Andreas Svensson , Lawrence Murray , Fredrik Lindsten

We present a new Markov chain Monte Carlo method for estimating posterior probabilities of structural features in Bayesian networks. The method draws samples from the posterior distribution of partial orders on the nodes; for each sampled…

Machine Learning · Computer Science 2012-02-20 Teppo Niinimaki , Pekka Parviainen , Mikko Koivisto

In this work we establish the posterior consistency for a parametrized family of partially observed, fully dominated Markov models. As a main assumption, we suppose that the prior distribution assigns positive probability to all…

Statistics Theory · Mathematics 2016-09-01 Randal Douc , Jimmy Olsson , Francois Roueff

The formal verification of large probabilistic models is important and challenging. Exploiting the concurrency that is often present is one way to address this problem. Here we study a restricted class of asynchronous distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-08-06 Sumit Kumar Jha , Madhavan Mukund , Ratul Saha , P S Thiagarajan

The deployment of autonomous systems that operate in unstructured environments necessitates algorithms to verify their safety. This can be challenging due to, e.g., black-box components in the control software, or undermodelled dynamics…

Systems and Control · Electrical Eng. & Systems 2020-06-17 John Jackson , Luca Laurenti , Eric Frew , Morteza Lahijanian

A novel data-driven method for formal verification is proposed to study complex systems operating in safety-critical domains. The proposed approach is able to formally verify discrete-time stochastic dynamical systems against temporal logic…

Systems and Control · Electrical Eng. & Systems 2024-03-11 Zhi Zhang , Chenyu Ma , Saleh Soudijani , Sadegh Soudjani

We consider Markov decision processes (MDPs) in which the transition probabilities and rewards belong to an uncertainty set parametrized by a collection of random variables. The probability distributions for these random parameters are…

Logic in Computer Science · Computer Science 2020-02-26 Murat Cubuktepe , Nils Jansen , Sebastian Junges , Joost-Pieter Katoen , Ufuk Topcu

Autonomous systems with machine learning-based perception can exhibit unpredictable behaviors that are difficult to quantify, let alone verify. Such behaviors are convenient to capture in probabilistic models, but probabilistic model…

Logic in Computer Science · Computer Science 2022-03-17 Matthew Cleaveland , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

Undirected graphical models are widely used in statistics, physics and machine vision. However Bayesian parameter estimation for undirected models is extremely challenging, since evaluation of the posterior typically involves the…

Computation · Statistics 2012-03-19 Richard G. Everitt

We present a new algorithm for the statistical model checking of Markov chains with respect to unbounded temporal properties, such as reachability and full linear temporal logic. The main idea is that we monitor each simulation run on the…

Logic in Computer Science · Computer Science 2016-03-04 Przemysław Daca , Thomas A. Henzinger , Jan Křetínský , Tatjana Petrov

The study presents a novel approach for stochastic nonlinear model updating in structural dynamics, employing a Bayesian framework integrated with Markov Chain Monte Carlo (MCMC) sampling for parameter estimation by using an approximated…

We propose automated techniques for the verification and control of probabilistic real-time systems that are only partially observable. To formally model such systems, we define an extension of probabilistic timed automata in which local…

Logic in Computer Science · Computer Science 2015-06-24 Gethin Norman , David Parker , Xueyi Zou

The importance of considering contextual probabilities in shaping response patterns within psychological testing is underscored, despite the ubiquitous nature of order effects discussed extensively in methodological literature. Drawing from…

Methodology · Statistics 2024-03-28 Andrea Bosco

The purpose of time series analysis via mechanistic models is to reconcile the known or hypothesized structure of a dynamical system with observations collected over time. We develop a framework for constructing nonlinear mechanistic models…

Statistics Theory · Mathematics 2009-06-08 Carles Bretó , Daihai He , Edward L. Ionides , Aaron A. King

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi

In this paper we investigate the applicability of standard model checking approaches to verifying properties in probabilistic programming. As the operational model for a standard probabilistic program is a potentially infinite parametric…

Programming Languages · Computer Science 2016-07-28 Nils Jansen , Christian Dehnert , Benjamin Lucien Kaminski , Joost-Pieter Katoen , Lukas Westhofen