English
Related papers

Related papers: Probabilistic Model Checking of Robots Deployed in…

200 papers

A Markov decision process-based state switching is devised, implemented, and analyzed for proximity operations of various autonomous vehicles. The framework contains a pose estimator along with a multi-state guidance algorithm. The unified…

Robotics · Computer Science 2024-10-22 Deep Parikh , Ali Hasnain Khowaja , Manoranjan Majji

Markov decision processes model systems subject to nondeterministic and probabilistic uncertainty. A plethora of verification techniques addresses variations of reachability properties, such as: Is there a scheduler resolving the…

Logic in Computer Science · Computer Science 2025-05-26 Lina Gerlach , Tobias Winkler , Erika Ábrahám , Borzoo Bonakdarpour , Sebastian Junges

We consider a class of partially observable Markov decision processes (POMDPs) with uncertain transition and/or observation probabilities. The uncertainty takes the form of probability intervals. Such uncertain POMDPs can be used, for…

Systems and Control · Computer Science 2018-07-12 Mohamadreza Ahmadi , Murat Cubuktepe , Nils Jansen , Ufuk Topcu

Design and control of autonomous systems that operate in uncertain or adversarial environments can be facilitated by formal modelling and analysis. Probabilistic model checking is a technique to automatically verify, for a given temporal…

Logic in Computer Science · Computer Science 2021-11-23 Marta Kwiatkowska , Gethin Norman , David Parker

Recent trends envisage robots being deployed in areas deemed dangerous to humans, such as buildings with gas and radiation leaks. In such situations, the model of the underlying hazardous process might be unknown to the agent a priori,…

Robotics · Computer Science 2021-09-24 Fernando S. Barbosa , Bruno Lacerda , Paul Duckworth , Jana Tumova , Nick Hawes

Probabilistic models are a critical part of the modern deep learning toolbox - ranging from generative models (VAEs, GANs), sequence to sequence models used in machine translation and speech processing to models over functional spaces…

Machine Learning · Computer Science 2018-12-10 Krishnamurthy Dvijotham , Marta Garnelo , Alhussein Fawzi , Pushmeet Kohli

Robotic exploration of unknown environments is fundamentally a problem of decision making under uncertainty where the robot must account for uncertainty in sensor measurements, localization, action execution, as well as many other factors.…

Reinforcement learning has been successfully used to solve difficult tasks in complex unknown environments. However, these methods typically do not provide any safety guarantees during the learning process. This is particularly problematic,…

Systems and Control · Electrical Eng. & Systems 2019-07-02 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Joschka Boedecker , Andreas Krause

Increasingly sophisticated mathematical modelling processes from Machine Learning are being used to analyse complex data. However, the performance and explainability of these models within practical critical systems requires a rigorous and…

Machine Learning · Computer Science 2020-12-08 Xingyu Zhao , Alec Banks , James Sharp , Valentin Robu , David Flynn , Michael Fisher , Xiaowei Huang

Learning-based methods have been successful in solving complex control tasks without significant prior knowledge about the system. However, these methods typically do not provide any safety guarantees, which prevents their use in…

Systems and Control · Computer Science 2018-11-08 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Andreas Krause

Probabilistic model checking for systems with large or unbounded state space is a challenging computational problem in formal modelling and its applications. Numerical algorithms require an explicit representation of the state space, while…

Logic in Computer Science · Computer Science 2018-06-12 Dimitrios Milios , Guido Sanguinetti , David Schnoerr

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

Machine Learning · Computer Science 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

Exploration of unknown, unstructured environments, such as in search and rescue, cave exploration, and planetary missions,presents significant challenges due to their unpredictable nature. This unpredictability can lead to inefficient path…

Robotics · Computer Science 2024-10-08 Riana Gagnon Souleiman , Vivek Shankar Varadharajan , Giovanni Beltrame

Many automated system analysis techniques (e.g., model checking, model-based testing) rely on first obtaining a model of the system under analysis. System modeling is often done manually, which is often considered as a hindrance to adopt…

Software Engineering · Computer Science 2019-11-22 Jingyi Wang , Jun Sun , Qixia Yuan , Jun Pang

Machine learning models play a vital role in the prediction task in several fields of study. In this work, we utilize the ability of machine learning algorithms to predict the occurrence of extreme events in a nonlinear mechanical system.…

Machine Learning · Computer Science 2021-12-03 J. Meiyazhagan , S. Sudharsan , A. Venkatasen , M. Senthilvelan

This paper considers maximum likelihood (ML) estimation in a large class of models with hidden Markov regimes. We investigate consistency of the ML estimator and local asymptotic normality for the models under general conditions which allow…

Statistics Theory · Mathematics 2021-12-07 Demian Pouzo , Zacharias Psaradakis , Martin Sola

In disaster response or surveillance operations, quickly identifying areas needing urgent attention is critical, but deploying response teams to every location is inefficient or often impossible. Effective performance in this domain…

Robotics · Computer Science 2025-07-09 Abhish Khanal , Joseph Prince Mathew , Cameron Nowzari , Gregory J. Stein

Learning has propelled the cutting edge of performance in robotic control to new heights, allowing robots to operate with high performance in conditions that were previously unimaginable. The majority of the work, however, assumes that the…

Robotics · Computer Science 2018-03-13 Christopher D. McKinnon , Angela P. Schoellig

We present a control framework for robot-assisted dressing that augments low-level hazard response with runtime monitoring and formal verification. A parametric discrete-time Markov chain (pDTMC) models the dressing process, while Bayesian…

Robotics · Computer Science 2025-04-23 Yasmin Rafiq , Gricel Vázquez , Radu Calinescu , Sanja Dogramadzi , Robert M Hierons

Purpose of Review: To effectively synthesise and analyse multi-robot behaviour, we require formal task-level models which accurately capture multi-robot execution. In this paper, we review modelling formalisms for multi-robot systems under…

Robotics · Computer Science 2023-08-16 Charlie Street , Masoumeh Mansouri , Bruno Lacerda