English
Related papers

Related papers: Conformal Safety Shielding for Imperfect-Perceptio…

200 papers

Autonomous Systems (AS) are increasingly proposed, or used, in Safety Critical (SC) applications. Many such systems make use of sophisticated sensor suites and processing to provide scene understanding which informs the AS' decision-making.…

Systems and Control · Electrical Eng. & Systems 2022-08-19 John Molloy , John McDermid

Providing safety guarantees for autonomous systems is difficult as these systems operate in complex environments that require the use of learning-enabled components, such as deep neural networks (DNNs) for visual perception. DNNs are hard…

Artificial Intelligence · Computer Science 2023-05-31 Corina Pasareanu , Ravi Mangal , Divya Gopinath , Huafeng Yu

We propose a framework for planning in unknown dynamic environments with probabilistic safety guarantees using conformal prediction. Particularly, we design a model predictive controller (MPC) that uses i) trajectory predictions of the…

Robotics · Computer Science 2023-06-09 Lars Lindemann , Matthew Cleaveland , Gihyun Shim , George J. Pappas

End-to-end learning has emerged as a major paradigm for developing autonomous systems. Unfortunately, with its performance and convenience comes an even greater challenge of safety assurance. A key factor of this challenge is the absence of…

Machine Learning · Computer Science 2024-06-21 Zhenjiang Mao , Carson Sobolewski , Ivan Ruchkin

Autonomous driving depends on perception systems to understand the environment and to inform downstream decision-making. While advanced perception systems utilizing black-box Deep Neural Networks (DNNs) demonstrate human-like comprehension,…

Artificial Intelligence · Computer Science 2024-03-26 Xiao Li , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky

Shielding is a prominent model-based technique to ensure safety of autonomous agents. Classical shielding aims to ensure that nothing bad ever happens and comes with strong guarantees about safety and maximal permissiveness. However,…

Logic in Computer Science · Computer Science 2026-05-14 Linus Heck , Filip Macák , Roman Andriushchenko , Milan Češka , Sebastian Junges

In this paper, we present a novel information processing architecture for safe deep learning-based visual navigation of autonomous systems. The proposed information processing architecture is used to support a perceptual attention-based…

Robotics · Computer Science 2019-10-17 Keuntaek Lee , Gabriel Nakajima An , Viacheslav Zakharov , Evangelos A. Theodorou

Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In…

Machine Learning · Computer Science 2024-02-12 Nikunj Gupta , Somjit Nath , Samira Ebrahimi Kahou

This paper studies the synthesis of control policies for an agent that has to satisfy a temporal logic specification in a partially observable environment, in the presence of an adversary. The interaction of the agent (defender) with the…

Systems and Control · Electrical Eng. & Systems 2020-11-09 Bhaskar Ramasubramanian , Luyao Niu , Andrew Clark , Linda Bushnell , Radha Poovendran

When deploying machine learning models in high-stakes robotics applications, the ability to detect unsafe situations is crucial. Early warning systems can provide alerts when an unsafe situation is imminent (in the absence of corrective…

This work presents a step towards utilizing incrementally-improving symbolic perception knowledge of the robot's surroundings for provably correct reactive control synthesis applied to an autonomous driving problem. Combining abstract…

Robotics · Computer Science 2022-09-21 Disha Kamale , Sofie Haesaert , Cristian-Ioan Vasile

Deep neural networks (DNNs) are increasingly used in safety-critical autonomous systems as perception components processing high-dimensional image data. Formal analysis of these systems is particularly challenging due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Corina S. Pasareanu , Ravi Mangal , Divya Gopinath , Sinem Getir Yaman , Calum Imrie , Radu Calinescu , Huafeng Yu

Autonomous cars have to navigate in dynamic environment which can be full of uncertainties. The uncertainties can come either from sensor limitations such as occlusions and limited sensor range, or from probabilistic prediction of other…

Robotics · Computer Science 2019-05-06 Liting Sun , Wei Zhan , Ching-Yao Chan , Masayoshi Tomizuka

Automated driving systems require monitoring mechanisms to ensure safe operation, especially if system components degrade or fail. Their runtime self-representation plays a key role as it provides a-priori knowledge about the system's…

Robotics · Computer Science 2024-07-30 Richard Schubert , Marvin Loba , Jasper Sünnemann , Torben Stolte , Markus Maurer

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia

Principled accountability for autonomous decision-making in uncertain environments requires distinguishing intentional outcomes from negligent designs from actual accidents. We propose analyzing the behavior of autonomous agents through a…

Optimal cruise control design can increase highway throughput and vehicle safety in traffic flow. In most heterogeneous platoons, the absence of vehicle-to-vehicle (V2V) communication poses challenges in maintaining system stability and…

Systems and Control · Electrical Eng. & Systems 2024-05-21 Vishrut Bohara , Siavash Farzan

Autonomous robots that rely on deep neural network controllers pose critical challenges for safety prediction, especially under partial observability and distribution shift. Traditional model-based verification techniques are limited in…

Robotics · Computer Science 2026-03-16 Zhenjiang Mao , Mrinall Eashaan Umasudhan , Ivan Ruchkin

Safety assurance of automated driving systems must consider uncertain environment perception. This paper reviews literature addressing how perception testing is realized as part of safety assurance. We focus on testing for verification and…

Robotics · Computer Science 2022-02-28 Michael Hoss , Maike Scholtes , Lutz Eckstein

Autonomous driving vehicles provide a vast potential for realizing use cases in the on-road and off-road domains. Consequently, remarkable solutions exist to autonomous systems' environmental perception and control. Nevertheless, proof of…

Robotics · Computer Science 2024-03-29 Patrick Wolf