English
Related papers

Related papers: Refining Perception Contracts: Case Studies in Vis…

200 papers

Safety assurance is a central concern for the development and societal acceptance of automated driving (AD) systems. Perception is a key aspect of AD that relies heavily on Machine Learning (ML). Despite the known challenges with the safety…

In this paper we address the issue of change after deployment in safety-critical embedded system applications. Our goal is to substitute lab-based verification with in-field formal analysis to determine whether an update may be safely…

Software Engineering · Computer Science 2016-06-03 Sönke Holthusen , Sophie Quinton , Ina Schaefer , Johannes Schlatow , Martin Wegner

Background: Driving automation systems (DAS), including autonomous driving and advanced driver assistance, are an important safety-critical domain. DAS often incorporate perceptions systems that use machine learning (ML) to analyze the…

In this paper, we solve the problem of finding a certified control policy that drives a robot from any given initial state and under any bounded disturbance to the desired reference trajectory, with guarantees on the convergence or bounds…

Robotics · Computer Science 2020-11-26 Dawei Sun , Susmit Jha , Chuchu Fan

Recent advances in Deep Machine Learning have shown promise in solving complex perception and control loops via methods such as reinforcement and imitation learning. However, guaranteeing safety for such learned deep policies has been a…

Robotics · Computer Science 2020-03-03 Tom Hirshberg , Sai Vemprala , Ashish Kapoor

Drones have the potential to revolutionize power line inspection by increasing productivity, reducing inspection time, improving data quality, and eliminating the risks for human operators. Current state-of-the-art systems for power line…

Robotics · Computer Science 2023-08-10 Jiaxu Xing , Giovanni Cioffi , Javier Hidalgo-Carrió , Davide Scaramuzza

During the development and verification of complex airborne systems, a variety of languages and development environments are used for different levels of the system hierarchy. As a result, there may be manual steps to translate requirements…

Software Engineering · Computer Science 2016-04-26 Jing Liu , John D. Backes , Darren Cofer , Andrew Gacek

Perception-based neural network controllers are increasingly used in autonomous systems that rely on visual inputs to operate in the real world. Ensuring the safety of such systems under uncertainty is challenging. Existing verification…

Robotics · Computer Science 2025-07-08 Alexander Estornell , Leonard Jung , Michael Everett

Perception is a critical component of high-integrity applications of robotics and autonomous systems, such as self-driving cars. In these applications, failure of perception systems may put human life at risk, and a broad adoption of these…

Robotics · Computer Science 2020-11-17 Pasquale Antonante , David I. Spivak , Luca Carlone

We present assume-guarantee contracts for continuous-time linear dynamical systems with inputs and outputs. These contracts are used to express specifications on the dynamic behaviour of a system. Contrary to existing approaches, we use…

Dynamical Systems · Mathematics 2022-09-07 B. M. Shali , H. M. Heidema , A. J. van der Schaft , B. Besselink

Designing large-scale control systems to satisfy complex specifications is hard in practice, as most formal methods are limited to systems of modest size. Contract theory has been proposed as a modular alternative to formal methods in…

Systems and Control · Electrical Eng. & Systems 2022-11-03 Miel Sharf , Bart Besselink , Karl Henrik Johansson

In the growing field of blockchain technology, smart contracts exist as transformative digital agreements that execute transactions autonomously in decentralised networks. However, these contracts face challenges in the form of security…

Cryptography and Security · Computer Science 2024-07-12 Christopher De Baets , Basem Suleiman , Armin Chitizadeh , Imran Razzak

We consider the problem of safe control in discrete autonomous agents that use learned components for imperfect perception (or more generally, state estimation) from high-dimensional observations. We propose a shield construction that…

Systems and Control · Electrical Eng. & Systems 2025-07-29 William Scarbro , Calum Imrie , Sinem Getir Yaman , Kavan Fatehi , Corina S. Pasareanu , Radu Calinescu , Ravi Mangal

Perception is a critical component of high-integrity applications of robotics and autonomous systems, such as self-driving vehicles. In these applications, failure of perception systems may put human life at risk, and a broad adoption of…

Robotics · Computer Science 2021-10-19 Pasquale Antonante , David I. Spivak , Luca Carlone

Convolutional Neural Networks (CNN) for object detection, lane detection, and segmentation now sit at the head of most autonomy pipelines, and yet, their safety analysis remains an important challenge. Formal analysis of perception models…

Robotics · Computer Science 2023-09-13 Chiao Hsieh , Keyur Joshi , Sasa Misailovic , Sayan Mitra

Advances in computer vision and machine learning enable robots to perceive their surroundings in powerful new ways, but these perception modules have well-known fragilities. We consider the problem of synthesizing a safe controller that is…

Robotics · Computer Science 2022-09-26 Dawei Sun , Negin Musavi , Geir Dullerud , Sanjay Shakkottai , Sayan Mitra

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

Robotics · Computer Science 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik

Contracts and contract monitoring are a powerful mechanism for specifying properties and guaranteeing them at run time. However, run time monitoring of contracts imposes a significant overhead. The execution time is impacted by the…

Programming Languages · Computer Science 2017-03-31 Matthias Keil , Peter Thiemann

Safety is one of the most important development goals for highly automated driving (HAD) systems. This applies in particular to the perception function driven by Deep Neural Networks (DNNs). For these, large parts of the traditional safety…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Timo Sämann , Peter Schlicht , Fabian Hüger

The exceptional progress in the field of machine learning (ML) in recent years has attracted a lot of interest in using this technology in aviation. Possible airborne applications of ML include safety-critical functions, which must be…

Machine Learning · Computer Science 2022-09-29 K. Dmitriev , J. Schumann , F. Holzapfel