English
Related papers

Related papers: Runtime Safety Monitoring of Deep Neural Networks …

200 papers

Deep Learning is currently used to perform multiple tasks, such as object recognition, face recognition, and natural language processing. However, Deep Neural Networks (DNNs) are vulnerable to perturbations that alter the network prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Joana C. Costa , Tiago Roxo , Hugo Proença , Pedro R. M. Inácio

For deep neural networks (DNNs) to be used in safety-critical autonomous driving tasks, it is desirable to monitor in operation time if the input for the DNN is similar to the data used in DNN training. While recent results in monitoring…

Machine Learning · Computer Science 2021-09-28 Chih-Hong Cheng

There is a growing body of research on developing testing techniques for Deep Neural Networks (DNN). We distinguish two general modes of testing for DNNs: Offline testing where DNNs are tested as individual units based on test datasets…

Machine Learning · Computer Science 2021-05-03 Fitash Ul Haq , Donghwan Shin , Shiva Nejati , Lionel Briand

From tiny pacemaker chips to aircraft collision avoidance systems, the state-of-the-art Cyber-Physical Systems (CPS) have increasingly started to rely on Deep Neural Networks (DNNs). However, as concluded in various studies, DNNs are highly…

Cryptography and Security · Computer Science 2021-05-10 Faiq Khalid , Muhammad Abdullah Hanif , Muhammad Shafique

Reliable detection of various objects and road users in the surrounding environment is crucial for the safe operation of automated driving systems (ADS). Despite recent progresses in developing highly accurate object detectors based on Deep…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Hakan Yekta Yatbaz , Mehrdad Dianati , Konstantinos Koufos , Roger Woodman

As deep neural networks (DNNs) are increasingly used in safety-critical applications, there is a growing concern for their reliability. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to…

Neural and Evolutionary Computing · Computer Science 2024-07-30 Eduard Pinconschi , Divya Gopinath , Rui Abreu , Corina S. Pasareanu

Modern software systems rely on Deep Neural Networks (DNN) when processing complex, unstructured inputs, such as images, videos, natural language texts or audio signals. Provided the intractably large size of such input spaces, the…

Software Engineering · Computer Science 2021-02-03 Michael Weiss , Paolo Tonella

Deep neural networks (DNNs) are increasingly used in safety-critical autonomous systems as perception components processing high-dimensional image data. Formal analysis of these systems is particularly challenging due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Corina S. Pasareanu , Ravi Mangal , Divya Gopinath , Sinem Getir Yaman , Calum Imrie , Radu Calinescu , Huafeng Yu

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now…

Machine Learning · Statistics 2017-11-08 Randall Balestriero , Richard Baraniuk

Runtime monitoring provides a more realistic and applicable alternative to verification in the setting of real neural networks used in industry. It is particularly useful for detecting out-of-distribution (OOD) inputs, for which the network…

Machine Learning · Computer Science 2022-12-21 Vahid Hashemi , Jan Křetínsky , Sabine Rieder , Jessica Schmidt

Deep Neural Networks (DNNs) are increasingly applied in the real world in safety critical applications like advanced driver assistance systems. An example for such use case is represented by traffic sign recognition systems. At the same…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Fabian Woitschek , Georg Schneider

Uncertainties in Deep Neural Network (DNN)-based perception and vehicle's motion pose challenges to the development of safe autonomous driving vehicles. In this paper, we propose a safe motion planning framework featuring the quantification…

Robotics · Computer Science 2021-08-12 Liuhui Ding , Dachuan Li , Bowen Liu , Wenxing Lan , Bing Bai , Qi Hao , Weipeng Cao , Ke Pei

The ever-growing advances of deep learning in many areas including vision, recommendation systems, natural language processing, etc., have led to the adoption of Deep Neural Networks (DNNs) in production systems. The availability of large…

Deploying deep neural networks (DNNs) as core functions in autonomous driving creates unique verification and validation challenges. In particular, the continuous engineering paradigm of gradually perfecting a DNN-based perception can make…

Machine Learning · Computer Science 2021-09-28 Chih-Hong Cheng , Rongjie Yan

Deep Neural Networks are increasingly adopted in critical tasks that require a high level of safety, e.g., autonomous driving. While state-of-the-art verifiers can be employed to check whether a DNN is unsafe w.r.t. some given property…

Artificial Intelligence · Computer Science 2023-06-21 Luca Marzari , Davide Corsi , Ferdinando Cicalese , Alessandro Farinelli

In order to deploy deep neural networks (DNNs) in high-stakes scenarios, it is imperative that DNNs provide inference robust to external perturbations - both intentional and unintentional. Although the resilience of DNNs to intentional and…

Cryptography and Security · Computer Science 2024-08-06 Sazzad Sayyed , Milin Zhang , Shahriar Rifat , Ananthram Swami , Michael De Lucia , Francesco Restuccia

Deep neural networks (DNNs) are increasingly important in safety-critical systems, for example in their perception layer to analyze images. Unfortunately, there is a lack of methods to ensure the functional safety of DNN-based components.…

Software Engineering · Computer Science 2022-10-14 Hazem Fahmy , Fabrizio Pastore , Mojtaba Bagherzadeh , Lionel Briand

As the number of cyberattacks and their particualr nature escalate, the need for effective intrusion detection systems (IDS) has become indispensable for ensuring the security of contemporary networks. Adaptive and more sophisticated…

Cryptography and Security · Computer Science 2025-05-12 Soham Chatterjee , Satvik Chaudhary , Aswani Kumar Cherukuri

The usage of deep neural networks in safety-critical systems is limited by our ability to guarantee their correct behavior. Runtime monitors are components aiming to identify unsafe predictions and discard them before they can lead to…

Machine Learning · Computer Science 2023-01-16 Joris Guérin , Kevin Delmas , Raul Sena Ferreira , Jérémie Guiochet

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution inputs (OODs). This limitation is one of the key challenges in the adoption of DNNs in high-assurance systems such as…

Machine Learning · Computer Science 2021-08-21 Ramneet Kaur , Susmit Jha , Anirban Roy , Sangdon Park , Oleg Sokolsky , Insup Lee