English
Related papers

Related papers: A Safety Framework for Critical Systems Utilising …

200 papers

Deep Learning (DL) techniques are now widespread and being integrated into many important systems. Their classification and recognition abilities ensure their relevance for multiple application domains. As machine-learning that relies on…

Software Engineering · Computer Science 2019-02-01 Gaetan J. D. R. Hains , Arvid Jakobsson , Youry Khmelevsky

Modern software systems rely on Deep Neural Networks (DNN) when processing complex, unstructured inputs, such as images, videos, natural language texts or audio signals. Provided the intractably large size of such input spaces, the…

Software Engineering · Computer Science 2021-02-03 Michael Weiss , Paolo Tonella

The modern pervasiveness of large-scale deep neural networks (NNs) is driven by their extraordinary performance on complex problems but is also plagued by their sudden, unexpected, and often catastrophic failures, particularly on…

Machine Learning · Computer Science 2023-08-02 Sadhana Lolla , Iaroslav Elistratov , Alejandro Perez , Elaheh Ahmadi , Daniela Rus , Alexander Amini

Deep neural networks can be trained to be efficient and effective controllers for dynamical systems; however, the mechanics of deep neural networks are complex and difficult to guarantee. This work presents a general approach for providing…

Systems and Control · Computer Science 2019-06-05 Kyle D. Julian , Mykel J. Kochenderfer

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

Despite the tremendous advances that have been made in the last decade on developing useful machine-learning applications, their wider adoption has been hindered by the lack of strong assurance guarantees that can be made about their…

Machine Learning · Computer Science 2019-07-18 He Zhu , Zikang Xiong , Stephen Magill , Suresh Jagannathan

The future success of the Navy will depend, in part, on artificial intelligence. In practice, many artificially intelligent algorithms, and in particular deep learning models, rely on continual learning to maintain performance in dynamic…

Machine Learning · Computer Science 2023-11-21 Ari Goodman , Ryan O'Shea , Noam Hirschorn , Hubert Chrostowski

Deep neural networks (DNNs) have a wide range of applications, and software employing them must be thoroughly tested, especially in safety-critical domains. However, traditional software test coverage metrics cannot be applied directly to…

Machine Learning · Computer Science 2019-04-16 Youcheng Sun , Xiaowei Huang , Daniel Kroening , James Sharp , Matthew Hill , Rob Ashmore

Neural networks are one of the most investigated and widely used techniques in Machine Learning. In spite of their success, they still find limited application in safety- and security-related contexts, wherein assurance about networks'…

Artificial Intelligence · Computer Science 2018-05-28 Francesco Leofante , Nina Narodytska , Luca Pulina , Armando Tacchella

Due to significant improvements in performance in recent years, neural networks are currently used for an ever-increasing number of applications. However, neural networks have the drawback that their decisions are not readily interpretable…

Cryptography and Security · Computer Science 2020-05-15 Christian Berghoff

In this paper, we propose a system-level approach for verifying the safety of neural network controlled systems, combining a continuous-time physical system with a discrete-time neural network based controller. We assume a generic model for…

Artificial Intelligence · Computer Science 2020-11-11 Arthur Clavière , Eric Asselin , Christophe Garion , Claire Pagetti

Recently, deep learning, which uses Deep Neural Networks (DNN), plays an important role in many fields. A secure neural network model with a secure training/inference scheme is indispensable to many applications. To accomplish such a task…

Cryptography and Security · Computer Science 2020-12-10 Chin-Yu Sun , Allen C. -H. Wu , TingTing Hwang

Deep Neural Networks (DNN) will emerge as a cornerstone in automotive software engineering. However, developing systems with DNNs introduces novel challenges for safety assessments. This paper reviews the state-of-the-art in verification…

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation and the vision of the Internet-of-Things fuel the interest in resource efficient approaches. These approaches require a carefully…

Recent breakthroughs in machine and deep learning (ML and DL) research have provided excellent tools for leveraging enormous amounts of data and optimizing huge models with millions of parameters to obtain accurate networks for image…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Mohammadreza Amirian

Deep Neural Networks (DNN) have improved the quality of several non-safety related products in the past years. However, before DNNs should be deployed to safety-critical applications, their robustness needs to be systematically analyzed. A…

Over the past decades, deep learning (DL) systems have achieved tremendous success and gained great popularity in various applications, such as intelligent machines, image processing, speech processing, and medical diagnostics. Deep neural…

Software Engineering · Computer Science 2018-10-11 Lei Ma , Felix Juefei-Xu , Minhui Xue , Qiang Hu , Sen Chen , Bo Li , Yang Liu , Jianjun Zhao , Jianxiong Yin , Simon See

In deep learning applications, robustness measures the ability of neural models that handle slight changes in input data, which could lead to potential safety hazards, especially in safety-critical applications. Pre-deployment assessment of…

Software Engineering · Computer Science 2024-04-26 Wenchuan Mu , Kwan Hui Lim

Machine learning (ML) systems are increasingly deployed in high-stakes domains where reliability is paramount. This thesis investigates how uncertainty estimation can enhance the safety and trustworthiness of ML, focusing on selective…

Machine Learning · Computer Science 2025-09-09 Stephan Rabanser

Neural networks in safety-critical applications face increasing safety and security concerns due to their susceptibility to little disturbance. In this paper, we propose DeepCDCL, a novel neural network verification framework based on the…

Machine Learning · Computer Science 2024-03-14 Zongxin Liu , Pengfei Yang , Lijun Zhang , Xiaowei Huang