English
Related papers

Related papers: Enumerating Safe Regions in Deep Neural Networks w…

200 papers

Deep Neural Networks (DNNs) have become key components of many safety-critical applications such as autonomous driving and medical diagnosis. However, DNNs have been shown suffering from poor robustness because of their susceptibility to…

Machine Learning · Computer Science 2020-07-28 Wenjie Wan , Zhaodi Zhang , Yiwei Zhu , Min Zhang , Fu Song

Traditional methods for formal verification (FV) of deep neural networks (DNNs) are constrained by a binary encoding of safety properties, where a model is classified as either safe or unsafe (robust or not robust). This binary encoding…

Artificial Intelligence · Computer Science 2025-05-09 Luca Marzari , Isabella Mastroeni , Alessandro Farinelli

Software development in the aerospace domain requires adhering to strict, high-quality standards. While there exist regulatory guidelines for commercial software in this domain (e.g., ARP-4754 and DO-178), these do not apply to software…

Software Engineering · Computer Science 2024-08-06 Guy Katz , Natan Levy , Idan Refaeli , Raz Yerushalmi

Deep neural networks (DNNs) are increasingly being employed in safety-critical systems, and there is an urgent need to guarantee their correctness. Consequently, the verification community has devised multiple techniques and tools for…

Logic in Computer Science · Computer Science 2022-08-30 Omri Isac , Clark Barrett , Min Zhang , Guy Katz

Verifying correctness of deep neural networks (DNNs) is challenging. We study a generic reachability problem for feed-forward DNNs which, for a given set of inputs to the network and a Lipschitz-continuous function over its outputs,…

Machine Learning · Computer Science 2018-05-08 Wenjie Ruan , Xiaowei Huang , Marta Kwiatkowska

Deep Neural Networks (DNNs) achieve state-of-the-art performance on numerous applications. However, it is difficult to tell beforehand if a DNN receiving an input will deliver the correct output since their decision criteria are usually…

Machine Learning · Computer Science 2021-09-07 Julia Lust , Alexandru Paul Condurache

Deep neural networks (DNNs) are increasingly being deployed to perform safety-critical tasks. The opacity of DNNs, which prevents humans from reasoning about them, presents new safety and security challenges. To address these challenges,…

Logic in Computer Science · Computer Science 2023-07-11 Omri Isac , Yoni Zohar , Clark Barrett , Guy Katz

Verification plays an essential role in the formal analysis of safety-critical systems. Most current verification methods have specific requirements when working on Deep Neural Networks (DNNs). They either target one particular network…

Machine Learning · Computer Science 2023-04-04 Chi Zhang , Wenjie Ruan , Fu Wang , Peipei Xu , Geyong Min , Xiaowei Huang

Deep neural networks (DNNs) are widely used in real-world applications, yet they remain vulnerable to errors and adversarial attacks. Formal verification offers a systematic approach to identify and mitigate these vulnerabilities, enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yizhak Y. Elboher , Avraham Raviv , Yael Leibovich Weiss , Omer Cohen , Roy Assa , Guy Katz , Hillel Kugler

Deep Neural Networks (DNN) have emerged as an effective approach to tackling real-world problems. However, like human-written software, DNNs are susceptible to bugs and attacks. This has generated significant interests in developing…

Machine Learning · Computer Science 2024-01-29 Hai Duong , Dong Xu , ThanhVu Nguyen , Matthew B. Dwyer

We study probabilistic safety for Bayesian Neural Networks (BNNs) under adversarial input perturbations. Given a compact set of input points, $T \subseteq \mathbb{R}^m$, we study the probability w.r.t. the BNN posterior that all the points…

Machine Learning · Computer Science 2020-06-22 Matthew Wicker , Luca Laurenti , Andrea Patane , Marta Kwiatkowska

Deep neural network (DNN) is a popular model implemented in many systems to handle complex tasks such as image classification, object recognition, natural language processing etc. Consequently DNN structural vulnerabilities become part of…

Machine Learning · Computer Science 2021-07-02 Juan Shu , Bowei Xi , Charles Kamhoua

Deep Neural Networks (DNNs) are increasingly deployed in safety-critical applications including autonomous vehicles and medical diagnostics. To reduce the residual risk for unexpected DNN behaviour and provide evidence for their trustworthy…

Software Engineering · Computer Science 2019-02-19 Hasan Ferit Eniser , Simos Gerasimou , Alper Sen

Ensuring solution feasibility is a key challenge in developing Deep Neural Network (DNN) schemes for solving constrained optimization problems, due to inherent DNN prediction errors. In this paper, we propose a ``preventive learning''…

Machine Learning · Computer Science 2023-05-18 Tianyu Zhao , Xiang Pan , Minghua Chen , Steven H. Low

Although Deep Neural Networks (DNNs) have shown incredible performance in perceptive and control tasks, several trustworthy issues are still open. One of the most discussed topics is the existence of adversarial perturbations, which has…

Machine Learning · Computer Science 2023-01-10 Fabio Brau , Giulio Rossolini , Alessandro Biondi , Giorgio Buttazzo

AI Safety is a major concern in many deep learning applications such as autonomous driving. Given a trained deep learning model, an important natural problem is how to reliably verify the model's prediction. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Tong Che , Xiaofeng Liu , Site Li , Yubin Ge , Ruixiang Zhang , Caiming Xiong , Yoshua Bengio

Deep neural networks (DNNs) have become the technology of choice for realizing a variety of complex tasks. However, as highlighted by many recent studies, even an imperceptible perturbation to a correctly classified input can lead to…

Machine Learning · Computer Science 2022-07-27 Guy Amir , Tom Zelazny , Guy Katz , Michael Schapira

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

Machine Learning · Computer Science 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Verification of Neural Networks (NNs) that approximate the solution of Partial Differential Equations (PDEs) is a major milestone towards enhancing their trustworthiness and accelerating their deployment, especially for safety-critical…

Systems and Control · Electrical Eng. & Systems 2024-02-13 Petros Ellinas , Rahul Nellikath , Ignasi Ventura , Jochen Stiasny , Spyros Chatzivasileiadis

As machine learning models, specifically neural networks, are becoming increasingly popular, there are concerns regarding their trustworthiness, specially in safety-critical applications, e.g. actions of an autonomous vehicle must be safe.…

Machine Learning · Computer Science 2023-12-15 Kshitij Goyal , Sebastijan Dumancic , Hendrik Blockeel