English
Related papers

Related papers: The #DNN-Verification Problem: Counting Unsafe Inp…

200 papers

Deep Neural Networks (DNNs), as valuable intellectual property, face unauthorized use. Existing protections, such as digital watermarking, are largely passive; they provide only post-hoc ownership verification and cannot actively prevent…

Cryptography and Security · Computer Science 2025-12-12 Han Yang , Shaofeng Li , Tian Dong , Xiangyu Xu , Guangchi Liu , Zhen Ling

Bringing deep neural networks (DNNs) into safety critical applications such as automated driving, medical imaging and finance, requires a thorough treatment of the model's uncertainties. Training deep neural networks is already resource…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Julian Burghoff , Robin Chan , Hanno Gottschalk , Annika Muetze , Tobias Riedlinger , Matthias Rottmann , Marius Schubert

Safety is a critical concern for the next generation of autonomy that is likely to rely heavily on deep neural networks for perception and control. Formally verifying the safety and robustness of well-trained DNNs and learning-enabled…

Machine Learning · Computer Science 2021-08-10 Xiaodong Yang , Tom Yamaguchi , Hoang-Dung Tran , Bardh Hoxha , Taylor T Johnson , Danil Prokhorov

Constraint solving is an elementary way for verification of deep neural networks (DNN). In the domain of AI safety, a DNN might be modified in its structure and parameters for its repair or attack. For such situations, we propose the…

Artificial Intelligence · Computer Science 2023-02-14 Pengfei Yang , Zhiming Chi , Zongxin Liu , Mengyu Zhao , Cheng-Chao Huang , Shaowei Cai , Lijun Zhang

In this paper, we propose a system-level approach for verifying the safety of neural network controlled systems, combining a continuous-time physical system with a discrete-time neural network based controller. We assume a generic model for…

Artificial Intelligence · Computer Science 2020-11-11 Arthur Clavière , Eric Asselin , Christophe Garion , Claire Pagetti

Software Defined Networking (SDN) is a novel network management technology, which currently attracts a lot of attention due to the provided capabilities. Recently, different works have been devoted to testing / verifying the (correct)…

Networking and Internet Architecture · Computer Science 2020-09-22 Igor Burdonov , Alexandre Kossachev , Nina Yevtushenko , Jorge López , Natalia Kushik , Djamal Zeghlache

Recent advances in the field of deep learning and impressive performance of deep neural networks (DNNs) for perception have resulted in an increased demand for their use in automated driving (AD) systems. The safety of such systems is of…

Machine Learning · Computer Science 2024-07-15 Stephanie Abrecht , Alexander Hirsch , Shervin Raafatnia , Matthias Woehrle

Deep neural networks have become widely used, obtaining remarkable results in domains such as computer vision, speech recognition, natural language processing, audio recognition, social network filtering, machine translation, and…

Neural and Evolutionary Computing · Computer Science 2020-02-03 Divya Gopinath , Guy Katz , Corina S. Pasareanu , Clark Barrett

Deep reinforcement learning (DRL) has become a dominant deep-learning paradigm for tasks where complex policies are learned within reactive systems. Unfortunately, these policies are known to be susceptible to bugs. Despite significant…

Robotics · Computer Science 2023-01-12 Guy Amir , Davide Corsi , Raz Yerushalmi , Luca Marzari , David Harel , Alessandro Farinelli , Guy Katz

Deep Neural Networks (DNN) are increasingly used in a variety of applications, many of them with substantial safety and security concerns. This paper introduces DeepCheck, a new approach for validating DNNs based on core ideas from program…

Software Engineering · Computer Science 2018-07-30 Divya Gopinath , Kaiyuan Wang , Mengshi Zhang , Corina S. Pasareanu , Sarfraz Khurshid

Recently, formal verification of deep neural networks (DNNs) has garnered considerable attention, and over-approximation based methods have become popular due to their effectiveness and efficiency. However, these strategies face challenges…

Artificial Intelligence · Computer Science 2024-01-24 Zhen Liang , Taoran Wu , Ran Zhao , Bai Xue , Ji Wang , Wenjing Yang , Shaojun Deng , Wanwei Liu

Deep neural networks (DNNs) are widely used in real-world applications, yet they remain vulnerable to errors and adversarial attacks. Formal verification offers a systematic approach to identify and mitigate these vulnerabilities, enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yizhak Y. Elboher , Avraham Raviv , Yael Leibovich Weiss , Omer Cohen , Roy Assa , Guy Katz , Hillel Kugler

Deep neural networks (DNNs) are increasingly being deployed to perform safety-critical tasks. The opacity of DNNs, which prevents humans from reasoning about them, presents new safety and security challenges. To address these challenges,…

Logic in Computer Science · Computer Science 2023-07-11 Omri Isac , Yoni Zohar , Clark Barrett , Guy Katz

Deep neural networks (DNNs) are increasingly important in safety-critical systems, for example in their perception layer to analyze images. Unfortunately, there is a lack of methods to ensure the functional safety of DNN-based components.…

Software Engineering · Computer Science 2022-10-14 Hazem Fahmy , Fabrizio Pastore , Mojtaba Bagherzadeh , Lionel Briand

For deep neural networks (DNNs) to be used in safety-critical autonomous driving tasks, it is desirable to monitor in operation time if the input for the DNN is similar to the data used in DNN training. While recent results in monitoring…

Machine Learning · Computer Science 2021-09-28 Chih-Hong Cheng

Quantifying uncertainty in a model's predictions is important as it enables the safety of an AI system to be increased by acting on the model's output in an informed manner. This is crucial for applications where the cost of an error is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Aria Khoshsirat

Deep neural networks (DNNs) are becoming a key component in diverse systems across the board. However, despite their success, they often err miserably; and this has triggered significant interest in formally verifying them. Unfortunately,…

Logic in Computer Science · Computer Science 2023-05-31 Raya Elsaleh , Guy Katz

With the widespread deployment of deep neural networks (DNNs), ensuring the reliability of DNN-based systems is of great importance. Serious reliability issues such as system failures can be caused by numerical defects, one of the most…

Software Engineering · Computer Science 2023-04-25 Linyi Li , Yuhao Zhang , Luyao Ren , Yingfei Xiong , Tao Xie

Great advances in deep neural networks (DNNs) have led to state-of-the-art performance on a wide range of tasks. However, recent studies have shown that DNNs are vulnerable to adversarial attacks, which have brought great concerns when…

Machine Learning · Computer Science 2023-04-13 Linyi Li , Tao Xie , Bo Li

The rise of deep learning has led to various successful attempts to apply deep neural networks (DNNs) for important networking tasks such as intrusion detection. Yet, running DNNs in the network control plane, as typically done in existing…

Cryptography and Security · Computer Science 2024-07-01 Kamran Razavi , Shayan Davari Fard , George Karlos , Vinod Nigade , Max Mühlhäuser , Lin Wang