English
Related papers

Related papers: Work In Progress: Safety and Robustness Verificati…

200 papers

As NLP models achieved state-of-the-art performances over benchmarks and gained wide applications, it has been increasingly important to ensure the safe deployment of these models in the real world, e.g., making sure the models are robust…

Computation and Language · Computer Science 2022-05-11 Xuezhi Wang , Haohan Wang , Diyi Yang

Graph Neural Networks (GNNs) have achieved promising results in tasks such as node classification and graph classification. However, recent studies reveal that GNNs are vulnerable to backdoor attacks, posing a significant threat to their…

Machine Learning · Computer Science 2025-03-13 Zhiwei Zhang , Minhua Lin , Junjie Xu , Zongyu Wu , Enyan Dai , Suhang Wang

Given the rapid changes in telecommunication systems and their higher dependence on artificial intelligence, it is increasingly important to have models that can perform well under different, possibly adverse, conditions. Deep Neural…

Signal Processing · Electrical Eng. & Systems 2021-03-30 Javier Maroto , Gérôme Bovet , Pascal Frossard

ML models are typically trained using large datasets of high quality. However, training datasets often contain inconsistent or incomplete data. To tackle this issue, one solution is to develop algorithms that can check whether a prediction…

Machine Learning · Computer Science 2022-01-19 Austen Z. Fan , Paraschos Koutris

Deploying deep neural networks (DNNs) as core functions in autonomous driving creates unique verification and validation challenges. In particular, the continuous engineering paradigm of gradually perfecting a DNN-based perception can make…

Machine Learning · Computer Science 2021-09-28 Chih-Hong Cheng , Rongjie Yan

Data-driven, neural network (NN) based anomaly detection and predictive maintenance are emerging research areas. NN-based analytics of time-series data offer valuable insights into past behaviors and estimates of critical parameters like…

Machine Learning · Computer Science 2023-07-27 Neelanjana Pal , Diego Manzanas Lopez , Taylor T Johnson

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

Machine Learning · Computer Science 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

Deep Neural Networks (DNN) will emerge as a cornerstone in automotive software engineering. However, developing systems with DNNs introduces novel challenges for safety assessments. This paper reviews the state-of-the-art in verification…

Artificial neural networks (NN) are instrumental in realizing highly-automated driving functionality. An overarching challenge is to identify best safety engineering practices for NN and other learning-enabled components. In particular,…

Machine Learning · Computer Science 2018-06-11 Chih-Hong Cheng , Georg Nührenberg , Chung-Hao Huang , Harald Ruess , Hirotoshi Yasuoka

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

In recent years numerous methods have been developed to formally verify the robustness of deep neural networks (DNNs). Though the proposed techniques are effective in providing mathematical guarantees about the DNNs behavior, it is not…

Machine Learning · Computer Science 2023-02-01 Debangshu Banerjee , Avaljot Singh , Gagandeep Singh

We study the problem of certifying the robustness of Bayesian neural networks (BNNs) to adversarial input perturbations. Given a compact set of input points $T \subseteq \mathbb{R}^m$ and a set of output points $S \subseteq \mathbb{R}^n$,…

Machine Learning · Computer Science 2023-06-26 Matthew Wicker , Andrea Patane , Luca Laurenti , Marta Kwiatkowska

Deep neural networks for computer vision are deployed in increasingly safety-critical and socially-impactful applications, motivating the need to close the gap in model performance under varied, naturally occurring imaging conditions.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Nathan Drenkow , Numair Sani , Ilya Shpitser , Mathias Unberath

While deep neural networks (DNNs) have revolutionized many fields, their fragility to carefully designed adversarial attacks impedes the usage of DNNs in safety-critical applications. In this paper, we strive to explore the robust features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hong Wang , Yuefan Deng , Shinjae Yoo , Yuewei Lin

Safety is a critical concern for the next generation of autonomy that is likely to rely heavily on deep neural networks for perception and control. Formally verifying the safety and robustness of well-trained DNNs and learning-enabled…

Machine Learning · Computer Science 2021-08-10 Xiaodong Yang , Tom Yamaguchi , Hoang-Dung Tran , Bardh Hoxha , Taylor T Johnson , Danil Prokhorov

Neural network models have become the leading solution for a large variety of tasks, such as classification, language processing, protein folding, and others. However, their reliability is heavily plagued by adversarial inputs: small input…

Machine Learning · Computer Science 2022-10-04 Natan Levy , Guy Katz

Deep Neural Networks(DNN) have excessively advanced the field of computer vision by achieving state of the art performance in various vision tasks. These results are not limited to the field of vision but can also be seen in speech…

Cryptography and Security · Computer Science 2018-06-07 Chirag Agarwal , Bo Dong , Dan Schonfeld , Anthony Hoogs

Deep neural networks have achieved impressive results in many image classification tasks. However, since their performance is usually measured in controlled settings, it is important to ensure that their decisions remain correct when…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Apostolos Modas

Deep neural networks (DNNs) have gained prominence in various applications, such as classification, recognition, and prediction, prompting increased scrutiny of their properties. A fundamental attribute of traditional DNNs is their…

Machine Learning · Computer Science 2023-08-15 Roman Garaev , Bader Rasheed , Adil Khan

Deep neural networks (DNNs) are increasingly being deployed in high-stakes applications, from self-driving cars to biometric authentication. However, their unpredictable and unreliable behaviors in real-world settings require new approaches…

Cryptography and Security · Computer Science 2025-10-01 Firas Ben Hmida , Abderrahmen Amich , Ata Kaboudi , Birhanu Eshete