English
Related papers

Related papers: Verification of Neural Networks (Lecture Notes)

200 papers

In this paper we investigate formal verification problems for Neural Network computations. Of central importance will be various robustness and minimization problems such as: Given symbolic specifications of allowed inputs and outputs in…

Artificial Intelligence · Computer Science 2024-03-21 Adrian Wurm

Prior work on neural network verification has focused on specifications that are linear functions of the output of the network, e.g., invariance of the classifier output under adversarial perturbations of the input. In this paper, we extend…

Although neural networks are widely used, it remains challenging to formally verify the safety and robustness of neural networks in real-world applications. Existing methods are designed to verify the network before deployment, which are…

Machine Learning · Computer Science 2023-02-06 Tianhao Wei , Changliu Liu

Formal verification has emerged as a powerful approach to ensure the safety and reliability of deep neural networks. However, current verification tools are limited to only a handful of properties that can be expressed as first-order…

Artificial Intelligence · Computer Science 2022-03-03 Xuan Xie , Kristian Kersting , Daniel Neider

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. Despite the reputation of learned NN models to behave as black boxes and…

Artificial Intelligence · Computer Science 2018-05-23 Rudy Bunel , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

In sequential decision making, neural networks (NNs) are nowadays commonly used to represent and learn the agent's policy. This area of application has implied new software quality assessment challenges that traditional validation and…

Software Engineering · Computer Science 2023-12-18 Q. Mazouni , H. Spieker , A. Gotlieb , M. Acher

Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only…

Machine Learning · Computer Science 2020-12-24 Zhouxing Shi , Huan Zhang , Kai-Wei Chang , Minlie Huang , Cho-Jui Hsieh

The use of neural networks as function approximators has enabled many advances in reinforcement learning (RL). The generalization power of neural networks combined with advances in RL algorithms has reignited the field of artificial…

Machine Learning · Computer Science 2022-03-14 Christopher Lazarus , Mykel J. Kochenderfer

We describe a class of systems theory based neural networks called "Network Of Recurrent neural networks" (NOR), which introduces a new structure level to RNN related models. In NOR, RNNs are viewed as the high-level neurons and are used to…

Neural and Evolutionary Computing · Computer Science 2017-10-11 Chao-Ming Wang

Neural networks are successfully used in a variety of applications, many of them having safety and security concerns. As a result researchers have proposed formal verification techniques for verifying neural network properties. While…

Cryptography and Security · Computer Science 2022-05-10 Youcheng Sun , Muhammad Usman , Divya Gopinath , Corina S. Păsăreanu

Recurrent Networks are one of the most powerful and promising artificial neural network algorithms to processing the sequential data such as natural languages, sound, time series data. Unlike traditional feed-forward network, Recurrent…

Machine Learning · Computer Science 2018-07-11 Pushparaja Murugan

Deep neural networks (DNNs) are widely used in real-world applications, yet they remain vulnerable to errors and adversarial attacks. Formal verification offers a systematic approach to identify and mitigate these vulnerabilities, enhancing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yizhak Y. Elboher , Avraham Raviv , Yael Leibovich Weiss , Omer Cohen , Roy Assa , Guy Katz , Hillel Kugler

We study the problem of formal verification of Binarized Neural Networks (BNN), which have recently been proposed as a energy-efficient alternative to traditional learning networks. The verification of BNNs, using the reduction to hardware…

Software Engineering · Computer Science 2018-01-22 Chih-Hong Cheng , Georg Nührenberg , Chung-Hao Huang , Harald Ruess

Runtime verification is a lightweight verification technique that complements model checking by analyzing system executions at runtime rather than exploring a complete system model in advance. It is particularly useful for partially…

Logic in Computer Science · Computer Science 2026-04-30 Benedikt Bollig

It is important that consumers and regulators can verify the provenance of large neural models to evaluate their capabilities and risks. We introduce the concept of a "Proof-of-Training-Data": any protocol that allows a model trainer to…

Machine Learning · Computer Science 2023-07-04 Dami Choi , Yonadav Shavit , David Duvenaud

The increasing use of deep neural networks for safety-critical applications, such as autonomous driving and flight control, raises concerns about their safety and reliability. Formal verification can address these concerns by guaranteeing…

Artificial Intelligence · Computer Science 2018-02-06 Lindsey Kuper , Guy Katz , Justin Gottschlich , Kyle Julian , Clark Barrett , Mykel Kochenderfer

In these lecture notes, we first recall the connection between graph neural networks, Weisfeiler-Lehman tests and logics such as first-order logic and graded modal logic. We then present a modal logic in which counting modalities appear in…

Logic in Computer Science · Computer Science 2025-10-14 François Schwarzentruber

Formal verification of neural networks is essential for their deployment in safety-critical areas. Many available formal verification methods have been shown to be instances of a unified Branch and Bound (BaB) formulation. We propose a…

Machine Learning · Computer Science 2019-12-04 Jingyue Lu , M. Pawan Kumar

Machine learning techniques often lack formal correctness guarantees, evidenced by the widespread adversarial examples that plague most deep-learning applications. This lack of formal guarantees resulted in several research efforts that aim…

Machine Learning · Computer Science 2024-06-11 Anahita Baninajjar , Ahmed Rezine , Amir Aminifar

Researchers have developed neural network verification algorithms motivated by the need to characterize the robustness of deep neural networks. The verifiers aspire to answer whether a neural network guarantees certain properties with…

Machine Learning · Computer Science 2021-10-04 Kai Jia , Martin Rinard