English
Related papers

Related papers: Reachability In Simple Neural Networks

200 papers

The reachability problem is a central decision problem for formal verification based on vector addition systems with states (VASS), which are equivalent to Petri nets and form one of the most studied and applied models of concurrency.…

Formal Languages and Automata Theory · Computer Science 2020-05-12 Wojciech Czerwiński , Sławomir Lasota , Ranko Lazić , Jérôme Leroux , Filip Mazowiecki

Several recent works have shown separation results between deep neural networks, and hypothesis classes with inferior approximation capacity such as shallow networks or kernel classes. On the other hand, the fact that deep networks can…

Machine Learning · Computer Science 2021-07-20 Eran Malach , Gilad Yehudai , Shai Shalev-Shwartz , Ohad Shamir

In graph realization problems one is given a degree sequence and the task is to decide whether there is a graph whose vertex degrees match to the given sequence. This realization problem is known to be polynomial-time solvable when the…

Computational Complexity · Computer Science 2012-01-18 Sepp Hartung , André Nichterlein

We study neural network training (NNT): optimizing a neural network's parameters to minimize the training loss over a given dataset. NNT has been studied extensively under theoretic lenses, mainly on two-layer networks with linear or ReLU…

Machine Learning · Computer Science 2024-12-18 Ilan Doron-Arad

Verification plays an essential role in the formal analysis of safety-critical systems. Most current verification methods have specific requirements when working on Deep Neural Networks (DNNs). They either target one particular network…

Machine Learning · Computer Science 2023-04-04 Chi Zhang , Wenjie Ruan , Fu Wang , Peipei Xu , Geyong Min , Xiaowei Huang

Network reliability measures the probability that a target node is reachable from a source node in an uncertain graph, i.e., a graph where every edge is associated with a probability of existence. In this paper, we investigate the novel and…

Databases · Computer Science 2020-05-26 Xiangyu Ke , Arijit Khan , Mohammad Al Hasan , Rojin Rezvansangsari

We present a novel framework for specifying and verifying correctness globally for neural networks on perception tasks. Most previous works on neural network verification for perception tasks focus on robustness verification. Unlike…

Machine Learning · Computer Science 2022-08-25 Yichen Yang , Martin Rinard

Deep learning (DL) has had unprecedented success and is now entering scientific computing with full force. However, current DL methods typically suffer from instability, even when universal approximation properties guarantee the existence…

Machine Learning · Computer Science 2022-04-04 Matthew J. Colbrook , Vegard Antun , Anders C. Hansen

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. Despite the reputation of learned NN models to behave as black boxes and…

Artificial Intelligence · Computer Science 2018-05-23 Rudy Bunel , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

We study the reachability problem for systems implemented as feed-forward neural networks whose activation function is implemented via ReLU functions. We draw a correspondence between establishing whether some arbitrary output can ever be…

Artificial Intelligence · Computer Science 2017-06-23 Alessio Lomuscio , Lalit Maganti

Deciding whether a graph can be embedded in a grid using only unit-length edges is NP-complete, even when restricted to binary trees. However, it is not difficult to devise a number of graph classes for which the problem is polynomial, even…

Data Structures and Algorithms · Computer Science 2012-04-13 Vinícius G. P. de Sá , Guilherme D. da Fonseca , Raphael Machado , Celina M. H. de Figueiredo

Incorporating prior knowledge or specifications of input-output relationships into machine learning models has attracted significant attention, as it enhances generalization from limited data and yields conforming outputs. However, most…

Machine Learning · Computer Science 2025-10-21 Youngjae Min , Navid Azizan

We investigate the computational complexity of various problems for simple recurrent neural networks (RNNs) as formal models for recognizing weighted languages. We focus on the single-layer, ReLU-activation, rational-weight RNNs with…

Formal Languages and Automata Theory · Computer Science 2018-03-06 Yining Chen , Sorcha Gilroy , Andreas Maletti , Jonathan May , Kevin Knight

Deep neural networks (DNNs) play an increasingly important role in various computer systems. In order to create these networks, engineers typically specify a desired topology, and then use an automated training algorithm to select the…

Machine Learning · Computer Science 2021-08-13 Ori Lahav , Guy Katz

Verification of deep neural networks has witnessed a recent surge of interest, fueled by success stories in diverse domains and by abreast concerns about safety and security in envisaged applications. Complexity and sheer size of such…

Machine Learning · Computer Science 2020-03-18 Dario Guidotti , Francesco Leofante , Luca Pulina , Armando Tacchella

The literature on reachability analysis methods for neural networks currently only focuses on uncertainties on the network's inputs. In this paper, we introduce two new approaches for the reachability analysis of neural networks with…

Systems and Control · Electrical Eng. & Systems 2023-03-15 Pierre-Jean Meyer

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

Machine Learning · Computer Science 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

Neural networks have been widely used to solve complex real-world problems. Due to the complicate, nonlinear, non-convex nature of neural networks, formal safety guarantees for the behaviors of neural network systems will be crucial for…

Systems and Control · Computer Science 2018-02-13 Weiming Xiang , Diego Manzanas Lopez , Patrick Musau , Taylor T. Johnson

Current approaches to neural network verification focus on specifications that target small regions around known input data points, such as local robustness. Thus, using these approaches, we can not obtain guarantees for inputs that are not…

Machine Learning · Computer Science 2023-06-23 David Boetius , Stefan Leue

We show that reachability, repeated reachability, nontermination and unboundedness are NP-complete for Lossy Channel Machines that are flat, i.e., with no nested cycles in the control graph. The upper complexity bound relies on a fine…

Logic in Computer Science · Computer Science 2020-07-13 Philippe Schnoebelen