English
Related papers

Related papers: Exploiting Verified Neural Networks via Floating P…

200 papers

Deep neural networks have seen enormous success in various real-world applications. Beyond their predictions as point estimates, increasing attention has been focused on quantifying the uncertainty of their predictions. In this review, we…

Machine Learning · Computer Science 2023-02-06 Chengyu Dong

Implicit neural networks are a general class of learning models that replace the layers in traditional feedforward models with implicit algebraic equations. Compared to traditional learning models, implicit networks offer competitive…

Machine Learning · Computer Science 2021-12-13 Saber Jafarpour , Matthew Abate , Alexander Davydov , Francesco Bullo , Samuel Coogan

The verification problem for neural networks is verifying whether a neural network will suffer from adversarial samples, or approximating the maximal allowed scale of adversarial perturbation that can be endured. While most prior work…

Machine Learning · Computer Science 2018-11-16 Qinglong Wang , Kaixuan Zhang , Xue Liu , C. Lee Giles

Neural networks are increasingly employed in safety-critical domains. This has prompted interest in verifying or certifying logically encoded properties of neural networks. Prior work has largely focused on checking existential properties,…

Cryptography and Security · Computer Science 2019-06-26 Teodora Baluta , Shiqi Shen , Shweta Shinde , Kuldeep S. Meel , Prateek Saxena

Due to their increasing spread, confidence in neural network predictions became more and more important. However, basic neural networks do not deliver certainty estimates or suffer from over or under confidence. Many researchers have been…

Learning monotonic models with respect to a subset of the inputs is a desirable feature to effectively address the fairness, interpretability, and generalization issues in practice. Existing methods for learning monotonic neural networks…

Machine Learning · Computer Science 2022-12-16 Xingchao Liu , Xing Han , Na Zhang , Qiang Liu

There is a recent interest in neural network (NN)-based communication algorithms which have shown to achieve (beyond) state-of-the-art performance for a variety of problems or lead to reduced implementation complexity. However, most work on…

Information Theory · Computer Science 2019-02-20 Fayçal Ait Aoudia , Jakob Hoydis

Existing neural network verifiers compute a proof that each input is handled correctly under a given perturbation by propagating a symbolic abstraction of reachable values at each layer. This process is repeated from scratch independently…

Machine Learning · Computer Science 2023-11-27 Marc Fischer , Christian Sprecher , Dimitar I. Dimitrov , Gagandeep Singh , Martin Vechev

Deep neural networks have enabled progress in a wide variety of applications. Growing the size of the neural network typically results in improved accuracy. As model sizes grow, the memory and compute requirements for training these models…

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

With the increasing complexity of computing systems, complete hardware reliability can no longer be guaranteed. We need, however, to ensure overall system reliability. One of the most important features of artificial neural networks is…

Neural and Evolutionary Computing · Computer Science 2015-10-07 Anton Kulakov , Mark Zwolinski , Jeff Reeve

Neural networks have become state-of-the-art for computer vision problems because of their ability to efficiently model complex functions from large amounts of data. While neural networks can be shown to perform well empirically for a…

Robotics · Computer Science 2020-03-06 Kyle D. Julian , Ritchie Lee , Mykel J. Kochenderfer

We investigate the complexity of the reachability problem for (deep) neural networks: does it compute valid output given some valid input? It was recently claimed that the problem is NP-complete for general neural networks and…

Computational Complexity · Computer Science 2026-04-08 Marco Sälzer , Martin Lange

It is essential for understanding neural network decisions to interpret the functionality (also known as concepts) of neurons. Existing approaches describe neuron concepts by generating natural language descriptions, thereby advancing the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 ZeBin Ji , Yang Hu , Xiuli Bi , Bo Liu , Bin Xiao

The state-of-the-art hardware platforms for training Deep Neural Networks (DNNs) are moving from traditional single precision (32-bit) computations towards 16 bits of precision -- in large part due to the high energy efficiency and smaller…

Machine Learning · Computer Science 2018-12-20 Naigang Wang , Jungwook Choi , Daniel Brand , Chia-Yu Chen , Kailash Gopalakrishnan

Neural network verification mainly focuses on local robustness properties, which can be checked by bounding the image (set of outputs) of a given input set. However, often it is important to know whether a given property holds globally for…

Software Engineering · Computer Science 2024-01-30 Xiyue Zhang , Benjie Wang , Marta Kwiatkowska

Verifying properties and interpreting the behaviour of deep neural networks (DNN) is an important task given their ubiquitous use in applications, including safety-critical ones, and their black-box nature. We propose an automata-theoric…

Formal Languages and Automata Theory · Computer Science 2023-09-28 Marco Sälzer , Eric Alsmann , Florian Bruse , Martin Lange

The robustness of deep neural networks is crucial to modern AI-enabled systems and should be formally verified. Sigmoid-like neural networks have been adopted in a wide range of applications. Due to their non-linearity, Sigmoid-like…

Machine Learning · Computer Science 2022-08-31 Zhaodi Zhang , Yiting Wu , Si Liu , Jing Liu , Min Zhang

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Robustness in response to unexpected events is always desirable for real-world networks. To improve the robustness of any networked system, it is important to analyze vulnerability to external perturbation such as random failures or…

Social and Information Networks · Computer Science 2017-02-01 Alan Kuhnle , Nam P. Nguyen , Thang N. Dinh , My T. Thai