English
Related papers

Related papers: Reluplex: An Efficient SMT Solver for Verifying De…

200 papers

Verification of neural networks enables us to gauge their robustness against adversarial attacks. Verification algorithms fall into two categories: exact verifiers that run in exponential time and relaxed verifiers that are efficient but…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Huan Zhang , Cho-Jui Hsieh , Pengchuan Zhang

We improve the effectiveness of propagation- and linear-optimization-based neural network verification algorithms with a new tightened convex relaxation for ReLU neurons. Unlike previous single-neuron relaxations which focus only on the…

Machine Learning · Computer Science 2020-10-26 Christian Tjandraatmadja , Ross Anderson , Joey Huchette , Will Ma , Krunal Patel , Juan Pablo Vielma

Neural Networks (NNs) have increasingly apparent safety implications commensurate with their proliferation in real-world applications: both unanticipated as well as adversarial misclassifications can result in fatal outcomes. As a…

Machine Learning · Computer Science 2021-04-20 Haitham Khedr , James Ferlez , Yasser Shoukry

A wide range of verification methods have been proposed to verify the safety properties of deep neural networks ensuring that the networks function correctly in critical applications. However, many well-known verification tools still…

Software Engineering · Computer Science 2023-08-15 Yuyi Zhong , Ruiwei Wang , Siau-Cheng Khoo

As deep neural networks are increasingly being deployed in practice, their efficiency has become an important issue. While there are compression techniques for reducing the network's size, energy consumption and computational requirement,…

Machine Learning · Computer Science 2020-01-31 Brandon Paulsen , Jingbo Wang , Chao Wang

In this paper, we consider the computational complexity of formally verifying the behavior of Rectified Linear Unit (ReLU) Neural Networks (NNs), where verification entails determining whether the NN satisfies convex polytopic…

Machine Learning · Computer Science 2021-03-26 James Ferlez , Yasser Shoukry

Convex functions and their gradients play a critical role in mathematical imaging, from proximal optimization to Optimal Transport. The successes of deep learning has led many to use learning-based methods, where fixed functions or…

Machine Learning · Computer Science 2025-04-09 Anne Gagneux , Mathurin Massias , Emmanuel Soubies , Rémi Gribonval

Neural networks achieved high performance over different tasks, i.e. image identification, voice recognition and other applications. Despite their success, these models are still vulnerable regarding small perturbations, which can be used…

Machine Learning · Computer Science 2023-01-31 João Zago , Eduardo Camponogara , Eric Antonelo

Formal verification of transformers has become increasingly important due to their widespread deployment in safety-critical applications. Compared to classic neural networks, the inferences of transformers involve highly complex…

Artificial Intelligence · Computer Science 2026-05-15 Hengjie Liu , Zhenya Zhang , Jianjun Zhao

Formal verification of neural networks is essential before their deployment in safety-critical applications. However, existing methods for formally verifying neural networks are not yet scalable enough to handle practical problems under…

Machine Learning · Computer Science 2025-07-08 Tobias Ladner , Matthias Althoff

Neural networks have been widely used to solve complex real-world problems. Due to the complicate, nonlinear, non-convex nature of neural networks, formal safety guarantees for the output behaviors of neural networks will be crucial for…

Machine Learning · Computer Science 2017-12-25 Weiming Xiang , Hoang-Dung Tran , Taylor T. Johnson

Deep neural networks (DNNs), particularly those using Rectified Linear Unit (ReLU) activation functions, have achieved remarkable success across diverse machine learning tasks, including image recognition, audio processing, and language…

Machine Learning · Computer Science 2026-03-26 Emi Zeger , Mert Pilanci

Deep neural networks, particularly those employing Rectified Linear Units (ReLU), are often perceived as complex, high-dimensional, non-linear systems. This complexity poses a significant challenge to understanding their internal learning…

Machine Learning · Computer Science 2025-11-11 Longqing Ye

Amongst others, the adoption of Rectified Linear Units (ReLUs) is regarded as one of the ingredients of the success of deep learning. ReLU activation has been shown to mitigate the vanishing gradient issue, to encourage sparsity in the…

Machine Learning · Statistics 2021-10-14 Nicola Picchiotti , Marco Gori

Deep Neural Networks (DNNs) have emerged as a powerful mechanism and are being increasingly deployed in real-world safety-critical domains. Despite the widespread success, their complex architecture makes proving any formal guarantees about…

Machine Learning · Computer Science 2020-03-26 Saket Dingliwal , Divyansh Pareek , Jatin Arora

Barrier certificates play an important role in verifying the safety of continuous-time systems, including autonomous driving, robotic manipulators and other critical applications. Recently, ReLU neural barrier certificates -- barrier…

Systems and Control · Electrical Eng. & Systems 2025-11-14 Dejin Ren , Yiling Xue , Taoran Wu , Bai Xue

Verification of deep neural networks has witnessed a recent surge of interest, fueled by success stories in diverse domains and by abreast concerns about safety and security in envisaged applications. Complexity and sheer size of such…

Machine Learning · Computer Science 2020-03-18 Dario Guidotti , Francesco Leofante , Luca Pulina , Armando Tacchella

In this paper, we consider the problem of certifying the robustness of neural networks to perturbed and adversarial input data. Such certification is imperative for the application of neural networks in safety-critical decision-making and…

Machine Learning · Computer Science 2020-09-21 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

Verifying the robustness property of a general Rectified Linear Unit (ReLU) network is an NP-complete problem [Katz, Barrett, Dill, Julian and Kochenderfer CAV17]. Although finding the exact minimum adversarial distortion is hard, giving a…

The ubiquity of deep learning algorithms in various applications has amplified the need for assuring their robustness against small input perturbations such as those occurring in adversarial attacks. Existing complete verification…

Machine Learning · Computer Science 2024-06-17 Matthias König , Xiyue Zhang , Holger H. Hoos , Marta Kwiatkowska , Jan N. van Rijn
‹ Prev 1 2 3 10 Next ›