中文
相关论文

相关论文: PEREGRiNN: Penalized-Relaxation Greedy Neural Netw…

200 篇论文

Batch Normalization (BN) is a commonly used technique to accelerate and stabilize training of deep neural networks. Despite its empirical success, a full theoretical understanding of BN is yet to be developed. In this work, we analyze BN…

机器学习 · 计算机科学 2022-03-22 Tolga Ergen , Arda Sahiner , Batu Ozturkler , John Pauly , Morteza Mardani , Mert Pilanci

State-of-the-art neural network verifiers operate by encoding neural network verification as constraint satisfaction problems. When dealing with standard piecewise-linear activation functions, such as ReLUs, verifiers typically employ…

计算机科学中的逻辑 · 计算机科学 2025-12-12 Maya Swisa , Guy Katz

Semidefinite programming (SDP) relaxation has emerged as a promising approach for neural network verification, offering tighter bounds than other convex relaxation methods for deep neural networks (DNNs) with ReLU activations. However, we…

机器学习 · 计算机科学 2025-06-13 Ryota Ueda , Takami Sato , Ken Kobayashi , Kazuhide Nakata

With the rapid development of deep learning, the sizes of neural networks become larger and larger so that the training and inference often overwhelm the hardware resources. Given the fact that neural networks are often over-parameterized,…

机器学习 · 计算机科学 2022-06-20 Zhangheng Li , Tianlong Chen , Linyi Li , Bo Li , Zhangyang Wang

We investigate the computational complexity of neural network verification in quantised settings. We distinguish three classes of Feedforward Neural Networks (FNNs): rational FNNs with exact rational weights, quantised FNNs whose weights…

计算复杂性 · 计算机科学 2026-05-29 Eric Alsmann , Martin Lange , Marco Sälzer

Neural networks are often susceptible to minor perturbations in input that cause them to misclassify. A recent solution to this problem is the use of globally-robust neural networks, which employ a function to certify that the…

编程语言 · 计算机科学 2025-05-13 James Tobler , Hira Taqdees Syeda , Toby Murray

Convex functions and their gradients play a critical role in mathematical imaging, from proximal optimization to Optimal Transport. The successes of deep learning has led many to use learning-based methods, where fixed functions or…

机器学习 · 计算机科学 2025-04-09 Anne Gagneux , Mathurin Massias , Emmanuel Soubies , Rémi Gribonval

We introduce a new framework for the exact point-wise $\ell_p$ robustness verification problem that exploits the layer-wise geometric structure of deep feed-forward networks with rectified linear activations (ReLU networks). The activation…

机器学习 · 计算机科学 2020-07-24 Cong Han Lim , Raquel Urtasun , Ersin Yumer

Deep neural network (DNN) verification is an emerging field, with diverse verification engines quickly becoming available. Demonstrating the effectiveness of these engines on real-world DNNs is an important step towards their wider…

计算机科学中的逻辑 · 计算机科学 2020-08-11 Sumathi Gokulanathan , Alexander Feldsher , Adi Malca , Clark Barrett , Guy Katz

Even though neural networks are being increasingly deployed in safety-critical control applications, it remains difficult to enforce constraints on their output, meaning that it is hard to guarantee safety in such settings. While many…

机器学习 · 计算机科学 2025-08-27 Long Kiu Chung , Shreyas Kousik

Convolutional neural networks (CNNs), one of the key architectures of deep learning models, have achieved superior performance on many machine learning tasks such as image classification, video recognition, and power systems. Despite their…

机器学习 · 计算机科学 2024-07-17 Hanxiao Lu , Zeyu Huang , Ren Wang

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

机器学习 · 计算机科学 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Traditional methods for formal verification (FV) of deep neural networks (DNNs) are constrained by a binary encoding of safety properties, where a model is classified as either safe or unsafe (robust or not robust). This binary encoding…

人工智能 · 计算机科学 2025-05-09 Luca Marzari , Isabella Mastroeni , Alessandro Farinelli

Formal verification of neural networks is critical for their safe adoption in real-world applications. However, designing a precise and scalable verifier which can handle different activation functions, realistic network architectures and…

人工智能 · 计算机科学 2022-03-01 Mark Niklas Müller , Gleb Makarchuk , Gagandeep Singh , Markus Püschel , Martin Vechev

Certified robustness is a critical property for deploying neural networks (NN) in safety-critical applications. A principle approach to achieving such guarantees is to constrain the global Lipschitz constant of the network. However,…

机器学习 · 计算机科学 2025-07-01 Zain ul Abdeen , Vassilis Kekatos , Ming Jin

We develop a method for the efficient verification of neural networks against convolutional perturbations such as blurring or sharpening. To define input perturbations we use well-known camera shake, box blur and sharpen kernels. We…

机器学习 · 计算机科学 2025-02-19 Benedikt Brückner , Alessio Lomuscio

Verifying the robustness property of a general Rectified Linear Unit (ReLU) network is an NP-complete problem [Katz, Barrett, Dill, Julian and Kochenderfer CAV17]. Although finding the exact minimum adversarial distortion is hard, giving a…

Deep neural networks (DNNs) are widely used in real-world applications, yet they remain vulnerable to errors and adversarial attacks. Formal verification offers a systematic approach to identify and mitigate these vulnerabilities, enhancing…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Yizhak Y. Elboher , Avraham Raviv , Yael Leibovich Weiss , Omer Cohen , Roy Assa , Guy Katz , Hillel Kugler

The prevalence of neural networks in society is expanding at an increasing rate. It is becoming clear that providing robust guarantees on systems that use neural networks is very important, especially in safety-critical applications. A…

系统与控制 · 电气工程与系统科学 2022-02-07 Matthew Newton , Antonis Papachristodoulou

Deep Neural Networks (DNN) have emerged as an effective approach to tackling real-world problems. However, like human-written software, DNNs are susceptible to bugs and attacks. This has generated significant interests in developing…

机器学习 · 计算机科学 2024-01-29 Hai Duong , Dong Xu , ThanhVu Nguyen , Matthew B. Dwyer