中文
相关论文

相关论文: Expressiveness of Multi-Neuron Convex Relaxations …

200 篇论文

We improve the effectiveness of propagation- and linear-optimization-based neural network verification algorithms with a new tightened convex relaxation for ReLU neurons. Unlike previous single-neuron relaxations which focus only on the…

机器学习 · 计算机科学 2020-10-26 Christian Tjandraatmadja , Ross Anderson , Joey Huchette , Will Ma , Krunal Patel , Juan Pablo Vielma

The existence of adversarial examples poses a real danger when deep neural networks are deployed in the real world. The go-to strategy to quantify this vulnerability is to evaluate the model against specific attack algorithms. This approach…

机器学习 · 计算机科学 2021-06-08 Kevin Roth

Verification of neural networks enables us to gauge their robustness against adversarial attacks. Verification algorithms fall into two categories: exact verifiers that run in exponential time and relaxed verifiers that are efficient but…

机器学习 · 计算机科学 2020-01-13 Hadi Salman , Greg Yang , Huan Zhang , Cho-Jui Hsieh , Pengchuan Zhang

Convex relaxations are a key component of training and certifying provably safe neural networks. However, despite substantial progress, a wide and poorly understood accuracy gap to standard networks remains, raising the question of whether…

机器学习 · 计算机科学 2023-11-08 Maximilian Baader , Mark Niklas Müller , Yuhao Mao , Martin Vechev

In this paper, we consider the problem of certifying the robustness of neural networks to perturbed and adversarial input data. Such certification is imperative for the application of neural networks in safety-critical decision-making and…

机器学习 · 计算机科学 2020-09-21 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

State-of-the-art neural network verifiers are fundamentally based on one of two paradigms: either encoding the whole verification problem via tight multi-neuron convex relaxations or applying a Branch-and-Bound (BaB) procedure leveraging…

机器学习 · 计算机科学 2022-05-03 Claudio Ferrari , Mark Niklas Muller , Nikola Jovanovic , Martin Vechev

The increasing integration of deep neural networks in critical systems has spawned a theoretical and practical interest in formally guaranteeing safety properties about their behavior. To achieve this, contemporary verification algorithms…

计算机科学中的逻辑 · 计算机科学 2026-05-29 Ido Shmuel , Guy Katz

Solving non-convex, NP-hard optimization problems is crucial for training machine learning models, including neural networks. However, non-convexity often leads to black-box machine learning models with unclear inner workings. While convex…

机器学习 · 计算机科学 2025-03-18 Karthik Prakhya , Tolga Birdal , Alp Yurtsever

Despite their impressive performance on diverse tasks, neural networks fail catastrophically in the presence of adversarial inputs---imperceptibly but adversarially perturbed versions of natural inputs. We have witnessed an arms race…

机器学习 · 计算机科学 2018-11-06 Aditi Raghunathan , Jacob Steinhardt , Percy Liang

Neural Networks (NNs) have increasingly apparent safety implications commensurate with their proliferation in real-world applications: both unanticipated as well as adversarial misclassifications can result in fatal outcomes. As a…

机器学习 · 计算机科学 2021-04-20 Haitham Khedr , James Ferlez , Yasser Shoukry

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

机器学习 · 计算机科学 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

Many neural network (NN) verification systems represent the network's input-output relation as a constraint program. Sound and complete, representations involve integer constraints, for simulating the activations. Recent works convexly…

机器学习 · 计算机科学 2026-04-22 Merkouris Papamichail , Konstantinos Varsos , Giorgos Flouris , João Marques-Silva

The robustness of a neural network to adversarial examples can be provably certified by solving a convex relaxation. If the relaxation is loose, however, then the resulting certificate can be too conservative to be practically useful.…

最优化与控制 · 数学 2020-10-28 Richard Y. Zhang

In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP)…

机器学习 · 计算机科学 2025-05-13 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

It is commonly recognized that the expressiveness of deep neural networks is contingent upon a range of factors, encompassing their depth, width, and other relevant considerations. Currently, the practical performance of the majority of…

机器学习 · 计算机科学 2023-11-08 Xuan Qi , Yi Wei

The reliable deployment of neural networks in control systems requires rigorous robustness guarantees. In this paper, we obtain tight robustness certificates over convex attack sets for min-max representations of ReLU neural networks by…

最优化与控制 · 数学 2023-10-10 Brendon G. Anderson , Samuel Pfrommer , Somayeh Sojoudi

Verifying robustness of neural network classifiers has attracted great interests and attention due to the success of deep neural networks and their unexpected vulnerability to adversarial perturbations. Although finding minimum adversarial…

机器学习 · 统计学 2018-11-30 Akhilan Boopathy , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Convex functions and their gradients play a critical role in mathematical imaging, from proximal optimization to Optimal Transport. The successes of deep learning has led many to use learning-based methods, where fixed functions or…

机器学习 · 计算机科学 2025-04-09 Anne Gagneux , Mathurin Massias , Emmanuel Soubies , Rémi Gribonval

While neural networks have achieved high performance in different learning tasks, their accuracy drops significantly in the presence of small adversarial perturbations to inputs. Defenses based on regularization and adversarial training are…

机器学习 · 计算机科学 2019-02-07 Sahil Singla , Soheil Feizi

Deep neural networks have emerged as a widely used and effective means for tackling complex, real-world problems. However, a major obstacle in applying them to safety-critical systems is the great difficulty in providing formal guarantees…

人工智能 · 计算机科学 2017-05-22 Guy Katz , Clark Barrett , David Dill , Kyle Julian , Mykel Kochenderfer
‹ 上一页 1 2 3 10 下一页 ›