English
Related papers

Related papers: On the tightness of linear relaxation based robust…

200 papers

In guaranteeing the absence of adversarial examples in an instance's neighbourhood, certification mechanisms play an important role in demonstrating neural net robustness. In this paper, we ask if these certifications can compromise the…

Machine Learning · Computer Science 2024-06-13 Andrew C. Cullen , Shijie Liu , Paul Montague , Sarah M. Erfani , Benjamin I. P. Rubinstein

In this paper, we study certifying the robustness of ReLU neural networks against adversarial input perturbations. To diminish the relaxation error suffered by the popular linear programming (LP) and semidefinite programming (SDP)…

Machine Learning · Computer Science 2025-05-13 Brendon G. Anderson , Ziye Ma , Jingqi Li , Somayeh Sojoudi

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Robotics · Computer Science 2020-03-10 Björn Lütjens , Michael Everett , Jonathan P. How

Certifiable local robustness, which rigorously precludes small-norm adversarial examples, has received significant attention as a means of addressing security concerns in deep learning. However, for some classification problems, local…

Machine Learning · Computer Science 2021-06-15 Klas Leino , Matt Fredrikson

Verification of neural networks enables us to gauge their robustness against adversarial attacks. Verification algorithms fall into two categories: exact verifiers that run in exponential time and relaxed verifiers that are efficient but…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Huan Zhang , Cho-Jui Hsieh , Pengchuan Zhang

Robustness is critical for machine learning (ML) classifiers to ensure consistent performance in real-world applications where models may encounter corrupted or adversarial inputs. In particular, assessing the robustness of classifiers to…

Machine Learning · Computer Science 2024-09-06 Georg Siedel , Ekagra Gupta , Andrey Morozov

The ubiquity of deep learning algorithms in various applications has amplified the need for assuring their robustness against small input perturbations such as those occurring in adversarial attacks. Existing complete verification…

Machine Learning · Computer Science 2024-06-17 Matthias König , Xiyue Zhang , Holger H. Hoos , Marta Kwiatkowska , Jan N. van Rijn

Implicit neural networks are a general class of learning models that replace the layers in traditional feedforward models with implicit algebraic equations. Compared to traditional learning models, implicit networks offer competitive…

Machine Learning · Computer Science 2021-12-13 Saber Jafarpour , Matthew Abate , Alexander Davydov , Francesco Bullo , Samuel Coogan

The rapid growth of deep learning applications in real life is accompanied by severe safety concerns. To mitigate this uneasy phenomenon, much research has been done providing reliable evaluations of the fragility level in different deep…

Machine Learning · Computer Science 2019-12-03 Zhaoyang Lyu , Ching-Yun Ko , Zhifeng Kong , Ngai Wong , Dahua Lin , Luca Daniel

Certified defenses based on convex relaxations are an established technique for training provably robust models. The key component is the choice of relaxation, varying from simple intervals to tight polyhedra. Counterintuitively, loose…

Machine Learning · Computer Science 2022-10-14 Nikola Jovanović , Mislav Balunović , Maximilian Baader , Martin Vechev

Recently smoothing deep neural network based classifiers via isotropic Gaussian perturbation is shown to be an effective and scalable way to provide state-of-the-art probabilistic robustness guarantee against $\ell_2$ norm bounded…

Machine Learning · Statistics 2020-02-19 Huijie Feng , Chunpeng Wu , Guoyang Chen , Weifeng Zhang , Yang Ning

The reliable deployment of neural networks in control systems requires rigorous robustness guarantees. In this paper, we obtain tight robustness certificates over convex attack sets for min-max representations of ReLU neural networks by…

Optimization and Control · Mathematics 2023-10-10 Brendon G. Anderson , Samuel Pfrommer , Somayeh Sojoudi

Interval Bound Propagation (IBP) is so far the base of state-of-the-art methods for training neural networks with certifiable robustness guarantees when potential adversarial perturbations present, while the convergence of IBP training…

Machine Learning · Computer Science 2022-03-18 Yihan Wang , Zhouxing Shi , Quanquan Gu , Cho-Jui Hsieh

Adversarial robustness of machine learning models is critical to ensuring reliable performance under data perturbations. Recent progress has been on point estimators, and this paper considers distributional predictors. First, using the link…

Machine Learning · Computer Science 2025-02-21 Mahalakshmi Sabanayagam , Russell Tsuchida , Cheng Soon Ong , Debarghya Ghoshdastidar

Convex relaxations are effective for training and certifying neural networks against norm-bounded adversarial attacks, but they leave a large gap between certifiable and empirical robustness. In principle, convex relaxation can provide…

Machine Learning · Computer Science 2020-02-25 Chen Zhu , Renkun Ni , Ping-yeh Chiang , Hengduo Li , Furong Huang , Tom Goldstein

This paper studies how encouraging semantically-aligned features during deep neural network training can increase network robustness. Recent works observed that Adversarial Training leads to robust models, whose learnt features appear to…

Machine Learning · Computer Science 2021-11-22 Motasem Alfarra , Juan C. Pérez , Adel Bibi , Ali Thabet , Pablo Arbeláez , Bernard Ghanem

Training certifiably robust neural networks remains a notoriously hard problem. On one side, adversarial training optimizes under-approximations of the worst-case loss, which leads to insufficient regularization for certification, while on…

Machine Learning · Computer Science 2023-10-26 Yuhao Mao , Mark Niklas Müller , Marc Fischer , Martin Vechev

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein

As ML models are increasingly deployed in critical applications, robustness against adversarial perturbations is crucial. While numerous defenses have been proposed to counter such attacks, they typically assume that all adversarial…

Machine Learning · Computer Science 2025-06-11 Yuan Xin , Dingfan Chen , Michael Backes , Xiao Zhang