English
Related papers

Related papers: Adaptive Certified Training: Towards Better Accura…

200 papers

Despite the promise of Lipschitz-based methods for provably-robust deep learning with deterministic guarantees, current state-of-the-art results are limited to feed-forward Convolutional Networks (ConvNets) on low-dimensional data, such as…

Machine Learning · Computer Science 2023-10-31 Kai Hu , Andy Zou , Zifan Wang , Klas Leino , Matt Fredrikson

Existing work in trustworthy machine learning primarily focuses on single-input adversarial perturbations. In many real-world attack scenarios, input-agnostic adversarial attacks, e.g. universal adversarial perturbations (UAPs), are much…

Machine Learning · Computer Science 2024-09-10 Changming Xu , Gagandeep Singh

Adversarial attacks pose significant threats to deploying state-of-the-art classifiers in safety-critical applications. Two classes of methods have emerged to address this issue: empirical defences and certified defences. Although certified…

Machine Learning · Computer Science 2023-06-13 Piersilvio De Bartolomeis , Jacob Clarysse , Amartya Sanyal , Fanny Yang

Derivative training is an established method that can significantly increase the accuracy of neural networks in certain low-dimensional tasks. In this paper, we extend this improvement to an illustrative image analysis problem:…

Machine Learning · Computer Science 2025-02-04 Vsevolod I. Avrutskiy

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

Machine Learning · Computer Science 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

Deep learning models are vulnerable to adversarial perturbations, raising important concerns for safety-critical deployment. Empirical defenses can achieve strong robustness in practice, but lack formal guarantees, motivating the need for…

Machine Learning · Computer Science 2026-05-26 Konstantinos Emmanouilidis , Tianjiao Ding , Nghia Nguyen , Nicolas Loizou , René Vidal

Certified defenses against small-norm adversarial examples have received growing attention in recent years; though certified accuracies of state-of-the-art methods remain far below their non-robust counterparts, despite the fact that…

Machine Learning · Computer Science 2023-01-24 Klas Leino

Certified robustness circumvents the fragility of defences against adversarial attacks, by endowing model predictions with guarantees of class invariance for attacks up to a calculated size. While there is value in these certifications, the…

Machine Learning · Computer Science 2023-09-21 Andrew C. Cullen , Paul Montague , Shijie Liu , Sarah M. Erfani , Benjamin I. P. Rubinstein

Deep neural networks are capable of training fast and generalizing well within many domains. Despite their promising performance, deep networks have shown sensitivities to perturbations of their inputs (e.g., adversarial examples) and their…

Machine Learning · Computer Science 2020-07-09 Justin Goodwin , Olivia Brown , Victoria Helus

Adversarial training attains strong empirical robustness to specific adversarial attacks by training on concrete adversarial perturbations, but it produces neural networks that are not amenable to strong robustness certificates through…

Machine Learning · Computer Science 2026-02-04 Alessandro De Palma

We consider the problem of certifying the robustness of deep neural networks against real-world distribution shifts. To do so, we bridge the gap between hand-crafted specifications and realistic deployment settings by proposing a novel…

Adversarial examples pose a security risk as they can alter decisions of a machine learning classifier through slight input perturbations. Certified robustness has been proposed as a mitigation where given an input $\mathbf{x}$, a…

Cryptography and Security · Computer Science 2024-09-10 Jiankai Jin , Olga Ohrimenko , Benjamin I. P. Rubinstein

Lipschitz bounded neural networks are certifiably robust and have a good trade-off between clean and certified accuracy. Existing Lipschitz bounding methods train from scratch and are limited to moderately sized networks (< 6M parameters).…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Kavya Gupta , Sagar Verma

Time series anomaly detection (TSAD) is an important data mining task with numerous applications in the IoT era. In recent years, a large number of deep neural network-based methods have been proposed, demonstrating significantly better…

Machine Learning · Computer Science 2022-08-04 Wenkai Li , Cheng Feng , Ting Chen , Jun Zhu

In this discussion paper, we survey recent research surrounding robustness of machine learning models. As learning algorithms become increasingly more popular in data-driven control systems, their robustness to data uncertainty must be…

Machine Learning · Computer Science 2022-09-28 Brendon G. Anderson , Tanmay Gautam , Somayeh Sojoudi

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Certified defenses based on convex relaxations are an established technique for training provably robust models. The key component is the choice of relaxation, varying from simple intervals to tight polyhedra. Counterintuitively, loose…

Machine Learning · Computer Science 2022-10-14 Nikola Jovanović , Mislav Balunović , Maximilian Baader , Martin Vechev

This paper evaluates the use of metamorphic relations to enhance the robustness and real-world performance of machine learning models. We propose a Metamorphic Retraining Framework, which applies metamorphic relations to data and utilizes…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Said Togru , Youssef Sameh Mostafa , Karim Lotfy

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

Data errors, corruptions, and poisoning attacks during training pose a major threat to the reliability of modern AI systems. While extensive effort has gone into empirical mitigations, the evolving nature of attacks and the complexity of…

Machine Learning · Computer Science 2025-10-28 Tobias Lorenz , Marta Kwiatkowska , Mario Fritz