English
Related papers

Related papers: A Recipe for Improved Certifiable Robustness

200 papers

We address the problem of verifying neural networks against geometric transformations of the input image, including rotation, scaling, shearing, and translation. The proposed method computes provably sound piecewise linear constraints for…

Machine Learning · Computer Science 2024-09-24 Ben Batten , Yang Zheng , Alessandro De Palma , Panagiotis Kouvaros , Alessio Lomuscio

Despite their impressive performance on diverse tasks, neural networks fail catastrophically in the presence of adversarial inputs---imperceptibly but adversarially perturbed versions of natural inputs. We have witnessed an arms race…

Machine Learning · Computer Science 2018-11-06 Aditi Raghunathan , Jacob Steinhardt , Percy Liang

Computational efficiency and robustness are essential in process modeling, optimization, and control for real-world engineering applications. While neural network-based approaches have gained significant attention in recent years,…

Machine Learning · Computer Science 2026-03-17 Zihao Wang , Yuhan Li , Yao Shi , Zhe Wu

Randomized smoothing-based certification is an effective approach for obtaining robustness certificates of deep neural networks (DNNs) against adversarial attacks. This method constructs a smoothed DNN model and certifies its robustness…

Machine Learning · Computer Science 2024-04-12 Shubham Ugare , Tarun Suresh , Debangshu Banerjee , Gagandeep Singh , Sasa Misailovic

Neural networks are very successful at detecting patterns in noisy data, and have become the technology of choice in many fields. However, their usefulness is hampered by their susceptibility to adversarial attacks. Recently, many methods…

Machine Learning · Computer Science 2022-07-14 Marco Casadio , Ekaterina Komendantskaya , Matthew L. Daggitt , Wen Kokke , Guy Katz , Guy Amir , Idan Refaeli

Recent research has established that the local Lipschitz constant of a neural network directly influences its adversarial robustness. We exploit this relationship to construct an ensemble of neural networks which not only improves the…

Machine Learning · Computer Science 2022-06-02 Thulasi Tholeti , Sheetal Kalyani

Stability certification and identifying a safe and stabilizing initial set are two important concerns in ensuring operational safety, stability, and robustness of dynamical systems. With the advent of machine-learning tools, these issues…

Machine Learning · Computer Science 2022-09-01 Soumyabrata Talukder , Ratnesh Kumar

While neural networks have achieved high accuracy on standard image classification benchmarks, their accuracy drops to nearly zero in the presence of small adversarial perturbations to test inputs. Defenses based on regularization and…

Machine Learning · Computer Science 2020-11-03 Aditi Raghunathan , Jacob Steinhardt , Percy Liang

This paper introduces new parameterizations of equilibrium neural networks, i.e. networks defined by implicit equations. This model class includes standard multilayer and residual networks as special cases. The new parameterization admits a…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

The rise of foundation models fine-tuned on human feedback from potentially untrusted users has increased the risk of adversarial data poisoning, necessitating the study of robustness of learning algorithms against such attacks. Existing…

Machine Learning · Computer Science 2025-02-25 Avinandan Bose , Laurent Lessard , Maryam Fazel , Krishnamurthy Dj Dvijotham

CLEVER (Cross-Lipschitz Extreme Value for nEtwork Robustness) is an Extreme Value Theory (EVT) based robustness score for large-scale deep neural networks (DNNs). In this paper, we propose two extensions on this robustness score. First, we…

Machine Learning · Computer Science 2018-10-23 Tsui-Wei Weng , Huan Zhang , Pin-Yu Chen , Aurelie Lozano , Cho-Jui Hsieh , Luca Daniel

Generative learning, recognized for its effective modeling of data distributions, offers inherent advantages in handling out-of-distribution instances, especially for enhancing robustness to adversarial attacks. Among these, diffusion…

Machine Learning · Computer Science 2025-02-25 Huanran Chen , Yinpeng Dong , Shitong Shao , Zhongkai Hao , Xiao Yang , Hang Su , Jun Zhu

Verifiable training has shown success in creating neural networks that are provably robust to a given amount of noise. However, despite only enforcing a single robustness criterion, its performance scales poorly with dataset complexity. On…

Machine Learning · Computer Science 2020-12-16 Shiqi Wang , Kevin Eykholt , Taesung Lee , Jiyong Jang , Ian Molloy

Great advances in deep neural networks (DNNs) have led to state-of-the-art performance on a wide range of tasks. However, recent studies have shown that DNNs are vulnerable to adversarial attacks, which have brought great concerns when…

Machine Learning · Computer Science 2023-04-13 Linyi Li , Tao Xie , Bo Li

Robustness to adversarial attacks was shown to require a larger model capacity, and thus a larger memory footprint. In this paper, we introduce an approach to obtain robust yet compact models by pruning randomly-initialized binary networks.…

Machine Learning · Computer Science 2022-10-18 Chen Liu , Ziqi Zhao , Sabine Süsstrunk , Mathieu Salzmann

Deep neural networks for natural language processing are fragile in the face of adversarial examples -- small input perturbations, like synonym substitution or word duplication, which cause a neural network to change its prediction. We…

Machine Learning · Computer Science 2021-09-08 Yuhao Zhang , Aws Albarghouthi , Loris D'Antoni

Recurrent neural networks (RNNs) are a class of nonlinear dynamical systems often used to model sequence-to-sequence maps. RNNs have excellent expressive power but lack the stability or robustness guarantees that are necessary for many…

Machine Learning · Computer Science 2020-10-06 Max Revay , Ruigang Wang , Ian R. Manchester

Despite the exploding interest in graph neural networks there has been little effort to verify and improve their robustness. This is even more alarming given recent findings showing that they are extremely vulnerable to adversarial attacks…

Machine Learning · Computer Science 2019-12-20 Aleksandar Bojchevski , Stephan Günnemann

Adversarial Training is the most effective approach for improving the robustness of Deep Neural Networks (DNNs). However, compared to the large body of research in optimizing the adversarial training process, there are few investigations…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 ShengYun Peng , Weilin Xu , Cory Cornelius , Kevin Li , Rahul Duggal , Duen Horng Chau , Jason Martin

We introduce Hybrid Convolutions with Attention Stochasticity (HyCAS), an adversarial defense that narrows the long-standing gap between provable robustness under L2 certificates and empirical robustness against strong L attacks, while…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Joy Dhar , Song Xia , Manish Kumar Pandey , Maryam Haghighat , Azadeh Alavi , Ferdous Sohel , Wenyu Zhang , Nayyar Zaidi