English
Related papers

Related papers: Estimating the Robustness Radius for Randomized Sm…

200 papers

Randomized smoothing is a popular way of providing robustness guarantees against adversarial attacks: randomly-smoothed functions have a universal Lipschitz-like bound, allowing for robustness certificates to be easily computed. In this…

Machine Learning · Computer Science 2020-12-16 Alexander Levine , Aounon Kumar , Thomas Goldstein , Soheil Feizi

Recently, the issue of adversarial robustness in the time series domain has garnered significant attention. However, the available defense mechanisms remain limited, with adversarial training being the predominant approach, though it does…

Machine Learning · Computer Science 2024-09-20 Chang Dong , Zhengyang Li , Liangwei Zheng , Weitong Chen , Wei Emma Zhang

Deep Neural Network (DNN) trained by the gradient descent method is known to be vulnerable to maliciously perturbed adversarial input, aka. adversarial attack. As one of the countermeasures against adversarial attack, increasing the model…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Adnan Siraj Rakin , Zhezhi He , Li Yang , Yanzhi Wang , Liqiang Wang , Deliang Fan

Deep Neural Networks (DNNs) are being deployed in a wide range of settings today, from safety-critical applications like autonomous driving to commercial applications involving image classifications. However, recent research has shown that…

Software Engineering · Computer Science 2021-01-26 Ziyuan Zhong , Yuchi Tian , Baishakhi Ray

This paper introduces a notation of $\varepsilon$-weakened robustness for analyzing the reliability and stability of deep neural networks (DNNs). Unlike the conventional robustness, which focuses on the "perfect" safe region in the absence…

Machine Learning · Computer Science 2021-11-01 Pei Huang , Yuting Yang , Minghao Liu , Fuqi Jia , Feifei Ma , Jian Zhang

Randomized smoothing is a recently proposed defense against adversarial attacks that has achieved SOTA provable robustness against $\ell_2$ perturbations. A number of publications have extended the guarantees to other metrics, such as…

Machine Learning · Computer Science 2020-10-15 Jeet Mohapatra , Ching-Yun Ko , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Randomized smoothing is sound when using infinite precision. However, we show that randomized smoothing is no longer sound for limited floating-point precision. We present a simple example where randomized smoothing certifies a radius of…

Machine Learning · Computer Science 2023-04-26 Václav Voráček , Matthias Hein

Models for image segmentation, node classification and many other tasks map a single input to multiple labels. By perturbing this single shared input (e.g. the image) an adversary can manipulate several predictions (e.g. misclassify several…

Machine Learning · Computer Science 2024-02-27 Jan Schuchardt , Tom Wollschläger , Aleksandar Bojchevski , Stephan Günnemann

Backdoor attack is a severe security threat to deep neural networks (DNNs). We envision that, like adversarial examples, there will be a cat-and-mouse game for backdoor attacks, i.e., new empirical defenses are developed to defend against…

Cryptography and Security · Computer Science 2020-07-21 Binghui Wang , Xiaoyu Cao , Jinyuan jia , Neil Zhenqiang Gong

Although large language models (LLMs) have achieved great success in vast real-world applications, their vulnerabilities towards noisy inputs have significantly limited their uses, especially in high-stake environments. In these contexts,…

Computation and Language · Computer Science 2023-07-17 Zhen Zhang , Guanhua Zhang , Bairu Hou , Wenqi Fan , Qing Li , Sijia Liu , Yang Zhang , Shiyu Chang

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

Machine Learning · Computer Science 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

The study of provable adversarial robustness for deep neural networks (DNNs) has mainly focused on static supervised learning tasks such as image classification. However, DNNs have been used extensively in real-world adaptive tasks such as…

Machine Learning · Computer Science 2022-05-31 Aounon Kumar , Alexander Levine , Soheil Feizi

Randomized smoothing is one of the most promising frameworks for certifying the adversarial robustness of machine learning models, including Graph Neural Networks (GNNs). Yet, existing randomized smoothing certificates for GNNs are overly…

Machine Learning · Computer Science 2024-11-12 Yan Scholten , Jan Schuchardt , Simon Geisler , Aleksandar Bojchevski , Stephan Günnemann

The fragility of modern machine learning models has drawn a considerable amount of attention from both academia and the public. While immense interests were in either crafting adversarial attacks as a way to measure the robustness of neural…

Machine Learning · Computer Science 2021-03-16 Jeet Mohapatra , Ching-Yun Ko , Tsui-Wei , Weng , Sijia Liu , Pin-Yu Chen , Luca Daniel

In this paper, we propose Selective Output Smoothing Regularization, a novel regularization method for training the Convolutional Neural Networks (CNNs). Inspired by the diverse effects on training from different samples, Selective Output…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xuan Cheng , Tianshu Xie , Xiaomin Wang , Qifeng Weng , Minghui Liu , Jiali Deng , Ming Liu

Despite advancements in Graph Neural Networks (GNNs), adaptive attacks continue to challenge their robustness. Certified robustness based on randomized smoothing has emerged as a promising solution, offering provable guarantees that a…

Machine Learning · Computer Science 2025-04-01 Yuni Lai , Yulin Zhu , Yixuan Sun , Yulun Wu , Bin Xiao , Gaolei Li , Jianhua Li , Kai Zhou

Randomized smoothing is the primary certified robustness method for accessing the robustness of deep learning models to adversarial perturbations in the l2-norm, by adding isotropic Gaussian noise to the input image and returning the…

Machine Learning · Computer Science 2024-04-09 Chengyan Fu , Wenjie Wang

One of the intensely studied concepts of network robustness is $r$-robustness, which is a network topology property quantified by an integer $r$. It is required by mean subsequence reduced (MSR) algorithms and their variants to achieve…

Systems and Control · Electrical Eng. & Systems 2022-07-26 Yuhao Yi , Yuan Wang , Xingkang He , Stacy Patterson , Karl H. Johansson

By driving models to converge to flat minima, sharpness-aware learning algorithms (such as SAM) have shown the power to achieve state-of-the-art performances. However, these algorithms will generally incur one extra forward-backward…

Machine Learning · Computer Science 2023-04-11 Yang Zhao , Hao Zhang , Xiuyuan Hu

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar