中文
相关论文

相关论文: Randomized Smoothing under Attack: How Good is it …

200 篇论文

Watermarking is a commonly used strategy to protect creators' rights to digital images, videos and audio. Recently, watermarking methods have been extended to deep learning models -- in principle, the watermark should be preserved when an…

The language models, especially the basic text classification models, have been shown to be susceptible to textual adversarial attacks such as synonym substitution and word insertion attacks. To defend against such attacks, a growing body…

密码学与安全 · 计算机科学 2024-06-12 Xinyu Zhang , Hanbin Hong , Yuan Hong , Peng Huang , Binghui Wang , Zhongjie Ba , Kui Ren

Randomized smoothing is currently considered the state-of-the-art method to obtain certifiably robust classifiers. Despite its remarkable performance, the method is associated with various serious problems such as "certified accuracy…

机器学习 · 计算机科学 2024-03-11 Peter Súkeník , Aleksei Kuvshinov , Stephan Günnemann

Randomized smoothing is a popular way of providing robustness guarantees against adversarial attacks: randomly-smoothed functions have a universal Lipschitz-like bound, allowing for robustness certificates to be easily computed. In this…

机器学习 · 计算机科学 2020-12-16 Alexander Levine , Aounon Kumar , Thomas Goldstein , Soheil Feizi

Randomized smoothing is the state-of-the-art approach to construct image classifiers that are provably robust against additive adversarial perturbations of bounded magnitude. However, it is more complicated to construct reasonable…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Dmitrii Korzh , Mikhail Pautov , Olga Tsymboi , Ivan Oseledets

While Automatic Speech Recognition has been shown to be vulnerable to adversarial attacks, defenses against these attacks are still lagging. Existing, naive defenses can be partially broken with an adaptive attack. In classification tasks,…

计算与语言 · 计算机科学 2022-01-12 Raphael Olivier , Bhiksha Raj

Recent work in adversarial robustness suggests that natural data distributions are localized, i.e., they place high probability in small volume regions of the input space, and that this property can be utilized for designing classifiers…

机器学习 · 计算机科学 2024-05-24 Ambar Pal , René Vidal , Jeremias Sulam

We show a hardness result for random smoothing to achieve certified adversarial robustness against attacks in the $\ell_p$ ball of radius $\epsilon$ when $p>2$. Although random smoothing has been well understood for the $\ell_2$ case using…

机器学习 · 计算机科学 2020-03-06 Avrim Blum , Travis Dick , Naren Manoj , Hongyang Zhang

Randomized smoothing is a leading approach for constructing classifiers that are certifiably robust against adversarial examples. Existing work on randomized smoothing has focused on classifiers with continuous inputs, such as images, where…

密码学与安全 · 计算机科学 2024-01-26 Zhuoqun Huang , Neil G. Marchant , Keane Lucas , Lujo Bauer , Olga Ohrimenko , Benjamin I. P. Rubinstein

As reinforcement learning (RL) has achieved great success and been even adopted in safety-critical domains such as autonomous vehicles, a range of empirical studies have been conducted to improve its robustness against adversarial attacks.…

机器学习 · 计算机科学 2022-03-17 Fan Wu , Linyi Li , Zijian Huang , Yevgeniy Vorobeychik , Ding Zhao , Bo Li

Randomized smoothing has been shown to provide good certified-robustness guarantees for high-dimensional classification problems. It uses the probabilities of predicting the top two most-likely classes around an input point under a…

机器学习 · 计算机科学 2020-10-26 Aounon Kumar , Alexander Levine , Soheil Feizi , Tom Goldstein

Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model in a "white box" setting and to the opposite in a "black box" setting. In this…

机器学习 · 计算机科学 2021-07-09 Daniel Park , Haidar Khan , Azer Khan , Alex Gittens , Bülent Yener

Randomized smoothing (RS) has successfully been used to improve the robustness of predictions for deep neural networks (DNNs) by adding random noise to create multiple variations of an input, followed by deciding the consensus. To…

机器学习 · 计算机科学 2024-04-29 Emmanouil Seferis , Stefanos Kollias , Chih-Hong Cheng

This paper investigates the theory of robustness against adversarial attacks. We focus on randomized classifiers (\emph{i.e.} classifiers that output random variables) and provide a thorough analysis of their behavior through the lens of…

机器学习 · 计算机科学 2021-02-23 Rafael Pinot , Laurent Meunier , Florian Yger , Cédric Gouy-Pailler , Yann Chevaleyre , Jamal Atif

Certified defenses such as randomized smoothing have shown promise towards building reliable machine learning systems against $\ell_p$-norm bounded attacks. However, existing methods are insufficient or unable to provably defend against…

机器学习 · 计算机科学 2022-06-30 Zhongkai Hao , Chengyang Ying , Yinpeng Dong , Hang Su , Jun Zhu , Jian Song

Neural ranking models have achieved remarkable progress and are now widely deployed in real-world applications such as Retrieval-Augmented Generation (RAG). However, like other neural architectures, they remain vulnerable to adversarial…

密码学与安全 · 计算机科学 2025-12-30 Jiawei Liu , Zhuo Chen , Rui Zhu , Miaokun Chen , Yuyang Gong , Wei Lu , Xiaofeng Wang

Machine Learning (ML) models have been utilized for malware detection for over two decades. Consequently, this ignited an ongoing arms race between malware authors and antivirus systems, compelling researchers to propose defenses for…

密码学与安全 · 计算机科学 2023-10-04 Shoumik Saha , Wenxiao Wang , Yigitcan Kaya , Soheil Feizi , Tudor Dumitras

As we seek to deploy machine learning models beyond virtual and controlled domains, it is critical to analyze not only the accuracy or the fact that it works most of the time, but if such a model is truly robust and reliable. This paper…

机器学习 · 计算机科学 2020-07-07 Samuel Henrique Silva , Peyman Najafirad

We propose a new randomized ensemble technique with a provable security guarantee against black-box transfer attacks. Our proof constructs a new security problem for random binary classifiers which is easier to empirically verify and a…

机器学习 · 计算机科学 2020-02-25 Kevin Shi , Daniel Hsu , Allison Bishop

Neural network classifiers are vulnerable to data poisoning attacks, as attackers can degrade or even manipulate their predictions thorough poisoning only a few training samples. However, the robustness of heuristic defenses is hard to…

机器学习 · 计算机科学 2020-10-14 Ruoxin Chen , Jie Li , Chentao Wu , Bin Sheng , Ping Li