English
Related papers

Related papers: Certified Robustness to Text Adversarial Attacks b…

200 papers

The language models, especially the basic text classification models, have been shown to be susceptible to textual adversarial attacks such as synonym substitution and word insertion attacks. To defend against such attacks, a growing body…

Cryptography and Security · Computer Science 2024-06-12 Xinyu Zhang , Hanbin Hong , Yuan Hong , Peng Huang , Binghui Wang , Zhongjie Ba , Kui Ren

Neural ranking models have achieved remarkable progress and are now widely deployed in real-world applications such as Retrieval-Augmented Generation (RAG). However, like other neural architectures, they remain vulnerable to adversarial…

Cryptography and Security · Computer Science 2025-12-30 Jiawei Liu , Zhuo Chen , Rui Zhu , Miaokun Chen , Yuyang Gong , Wei Lu , Xiaofeng Wang

State-of-the-art NLP models can often be fooled by human-unaware transformations such as synonymous word substitution. For security reasons, it is of critical importance to develop models with certified robustness that can provably…

Machine Learning · Computer Science 2020-06-01 Mao Ye , Chengyue Gong , Qiang Liu

We show how to turn any classifier that classifies well under Gaussian noise into a new classifier that is certifiably robust to adversarial perturbations under the $\ell_2$ norm. This "randomized smoothing" technique has been proposed…

Machine Learning · Computer Science 2019-06-18 Jeremy M Cohen , Elan Rosenfeld , J. Zico Kolter

Neural ranking models (NRMs) have achieved promising results in information retrieval. NRMs have also been shown to be vulnerable to adversarial examples. A typical Word Substitution Ranking Attack (WSRA) against NRMs was proposed recently,…

Information Retrieval · Computer Science 2022-09-15 Chen Wu , Ruqing Zhang , Jiafeng Guo , Wei Chen , Yixing Fan , Maarten de Rijke , Xueqi Cheng

With the growing integration of AI in daily life, ensuring the robustness of systems to inference-time attacks is crucial. Among the approaches for certifying robustness to such adversarial examples, randomized smoothing has emerged as…

Computation and Language · Computer Science 2024-08-02 Zhuoqun Huang , Neil G Marchant , Olga Ohrimenko , Benjamin I. P. Rubinstein

Randomized smoothing is a recent and celebrated solution to certify the robustness of any classifier. While it indeed provides a theoretical robustness against adversarial attacks, the dimensionality of current classifiers necessarily…

Cryptography and Security · Computer Science 2022-05-02 Thibault Maho , Teddy Furon , Erwan Le Merrer

Backdoor attack is a severe security threat to deep neural networks (DNNs). We envision that, like adversarial examples, there will be a cat-and-mouse game for backdoor attacks, i.e., new empirical defenses are developed to defend against…

Cryptography and Security · Computer Science 2020-07-21 Binghui Wang , Xiaoyu Cao , Jinyuan jia , Neil Zhenqiang Gong

It is well-known that classifiers are vulnerable to adversarial perturbations. To defend against adversarial perturbations, various certified robustness results have been derived. However, existing certified robustnesses are limited to…

Machine Learning · Computer Science 2019-12-23 Jinyuan Jia , Xiaoyu Cao , Binghui Wang , Neil Zhenqiang Gong

Machine learning models have demonstrated remarkable success across diverse domains but remain vulnerable to adversarial attacks. Empirical defense mechanisms often fail, as new attacks constantly emerge, rendering existing defenses…

Machine Learning · Computer Science 2024-10-25 Anupriya Kumari , Devansh Bhardwaj , Sukrit Jindal

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

Computation and Language · Computer Science 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

Machine Learning · Computer Science 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

The effectiveness of watermark algorithms in AI-generated text identification has garnered significant attention. Concurrently, an increasing number of watermark algorithms have been proposed to enhance the robustness against various…

Cryptography and Security · Computer Science 2024-10-01 Xianheng Feng , Jian Liu , Kui Ren , Chun Chen

Randomized smoothing is a popular certified defense against adversarial attacks. In its essence, we need to solve a problem of statistical estimation which is usually very time-consuming since we need to perform numerous (usually $10^5$)…

Machine Learning · Statistics 2025-01-22 Vaclav Voracek

Randomized smoothing has achieved great success for certified robustness against adversarial perturbations. Given any arbitrary classifier, randomized smoothing can guarantee the classifier's prediction over the perturbed input with…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Hanbin Hong , Yuan Hong

A line of work has shown that natural text processing models are vulnerable to adversarial examples. Correspondingly, various defense methods are proposed to mitigate the threat of textual adversarial examples, eg, adversarial training,…

Computation and Language · Computer Science 2022-07-21 Xiaosen Wang , Yifeng Xiong , Kun He

As ML models are increasingly deployed in critical applications, robustness against adversarial perturbations is crucial. While numerous defenses have been proposed to counter such attacks, they typically assume that all adversarial…

Machine Learning · Computer Science 2025-06-11 Yuan Xin , Dingfan Chen , Michael Backes , Xiao Zhang

Deep learning-based malware detection systems are vulnerable to adversarial EXEmples - carefully-crafted malicious programs that evade detection with minimal perturbation. As such, the community is dedicating effort to develop mechanisms to…

Cryptography and Security · Computer Science 2024-05-02 Daniel Gibert , Luca Demetrio , Giulio Zizzo , Quan Le , Jordi Planes , Battista Biggio

It is imperative to ensure the stability of every prediction made by a language model; that is, a language's prediction should remain consistent despite minor input variations, like word substitutions. In this paper, we investigate the…

Computation and Language · Computer Science 2024-06-06 Qian Lou , Xin Liang , Jiaqi Xue , Yancheng Zhang , Rui Xie , Mengxin Zheng

The improvement of language model robustness, including successful defense against adversarial attacks, remains an open problem. In computer vision settings, the stochastic noising and de-noising process provided by diffusion models has…

Machine Learning · Computer Science 2024-06-21 Harrison Gietz , Jugal Kalita
‹ Prev 1 2 3 10 Next ›