English
Related papers

Related papers: Certified Robustness to Text Adversarial Attacks b…

200 papers

Recent advancements in Large Language Models (LLMs) have led to their widespread adoption in daily applications. Despite their impressive capabilities, they remain vulnerable to adversarial attacks, as even minor meaning-preserving changes…

Machine Learning · Computer Science 2025-12-11 Zixia Wang , Gaojie Jin , Jia Hu , Ronghui Mu

Various adversarial audio attacks have recently been developed to fool automatic speech recognition (ASR) systems. We here propose a defense against such attacks based on the uncertainty introduced by dropout in neural networks. We show…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-16 Tejas Jayashankar , Jonathan Le Roux , Pierre Moulin

The robustness of deep neural networks (DNNs) against adversarial example attacks has raised wide attention. For smoothed classifiers, we propose the worst-case adversarial loss over input distributions as a robustness certificate. Compared…

Machine Learning · Computer Science 2021-05-03 Jungang Yang , Liyao Xiang , Ruidong Chen , Yukun Wang , Wei Wang , Xinbing Wang

Deep Neural Network (DNN) based classifiers have recently been used for the modulation classification of RF signals. These classifiers have shown impressive performance gains relative to conventional methods, however, they are vulnerable to…

Machine Learning · Computer Science 2024-10-10 Wenhan Zhang , Meiyu Zhong , Ravi Tandon , Marwan Krunz

The landscape of available textual adversarial attacks keeps growing, posing severe threats and raising concerns regarding the deep NLP system's integrity. However, the crucial problem of defending against malicious attacks has only drawn…

Computation and Language · Computer Science 2023-10-24 Pierre Colombo , Marine Picot , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

Research on adversarial robustness in language models is currently fragmented across applications and attacks, obscuring shared vulnerabilities. In this work, we propose unifying the study of adversarial robustness in text scoring models…

Computation and Language · Computer Science 2026-02-03 Manveer Singh Tamber , Hosna Oyarhoseini , Jimmy Lin

Is there a classifier that ensures optimal robustness against all adversarial attacks? This paper answers this question by adopting a game-theoretic point of view. We show that adversarial attacks and defenses form an infinite zero-sum game…

Machine Learning · Computer Science 2021-01-07 Rafael Pinot , Raphael Ettedgui , Geovani Rizk , Yann Chevaleyre , Jamal Atif

Model attribution is a popular tool to explain the rationales behind model predictions. However, recent work suggests that the attributions are vulnerable to minute perturbations, which can be added to input samples to fool the attributions…

Machine Learning · Computer Science 2024-05-13 Fan Wang , Adams Wai-Kin Kong

Revealing the robustness issues of natural language processing models and improving their robustness is important to their performance under difficult situations. In this paper, we study the robustness of paraphrase identification models…

Computation and Language · Computer Science 2020-10-06 Zhouxing Shi , Minlie Huang

CAPTCHA (Completely Automated Public Truing test to tell Computers and Humans Apart) is a widely used technology to distinguish real users and automated users such as bots. However, the advance of AI technologies weakens many CAPTCHA tests…

Machine Learning · Computer Science 2021-01-08 Rulin Shao , Zhouxing Shi , Jinfeng Yi , Pin-Yu Chen , Cho-Jui Hsieh

We extend randomized smoothing to cover parameterized transformations (e.g., rotations, translations) and certify robustness in the parameter space (e.g., rotation angle). This is particularly challenging as interpolation and rounding…

Machine Learning · Computer Science 2021-08-26 Marc Fischer , Maximilian Baader , Martin Vechev

As machine learning systems become more widely used, especially for safety critical applications, there is a growing need to ensure that these systems behave as intended, even in the face of adversarial examples. Adversarial examples are…

Computation and Language · Computer Science 2024-08-19 Anahita Samadi , Allison Sullivan

Despite considerable efforts on making them robust, real-world AI-based systems remain vulnerable to decision based attacks, as definitive proofs of their operational robustness have so far proven intractable. Canonical robustness…

Artificial Intelligence · Computer Science 2025-05-07 Ilias Tsingenopoulos , Vera Rimmer , Davy Preuveneers , Fabio Pierazzi , Lorenzo Cavallaro , Wouter Joosen

Deep learning techniques have enabled vast improvements in computer vision technologies. Nevertheless, these models are vulnerable to adversarial patch attacks which catastrophically impair performance. The physically realizable nature of…

Cryptography and Security · Computer Science 2025-06-02 Dennis Jacob , Chong Xiang , Prateek Mittal

Graph neural networks (GNNs) have recently gained much attention for node and graph classification tasks on graph-structured data. However, multiple recent works showed that an attacker can easily make GNNs predict incorrectly via…

Cryptography and Security · Computer Science 2021-07-19 Binghui Wang , Jinyuan Jia , Xiaoyu Cao , Neil Zhenqiang Gong

Recent advances in machine learning (ML) algorithms, especially deep neural networks (DNNs), have demonstrated remarkable success (sometimes exceeding human-level performance) on several tasks, including face and speech recognition.…

Machine Learning · Computer Science 2020-03-04 Yue Gao , Harrison Rosenberg , Kassem Fawaz , Somesh Jha , Justin Hsu

Graph classification has practical applications in diverse fields. Recent studies show that graph-based machine learning models are especially vulnerable to adversarial perturbations due to the non i.i.d nature of graph data. By adding or…

Machine Learning · Computer Science 2020-09-15 Zhidong Gao , Rui Hu , Yanmin Gong

Although promising, existing defenses against query-based attacks share a common limitation: they offer increased robustness against attacks at the price of a considerable accuracy drop on clean samples. In this work, we show how to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Pascal Zimmer , Sébastien Andreina , Giorgia Azzurra Marson , Ghassan Karame

With the boom of Large Language Models (LLMs), the research of solving Math Word Problem (MWP) has recently made great progress. However, there are few studies to examine the security of LLMs in math solving ability. Instead of attacking…

Computation and Language · Computer Science 2023-09-06 Zihao Zhou , Qiufeng Wang , Mingyu Jin , Jie Yao , Jianan Ye , Wei Liu , Wei Wang , Xiaowei Huang , Kaizhu Huang

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein