English
Related papers

Related papers: LimeAttack: Local Explainable Method for Textual H…

200 papers

Several years of research have shown that machine-learning systems are vulnerable to adversarial examples, both in theory and in practice. Until now, such attacks have primarily targeted visual models, exploiting the gap between human and…

Computation and Language · Computer Science 2021-12-14 Nicholas Boucher , Ilia Shumailov , Ross Anderson , Nicolas Papernot

Semantic segmentation is one of the most fundamental problems in computer vision with significant impact on a wide variety of applications. Adversarial learning is shown to be an effective approach for improving semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Hadi Jamali-Rad , Attila Szabo

Readability assessment aims to evaluate the reading difficulty of a text. In recent years, while deep learning technology has been gradually applied to readability assessment, most approaches fail to consider either the length of the text…

Computation and Language · Computer Science 2025-11-27 Yurui Zheng , Yijun Chen , Shaohong Zhang

Large Language Models (LLMs) represent a transformative leap in artificial intelligence, enabling the comprehension, generation, and nuanced interaction with human language on an unparalleled scale. However, LLMs are increasingly vulnerable…

Cryptography and Security · Computer Science 2025-02-06 Nan Wang , Kane Walter , Yansong Gao , Alsharif Abuadbba

Backdoor attacks significantly compromise the security of large language models by triggering them to output specific and controlled content. Currently, triggers for textual backdoor attacks fall into two categories: fixed-token triggers…

Cryptography and Security · Computer Science 2025-04-01 Jingyi Zheng , Tianyi Hu , Tianshuo Cong , Xinlei He

Adversarial training (AT) is currently one of the most effective ways to obtain the robustness of deep neural networks against adversarial attacks. However, most AT methods suffer from robust overfitting, i.e., a significant generalization…

Machine Learning · Computer Science 2024-03-15 Daiwei Yu , Zhuorong Li , Lina Wei , Canghong Jin , Yun Zhang , Sixian Chan

Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning using Chain-of-Thought (CoT) prompting. However, CoT can be biased by users' instruction. In this work, we study the reasoning robustness of LLMs to…

Computation and Language · Computer Science 2024-11-11 Esther Gan , Yiran Zhao , Liying Cheng , Yancan Mao , Anirudh Goyal , Kenji Kawaguchi , Min-Yen Kan , Michael Shieh

Although Deep Neural Network (DNN) has led to unprecedented progress in various natural language processing (NLP) tasks, research shows that deep models are extremely vulnerable to backdoor attacks. The existing backdoor attacks mainly…

Cryptography and Security · Computer Science 2022-06-07 Xiaoyi Chen , Yinpeng Dong , Zeyu Sun , Shengfang Zhai , Qingni Shen , Zhonghai Wu

Machine learning algorithms are often vulnerable to adversarial examples that have imperceptible alterations from the original counterparts but can fool the state-of-the-art models. It is helpful to evaluate or even improve the robustness…

Computation and Language · Computer Science 2020-04-10 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

Computation and Language · Computer Science 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Textual adversarial attacking has received wide and increasing attention in recent years. Various attack models have been proposed, which are enormously distinct and implemented with different programming frameworks and settings. These…

Computation and Language · Computer Science 2021-09-27 Guoyang Zeng , Fanchao Qi , Qianrui Zhou , Tingji Zhang , Zixian Ma , Bairu Hou , Yuan Zang , Zhiyuan Liu , Maosong Sun

This paper introduces a novel adversarial attack method targeting text classification models, termed the Modified Word Saliency-based Adversarial At-tack (MWSAA). The technique builds upon the concept of word saliency to strategically…

Computation and Language · Computer Science 2025-05-13 Hetvi Waghela , Sneha Rakshit , Jaydip Sen

With the emergence of more powerful large language models (LLMs), such as ChatGPT and GPT-4, in-context learning (ICL) has gained significant prominence in leveraging these models for specific tasks by utilizing data-label pairs as…

Computation and Language · Computer Science 2023-10-17 Jiongxiao Wang , Zichen Liu , Keun Hee Park , Zhuojun Jiang , Zhaoheng Zheng , Zhuofeng Wu , Muhao Chen , Chaowei Xiao

Deep neural networks are vulnerable to backdoor attacks, a type of adversarial attack that poisons the training data to manipulate the behavior of models trained on such data. Clean-label attacks are a more stealthy form of backdoor attacks…

Machine Learning · Computer Science 2024-07-17 Quang H. Nguyen , Nguyen Ngoc-Hieu , The-Anh Ta , Thanh Nguyen-Tang , Kok-Seng Wong , Hoang Thanh-Tung , Khoa D. Doan

Adversarial purification is a defense mechanism for safeguarding classifiers against adversarial attacks without knowing the type of attacks or training of the classifier. These techniques characterize and eliminate adversarial…

Cryptography and Security · Computer Science 2024-02-13 Raha Moraffah , Shubh Khandelwal , Amrita Bhattacharjee , Huan Liu

With the great success of deep neural networks, adversarial learning has received widespread attention in various studies, ranging from multi-class learning to multi-label learning. However, existing adversarial attacks toward multi-label…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuchen Sun , Qianqian Xu , Zitai Wang , Qingming Huang

We study the problem of attacking a machine learning model in the hard-label black-box setting, where no model information is revealed except that the attacker can make queries to probe the corresponding hard-label decisions. This is a very…

Machine Learning · Computer Science 2018-07-13 Minhao Cheng , Thong Le , Pin-Yu Chen , Jinfeng Yi , Huan Zhang , Cho-Jui Hsieh

Machine Learning models have been shown to be vulnerable to adversarial examples, ie. the manipulation of data by a attacker to defeat a defender's classifier at test time. We present a novel probabilistic definition of adversarial examples…

Machine Learning · Statistics 2018-01-09 Martin Gubri

Current adversarial attack research reveals the vulnerability of learning-based classifiers against carefully crafted perturbations. However, most existing attack methods have inherent limitations in cross-dataset generalization as they…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Cheng Luo , Qinliang Lin , Weicheng Xie , Bizhu Wu , Jinheng Xie , Linlin Shen

Adversarial Robustness is a growing field that evidences the brittleness of neural networks. Although the literature on adversarial robustness is vast, a dimension is missing in these studies: assessing how severe the mistakes are. We call…

Machine Learning · Computer Science 2021-08-27 Guillaume Jeanneret , Juan C Perez , Pablo Arbelaez