中文
相关论文

相关论文: Model Robustness with Text Classification: Semanti…

200 篇论文

We study the adversarial robustness of information bottleneck models for classification. Previous works showed that the robustness of models trained with information bottlenecks can improve upon adversarial training. Our evaluation under a…

机器学习 · 计算机科学 2021-07-14 Iryna Korshunova , David Stutz , Alexander A. Alemi , Olivia Wiles , Sven Gowal

With the development of large language models (LLMs), detecting whether text is generated by a machine becomes increasingly challenging in the face of malicious use cases like the spread of false information, protection of intellectual…

计算与语言 · 计算机科学 2024-04-03 Ying Zhou , Ben He , Le Sun

Due to their complex nature, it is hard to characterize the ways in which machine learning models can misbehave or be exploited when deployed. Recent work on adversarial examples, i.e. inputs with minor perturbations that result in…

机器学习 · 计算机科学 2018-02-27 Zhengli Zhao , Dheeru Dua , Sameer Singh

Adversarial examples, generated by applying small perturbations to input features, are widely used to fool classifiers and measure their robustness to noisy inputs. However, little work has been done to evaluate the robustness of ranking…

信息检索 · 计算机科学 2020-08-06 Nisarg Raval , Manisha Verma

In this paper, we present an effective method to craft text adversarial samples, revealing one important yet underestimated fact that DNN-based text classifiers are also prone to adversarial sample attack. Specifically, confronted with…

密码学与安全 · 计算机科学 2019-01-08 Bin Liang , Hongcheng Li , Miaoqiang Su , Pan Bian , Xirong Li , Wenchang Shi

The landscape of adversarial attacks against text classifiers continues to grow, with new attacks developed every year and many of them available in standard toolkits, such as TextAttack and OpenAttack. In response, there is a growing body…

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

计算与语言 · 计算机科学 2023-07-25 Neel Bhandari , Pin-Yu Chen

We propose an efficient method to generate white-box adversarial examples to trick a character-level neural classifier. We find that only a few manipulations are needed to greatly decrease the accuracy. Our method relies on an atomic flip…

计算与语言 · 计算机科学 2018-05-25 Javid Ebrahimi , Anyi Rao , Daniel Lowd , Dejing Dou

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

Text classifiers are vulnerable to adversarial examples -- correctly-classified examples that are deliberately transformed to be misclassified while satisfying acceptability constraints. The conventional approach to finding adversarial…

计算与语言 · 计算机科学 2024-05-21 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

Large Language Models (LLMs) have revolutionized natural language processing, but their robustness against adversarial attacks remains a critical concern. We presents a novel white-box style attack approach that exposes vulnerabilities in…

计算与语言 · 计算机科学 2024-09-16 Zeyu Yang , Zhao Meng , Xiaochen Zheng , Roger Wattenhofer

Although deep neural networks have shown promising performances on various tasks, even achieving human-level performance on some, they are shown to be susceptible to incorrect predictions even with imperceptibly small perturbations to an…

机器学习 · 计算机科学 2019-09-11 Byunggill Joe , Sung Ju Hwang , Insik Shin

Deep neural networks are vulnerable to adversarial attacks, where a small perturbation to an input alters the model prediction. In many cases, malicious inputs intentionally crafted for one model can fool another model. In this paper, we…

机器学习 · 计算机科学 2021-09-23 Liping Yuan , Xiaoqing Zheng , Yi Zhou , Cho-Jui Hsieh , Kai-wei Chang

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

机器学习 · 计算机科学 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Despite outstanding performance in a variety of NLP tasks, recent studies have revealed that NLP models are vulnerable to adversarial attacks that slightly perturb the input to cause the models to misbehave. Among these attacks, adversarial…

计算与语言 · 计算机科学 2024-06-11 Duy C. Hoang , Quang H. Nguyen , Saurav Manchanda , MinLong Peng , Kok-Seng Wong , Khoa D. Doan

Black-Box attacks on machine learning models occur when an attacker, despite having no access to the inner workings of a model, can successfully craft an attack by means of model theft. The attacker will train an own substitute model that…

机器学习 · 计算机科学 2017-11-16 Yannic Kilcher , Thomas Hofmann

Deep neural networks are vulnerable to adversarial examples - small input perturbations that result in incorrect predictions. We study this problem for models of source code, where we want the network to be robust to source-code…

机器学习 · 计算机科学 2022-08-23 Goutham Ramakrishnan , Jordan Henkel , Zi Wang , Aws Albarghouthi , Somesh Jha , Thomas Reps

Like many other tasks involving neural networks, Speech Recognition models are vulnerable to adversarial attacks. However recent research has pointed out differences between attacks and defenses on ASR models compared to image models.…

密码学与安全 · 计算机科学 2022-04-06 Raphael Olivier , Bhiksha Raj

As machine learning systems become more widely used, especially for safety critical applications, there is a growing need to ensure that these systems behave as intended, even in the face of adversarial examples. Adversarial examples are…

计算与语言 · 计算机科学 2024-08-19 Anahita Samadi , Allison Sullivan