中文
相关论文

相关论文: Second-Order NLP Adversarial Examples

200 篇论文

As the deployment of NLP systems in critical applications grows, ensuring the robustness of large language models (LLMs) against adversarial attacks becomes increasingly important. Large language models excel in various NLP tasks but remain…

计算与语言 · 计算机科学 2024-05-03 Zhenning Yang , Ryan Krawec , Liang-Yuan Wu

Making classifiers robust to adversarial examples is hard. Thus, many defenses tackle the seemingly easier task of detecting perturbed inputs. We show a barrier towards this goal. We prove a general hardness reduction between detection and…

机器学习 · 计算机科学 2022-06-17 Florian Tramèr

Neural language models show vulnerability to adversarial examples which are semantically similar to their original counterparts with a few words replaced by their synonyms. A common way to improve model robustness is adversarial training…

计算与语言 · 计算机科学 2022-03-25 Hanjie Chen , Yangfeng Ji

Modern classification algorithms are susceptible to adversarial examples--perturbations to inputs that cause the algorithm to produce undesirable behavior. In this work, we seek to understand and extend adversarial examples across domains…

机器学习 · 计算机科学 2021-12-14 Volodymyr Kuleshov , Evgenii Nikishin , Shantanu Thakoor , Tingfung Lau , Stefano Ermon

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

计算与语言 · 计算机科学 2023-07-25 Neel Bhandari , Pin-Yu Chen

Given the widespread use of deep learning models in safety-critical applications, ensuring that the decisions of such models are robust against adversarial exploitation is of fundamental importance. In this thesis, we discuss recent…

机器学习 · 计算机科学 2025-09-24 Alexander Robey

Machine Learning systems are vulnerable to adversarial attacks and will highly likely produce incorrect outputs under these attacks. There are white-box and black-box attacks regarding to adversary's access level to the victim learning…

机器学习 · 计算机科学 2019-10-23 Saeid Samizade , Zheng-Hua Tan , Chao Shen , Xiaohong Guan

Recent work has shown it is possible to construct adversarial examples that cause an aligned language model to emit harmful strings or perform harmful behavior. Existing attacks work either in the white-box setting (with full access to the…

计算与语言 · 计算机科学 2024-12-10 Jonathan Hayase , Ema Borevkovic , Nicholas Carlini , Florian Tramèr , Milad Nasr

Neural networks have received a lot of attention recently, and related security issues have come with it. Many studies have shown that neural networks are vulnerable to adversarial examples that have been artificially perturbed with…

密码学与安全 · 计算机科学 2025-08-07 Shi Pu , Fu Song , Wenjie Wang

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

机器学习 · 计算机科学 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

The phenomenon of Adversarial Examples is attracting increasing interest from the Machine Learning community, due to its significant impact to the security of Machine Learning systems. Adversarial examples are similar (from a perceptual…

计算机视觉与模式识别 · 计算机科学 2019-01-25 Luiz G. Hafemann , Robert Sabourin , Luiz S. Oliveira

Large Language Models (LLMs) have become vital tools in software development tasks such as code generation, completion, and analysis. As their integration into workflows deepens, ensuring robustness against vulnerabilities especially those…

软件工程 · 计算机科学 2025-07-21 Yang Liu , Armstrong Foundjem , Foutse Khomh , Heng Li

Over recent years, devising classification algorithms that are robust to adversarial perturbations has emerged as a challenging problem. In particular, deep neural nets (DNNs) seem to be susceptible to small imperceptible changes over test…

机器学习 · 计算机科学 2019-12-20 Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody

In malware behavioral analysis, the list of accessed and created files very often indicates whether the examined file is malicious or benign. However, malware authors are trying to avoid detection by generating random filenames and/or…

机器学习 · 计算机科学 2021-10-26 Marek Galovic , Branislav Bosansky , Viliam Lisy

Machine learning based solutions have been very helpful in solving problems that deal with immense amounts of data, such as malware detection and classification. However, deep neural networks have been found to be vulnerable to adversarial…

密码学与安全 · 计算机科学 2020-11-12 Daniel Park , Bülent Yener

Deep neural networks have been proved that they are vulnerable to adversarial examples, which are generated by adding human-imperceptible perturbations to images. To defend these adversarial examples, various detection based methods have…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Kejiang Chen , Yuefeng Chen , Hang Zhou , Chuan Qin , Xiaofeng Mao , Weiming Zhang , Nenghai Yu

Recently, generating adversarial examples has become an important means of measuring robustness of a deep learning model. Adversarial examples help us identify the susceptibilities of the model and further counter those vulnerabilities by…

机器学习 · 计算机科学 2021-03-03 Prashanth Vijayaraghavan , Deb Roy

Adversarial examples are typically constructed by perturbing an existing data point within a small matrix norm, and current defense methods are focused on guarding against this type of attack. In this paper, we propose unrestricted…

机器学习 · 计算机科学 2018-12-04 Yang Song , Rui Shu , Nate Kushman , Stefano Ermon

Adversarial example generation has been a hot spot in recent years because it can cause deep neural networks (DNNs) to misclassify the generated adversarial examples, which reveals the vulnerability of DNNs, motivating us to find good…

密码学与安全 · 计算机科学 2023-03-06 Mingjie Li , Hanzhou Wu , Xinpeng Zhang

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

计算与语言 · 计算机科学 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy