English
Related papers

Related papers: Attacking Neural Text Detectors

200 papers

Current large language models (LLM) provide a strong foundation for large-scale user-oriented natural language tasks. Many users can easily inject adversarial text or instructions through the user interface, thus causing LLM model security…

Computation and Language · Computer Science 2024-11-14 Chong Zhang , Mingyu Jin , Dong Shu , Taowen Wang , Dongfang Liu , Xiaobo Jin

We introduce a simple yet efficient sentence-level attack on black-box toxicity detector models. By adding several positive words or sentences to the end of a hateful message, we are able to change the prediction of a neural network and…

Computation and Language · Computer Science 2023-10-23 Sergey Berezin , Reza Farahbakhsh , Noel Crespi

Attacks on deep learning models are often difficult to identify and therefore are difficult to protect against. This problem is exacerbated by the use of public datasets that typically are not manually inspected before use. In this paper,…

Computation and Language · Computer Science 2022-02-14 Abigail Swenor , Jugal Kalita

Adversarial attacks expose vulnerabilities of deep learning models by introducing minor perturbations to the input, which lead to substantial alterations in the output. Our research focuses on the impact of such adversarial attacks on…

Computation and Language · Computer Science 2023-09-14 Pavel Burnyshev , Elizaveta Kostenok , Alexey Zaytsev

Natural Language Processing (NLP) models are used for text-related tasks such as classification and generation. To complete these tasks, input data is first tokenized from human-readable text into a format the model can understand, enabling…

Machine Learning · Computer Science 2025-06-10 Kasimir Schulz , Kenneth Yeung , Kieran Evans

Adversarial attacks are a major challenge faced by current machine learning research. These purposely crafted inputs fool even the most advanced models, precluding their deployment in safety-critical applications. Extensive research in…

Artificial Intelligence · Computer Science 2023-06-30 Edoardo Mosca , Shreyash Agarwal , Javier Rando , Georg Groh

Current adversarial attack algorithms, where an adversary changes a text to fool a victim model, have been repeatedly shown to be effective against text classifiers. These attacks, however, generally assume that the victim model is…

Computation and Language · Computer Science 2024-01-17 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Visually similar characters, or homoglyphs, can be used to perform social engineering attacks or to evade spam and plagiarism detectors. It is thus important to understand the capabilities of an attacker to identify homoglyphs --…

Cryptography and Security · Computer Science 2020-12-23 Perry Deng , Cooper Linsky , Matthew Wright

High-quality paraphrases are easy to produce using instruction-tuned language models or specialized paraphrasing models. Although this capability has a variety of benign applications, paraphrasing attacks$\unicode{x2013}$paraphrases applied…

Computation and Language · Computer Science 2025-03-21 Rafael Rivera Soto , Barry Chen , Nicholas Andrews

Text-based machine learning models are vulnerable to an emerging class of Unicode-based adversarial examples capable of tricking a model into misreading text with potentially disastrous effects. The primary existing defense against these…

Cryptography and Security · Computer Science 2025-10-14 Nicholas Boucher , Jenny Blessing , Ilia Shumailov , Ross Anderson , Nicolas Papernot

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

Cryptography and Security · Computer Science 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

With the widespread use of deep learning system in many applications, the adversary has strong incentive to explore vulnerabilities of deep neural networks and manipulate them. Backdoor attacks against deep neural networks have been…

Cryptography and Security · Computer Science 2019-06-05 Jiazhu Dai , Chuanshuai Chen

Adversarial attacks have become a major threat for machine learning applications. There is a growing interest in studying these attacks in the audio domain, e.g, speech and speaker recognition; and find defenses against them. In this work,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-12 Jesús Villalba , Sonal Joshi , Piotr Żelasko , Najim Dehak

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

Computation and Language · Computer Science 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

Large Language Models (LLMs) have achieved significantly advanced capabilities in understanding and generating human language text, which have gained increasing popularity over recent years. Apart from their state-of-the-art natural…

Cryptography and Security · Computer Science 2025-02-11 Yihe Zhou , Tao Ni , Wei-Bin Lee , Qingchuan Zhao

Textual backdoor attacks present a substantial security risk to Large Language Models (LLM). It embeds carefully chosen triggers into a victim model at the training stage, and makes the model erroneously predict inputs containing the same…

Computation and Language · Computer Science 2024-07-08 Xinglin Li , Xianwen He , Yao Li , Minhao Cheng

It has been proved that deep neural networks are facing a new threat called backdoor attacks, where the adversary can inject backdoors into the neural network model through poisoning the training dataset. When the input containing some…

Cryptography and Security · Computer Science 2021-03-16 Chuanshuai Chen , Jiazhu Dai

Front-line police officers often categorize all police call reported cases of Telecom Fraud into 14 subcategories to facilitate targeted prevention measures, such as precise public education. However, the associated data is characterized by…

Artificial Intelligence · Computer Science 2024-11-12 Liu Zhuoxian , Shi Tuo , Hu Xiaofeng

Textual adversarial examples pose serious threats to the reliability of natural language processing systems. Recent studies suggest that adversarial examples tend to deviate from the underlying manifold of normal texts, whereas pre-trained…

Computation and Language · Computer Science 2025-04-15 Xiaomei Zhang , Zhaoxi Zhang , Yanjun Zhang , Xufei Zheng , Leo Yu Zhang , Shengshan Hu , Shirui Pan