English
Related papers

Related papers: Attacking Neural Text Detectors

200 papers

The landscape of adversarial attacks against text classifiers continues to grow, with new attacks developed every year and many of them available in standard toolkits, such as TextAttack and OpenAttack. In response, there is a growing body…

Computation and Language · Computer Science 2022-01-24 Zhouhang Xie , Jonathan Brophy , Adam Noack , Wencong You , Kalyani Asthana , Carter Perkins , Sabrina Reis , Sameer Singh , Daniel Lowd

As machine learning (ML) systems are being increasingly employed in the real world to handle sensitive tasks and make decisions in various fields, the security and privacy of those models have also become increasingly critical. In…

Cryptography and Security · Computer Science 2023-02-21 Marwan Omar

Existing methods for the zero-shot detection of machine-generated text are dominated by three statistical quantities: log-likelihood, log-rank, and entropy. As language models mimic the distribution of human text ever closer, this will…

Computation and Language · Computer Science 2025-03-27 Tom Kempton , Stuart Burrell , Connor Cheverall

Recent advancements in neural language modelling make it possible to rapidly generate vast amounts of human-sounding text. The capabilities of humans and automatic discriminators to detect machine-generated text have been a large source of…

Computation and Language · Computer Science 2020-05-11 Daphne Ippolito , Daniel Duckworth , Chris Callison-Burch , Douglas Eck

Adversarial attacks and backdoor attacks are two common security threats that hang over deep learning. Both of them harness task-irrelevant features of data in their implementation. Text style is a feature that is naturally irrelevant to…

Computation and Language · Computer Science 2021-10-15 Fanchao Qi , Yangyi Chen , Xurui Zhang , Mukai Li , Zhiyuan Liu , Maosong Sun

Despite outstanding performance in a variety of NLP tasks, recent studies have revealed that NLP models are vulnerable to adversarial attacks that slightly perturb the input to cause the models to misbehave. Among these attacks, adversarial…

Computation and Language · Computer Science 2024-06-11 Duy C. Hoang , Quang H. Nguyen , Saurav Manchanda , MinLong Peng , Kok-Seng Wong , Khoa D. Doan

Neural text generation models conditioning on given input (e.g. machine translation and image captioning) are usually trained by maximum likelihood estimation of target text. However, the trained models suffer from various types of errors…

Computation and Language · Computer Science 2020-12-29 Keisuke Shirai , Kazuma Hashimoto , Akiko Eriguchi , Takashi Ninomiya , Shinsuke Mori

In the rapidly evolving domain of artificial intelligence, safeguarding the intellectual property of Large Language Models (LLMs) is increasingly crucial. Current watermarking techniques against model extraction attacks, which rely on…

Cryptography and Security · Computer Science 2024-05-03 Minhao Bai , Kaiyi Pang , Yongfeng Huang

The proliferation of large language models has raised growing concerns about their misuse, particularly in cases where AI-generated text is falsely attributed to human authors. Machine-generated content detectors claim to effectively…

Computation and Language · Computer Science 2025-02-11 Brian Tufts , Xuandong Zhao , Lei Li

Natural language correction has the potential to help language learners improve their writing skills. While approaches with separate classifiers for different error types have high precision, they do not flexibly handle errors such as…

Computation and Language · Computer Science 2016-04-01 Ziang Xie , Anand Avati , Naveen Arivazhagan , Dan Jurafsky , Andrew Y. Ng

High-quality text generation capability of recent Large Language Models (LLMs) causes concerns about their misuse (e.g., in massive generation/spread of disinformation). Machine-generated text (MGT) detection is important to cope with such…

Modifying characters of a piece of text to their visual similar ones often ap-pear in spam in order to fool inspection systems and other conditions, which we regard as a kind of adversarial attack to neural models. We pro-pose a way of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Shengjun Liu , Ningkang Jiang , Yuanbin Wu

Neural text ranking models have witnessed significant advancement and are increasingly being deployed in practice. Unfortunately, they also inherit adversarial vulnerabilities of general neural models, which have been detected but remain…

Information Retrieval · Computer Science 2023-04-19 Jiawei Liu , Yangyang Kang , Di Tang , Kaisong Song , Changlong Sun , Xiaofeng Wang , Wei Lu , Xiaozhong Liu

To combat the potential misuse of Natural Language Generation (NLG) technology, a variety of algorithms have been developed for the detection of AI-generated texts. Traditionally, this task is treated as a binary classification problem.…

Computation and Language · Computer Science 2023-12-22 Yi-Fan Zhang , Zhang Zhang , Liang Wang , Tieniu Tan , Rong Jin

The recent large-scale emergence of LLMs has left an open space for dealing with their consequences, such as plagiarism or the spread of false information on the Internet. Coupling this with the rise of AI detector bypassing tools, reliable…

Machine Learning · Computer Science 2026-05-15 Andrii Shportko , Inessa Verbitsky

Typographic attacks, adding misleading text to images, can deceive vision-language models (LVLMs). The susceptibility of recent large LVLMs like GPT4-V to such attacks is understudied, raising concerns about amplified misinformation in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Maan Qraitem , Nazia Tasnim , Piotr Teterwak , Kate Saenko , Bryan A. Plummer

In social media, neural network models have been applied to hate speech detection, sentiment analysis, etc., but neural network models are susceptible to adversarial attacks. For instance, in a text classification task, the attacker…

Computation and Language · Computer Science 2024-12-04 Xi Cao , Nuo Qun , Quzong Gesang , Yulei Zhu , Trashi Nyima

Deep neural networks provide unprecedented performance in all image classification problems, taking advantage of huge amounts of data available for training. Recent studies, however, have shown their vulnerability to adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Diego Gragnaniello , Francesco Marra , Giovanni Poggi , Luisa Verdoliva

Large language models (LLMs) have achieved remarkable performance across diverse natural language processing tasks, yet their vulnerability to character-level adversarial manipulations presents significant security challenges for real-world…

Cryptography and Security · Computer Science 2025-11-27 Ephraiem Sarabamoun

The ubiquity of offensive and hateful content on online fora necessitates the need for automatic solutions that detect such content competently across target groups. In this paper we show that text classification models trained on large…

Computation and Language · Computer Science 2021-12-08 Darsh J Shah , Sinong Wang , Han Fang , Hao Ma , Luke Zettlemoyer