English
Related papers

Related papers: Efficient Black-Box Adversarial Attacks on Neural …

200 papers

With the rise of generative pre-trained transformer models such as GPT-3, GPT-NeoX, or OPT, distinguishing human-generated texts from machine-generated ones has become important. We refined five separate language models to generate…

Computation and Language · Computer Science 2023-10-27 Sinclair Schneider , Florian Steuber , Joao A. G. Schneider , Gabi Dreo Rodosek

With the recent proliferation of Large Language Models (LLMs), there has been an increasing demand for tools to detect machine-generated text. The effective detection of machine-generated text face two pertinent problems: First, they are…

Computation and Language · Computer Science 2024-04-04 Mazal Bethany , Brandon Wherry , Emet Bethany , Nishant Vishwamitra , Anthony Rios , Peyman Najafirad

It is known that neural networks are subject to attacks through adversarial perturbations, i.e., inputs which are maliciously crafted through perturbations to induce wrong predictions. Furthermore, such attacks are impossible to eliminate,…

Computation and Language · Computer Science 2022-01-10 Guoliang Dong , Jingyi Wang , Jun Sun , Sudipta Chattopadhyay , Xinyu Wang , Ting Dai , Jie Shi , Jin Song Dong

Neural text generation models conditioning on given input (e.g. machine translation and image captioning) are usually trained by maximum likelihood estimation of target text. However, the trained models suffer from various types of errors…

Computation and Language · Computer Science 2020-12-29 Keisuke Shirai , Kazuma Hashimoto , Akiko Eriguchi , Takashi Ninomiya , Shinsuke Mori

Evaluating on adversarial examples has become a standard procedure to measure robustness of deep learning models. Due to the difficulty of creating white-box adversarial examples for discrete text input, most analyses of the robustness of…

Computation and Language · Computer Science 2018-06-26 Javid Ebrahimi , Daniel Lowd , Dejing Dou

We propose a novel genetic-algorithm technique that generates black-box adversarial examples which successfully fool neural network based text classifiers. We perform a genetic search with multi-objective optimization guided by deep…

Artificial Intelligence · Computer Science 2020-11-11 Alex Mathai , Shreya Khare , Srikanth Tamilselvam , Senthil Mani

The rapid improvement of language models has raised the specter of abuse of text generation systems. This progress motivates the development of simple methods for detecting generated text that can be used by and explained to non-experts. We…

Computation and Language · Computer Science 2019-06-11 Sebastian Gehrmann , Hendrik Strobelt , Alexander M. Rush

Modifying characters of a piece of text to their visual similar ones often ap-pear in spam in order to fool inspection systems and other conditions, which we regard as a kind of adversarial attack to neural models. We pro-pose a way of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Shengjun Liu , Ningkang Jiang , Yuanbin Wu

Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural…

Computation and Language · Computer Science 2017-11-28 Ziang Xie

The widespread adoption of ChatGPT has raised concerns about its misuse, highlighting the need for robust detection of AI-generated text. Current word-level detectors are vulnerable to paraphrasing or simple prompts (PSP), suffer from…

Computation and Language · Computer Science 2025-09-24 Mo Mu , Dianqiao Lei , Chang Li

Research shows that natural language processing models are generally considered to be vulnerable to adversarial attacks; but recent work has drawn attention to the issue of validating these adversarial inputs against certain criteria (e.g.,…

Computation and Language · Computer Science 2021-09-10 Maximilian Mozes , Max Bartolo , Pontus Stenetorp , Bennett Kleinberg , Lewis D. Griffin

Machine learning algorithms are often vulnerable to adversarial examples that have imperceptible alterations from the original counterparts but can fool the state-of-the-art models. It is helpful to evaluate or even improve the robustness…

Computation and Language · Computer Science 2020-04-10 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

The advent of instruction-tuned language models that convincingly mimic human writing poses a significant risk of abuse. However, such abuse may be counteracted with the ability to detect whether a piece of text was composed by a language…

Computation and Language · Computer Science 2024-05-09 Rafael Rivera Soto , Kailin Koch , Aleem Khan , Barry Chen , Marcus Bishop , Nicholas Andrews

Due to advances in Large Language Models (LLMs) such as ChatGPT, the boundary between human-written text and AI-generated text has become blurred. Nevertheless, recent work has demonstrated that it is possible to reliably detect…

Computation and Language · Computer Science 2025-06-17 Natesh Reddy , Mark Stamp

As text generated by large language models proliferates, it becomes vital to understand how humans engage with such text, and whether or not they are able to detect when the text they are reading did not originate with a human writer. Prior…

Computation and Language · Computer Science 2022-12-27 Liam Dugan , Daphne Ippolito , Arun Kirubarajan , Sherry Shi , Chris Callison-Burch

The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under…

Computation and Language · Computer Science 2024-02-20 Yichen Wang , Shangbin Feng , Abe Bohan Hou , Xiao Pu , Chao Shen , Xiaoming Liu , Yulia Tsvetkov , Tianxing He

The rampant proliferation of large language models, fluent enough to generate text indistinguishable from human-written language, gives unprecedented importance to the detection of machine-generated text. This work is motivated by an…

Computation and Language · Computer Science 2023-10-10 Xiao Pu , Jingyu Zhang , Xiaochuang Han , Yulia Tsvetkov , Tianxing He

Large language models (LLMs) have notably enhanced the fluency and diversity of machine-generated text. However, this progress also presents a significant challenge in detecting the origin of a given text, and current research on detection…

Computation and Language · Computer Science 2023-10-05 Xianjun Yang , Wei Cheng , Yue Wu , Linda Petzold , William Yang Wang , Haifeng Chen

Large language models (LLMs) such as GPT, Claude, Gemini, and Grok have been deeply integrated into our daily life. They now support a wide range of tasks -- from dialogue and email drafting to assisting with teaching and coding, serving as…

Computation and Language · Computer Science 2026-01-13 Hongyi Zhou , Jin Zhu , Ying Yang , Chengchun Shi

Explainable AI is a strong strategy implemented to understand complex black-box model predictions in a human interpretable language. It provides the evidence required to execute the use of trustworthy and reliable AI systems. On the other…

Computation and Language · Computer Science 2025-03-12 Esther Chiramal , Kelvin Soh Boon Kai