English
Related papers

Related papers: How Sampling Affects the Detectability of Machine-…

200 papers

The rapid advancement of large language models (LLMs) such as ChatGPT, DeepSeek, and Claude has significantly increased the presence of AI-generated text in digital communication. This trend has heightened the need for reliable detection…

Computation and Language · Computer Science 2025-10-13 Cong Zeng , Shengkun Tang , Yuanzhou Chen , Zhiqiang Shen , Wenchao Yu , Xujiang Zhao , Haifeng Chen , Wei Cheng , Zhiqiang Xu

The increasing capability of large language models (LLMs) to generate fluent long-form texts is presenting new challenges in distinguishing machine-generated outputs from human-written ones, which is crucial for ensuring authenticity and…

Computation and Language · Computer Science 2024-10-08 Yufei Tian , Zeyu Pan , Nanyun Peng

Large Language Models (LLMs) have revolutionized text generation, making detecting machine-generated text increasingly challenging. Although past methods have achieved good performance on detecting pure machine-generated text, those…

Computation and Language · Computer Science 2024-12-24 Jiaqi Chen , Xiaoye Zhu , Tianyang Liu , Ying Chen , Xinhui Chen , Yiwen Yuan , Chak Tou Leong , Zuchao Li , Tang Long , Lei Zhang , Chenyu Yan , Guanghao Mei , Jie Zhang , Lefei Zhang

We consider the problem of distinguishing human-written creative fiction (excerpts from novels) from similar text generated by an LLM. Our results show that, while human observers perform poorly (near chance levels) on this binary…

Computation and Language · Computer Science 2026-01-13 Minerva Suvanto , Andrea McGlinchey , Mattias Wahde , Peter J Barclay

The widespread adoption of large language models (LLMs) makes it important to recognize their strengths and limitations. We argue that in order to develop a holistic understanding of these systems we need to consider the problem that they…

Computation and Language · Computer Science 2023-09-26 R. Thomas McCoy , Shunyu Yao , Dan Friedman , Matthew Hardy , Thomas L. Griffiths

Since the proliferation of LLMs, there have been concerns about their misuse for harmful content creation and spreading. Recent studies justify such fears, providing evidence of LLM vulnerabilities and high potential of their misuse. Humans…

Computation and Language · Computer Science 2025-03-20 Dominik Macko , Robert Moro , Ivan Srba

Human and model-generated texts can be distinguished by examining the magnitude of likelihood in language. However, it is becoming increasingly difficult as language model's capabilities of generating human-like texts keep evolving. This…

Computation and Language · Computer Science 2024-10-10 Yang Xu , Yu Wang , Hao An , Zhichen Liu , Yongyuan Li

Potential harms of Large Language Models such as mass misinformation and plagiarism can be partially mitigated if there exists a reliable way to detect machine generated text. In this paper, we propose a new watermarking method to detect…

Computation and Language · Computer Science 2023-12-12 Kaan Efe Keleş , Ömer Kaan Gürbüz , Mucahid Kutlu

The efficacy of detectors for texts generated by large language models (LLMs) substantially depends on the availability of large-scale training data. However, white-box zero-shot detectors, which require no such data, are limited by the…

Computation and Language · Computer Science 2025-03-04 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xuebo Liu , Lidia S. Chao , Min Zhang

This work analyses the text memorization behavior of large language models (LLMs) when subjected to nucleus sampling. Stochastic decoding methods like nucleus sampling are typically applied to overcome issues such as monotonous and…

Computation and Language · Computer Science 2024-08-30 Luka Borec , Philipp Sadler , David Schlangen

The emergence of large language models (LLMs) has resulted in the production of LLM-generated texts that is highly sophisticated and almost indistinguishable from texts written by humans. However, this has also sparked concerns about the…

Computation and Language · Computer Science 2023-06-06 Ruixiang Tang , Yu-Neng Chuang , Xia Hu

The power of natural language generation models has provoked a flurry of interest in automatic methods to detect if a piece of text is human or machine-authored. The problem so far has been framed in a standard supervised way and consists…

Computation and Language · Computer Science 2021-11-05 Matthias Gallé , Jos Rozen , Germán Kruszewski , Hady Elsahar

Large language models (LM) generate remarkably fluent text and can be efficiently adapted across NLP tasks. Measuring and guaranteeing the quality of generated text in terms of safety is imperative for deploying LMs in the real world; to…

With their advanced capabilities, Large Language Models (LLMs) can generate highly convincing and contextually relevant fake news, which can contribute to disseminating misinformation. Though there is much research on fake news detection…

Computation and Language · Computer Science 2026-02-05 Rupak Kumar Das , Jonathan Dodge

General large language models (LLMs) such as ChatGPT have shown remarkable success, but it has also raised concerns among people about the misuse of AI-generated texts. Therefore, an important question is how to detect whether the texts are…

Computation and Language · Computer Science 2023-10-24 Rongsheng Wang , Qi Li , Sihong Xie

With the increasing integration of large language models (LLMs) into open-domain writing, detecting machine-generated text has become a critical task for ensuring content authenticity and trust. Existing approaches rely on statistical…

Computation and Language · Computer Science 2025-10-15 Siyuan Li , Aodu Wulianghai , Xi Lin , Guangyan Li , Xiang Chen , Jun Wu , Jianhua Li

The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under…

Computation and Language · Computer Science 2024-02-20 Yichen Wang , Shangbin Feng , Abe Bohan Hou , Xiao Pu , Chao Shen , Xiaoming Liu , Yulia Tsvetkov , Tianxing He

Machine-generated text (MGT) detection requires identifying structurally invariant signals across generation models, rather than relying on model-specific fingerprints. In this respect, we hypothesize that while large language models excel…

Computation and Language · Computer Science 2026-04-29 Lucio La Cava , Andrea Tagarelli

As large language models (LLMs) generate text that increasingly resembles human writing, the subtle cues that distinguish AI-generated content from human-written content become increasingly challenging to capture. Reliance on…

Computation and Language · Computer Science 2026-04-16 Xiao Pu , Zepeng Cheng , Lin Yuan , Yu Wu , Xiuli Bi

Machine-generated texts (MGTs) produced by large language models (LLMs) are increasingly prevalent across various applications, while their potential misuse in fake news propagation and phishing has raised serious concerns, highlighting the…

Computation and Language · Computer Science 2026-05-25 Chenwang Wu , Yiu-ming Cheung , Bo Han , Defu Lian