English
Related papers

Related papers: Smaller Language Models are Better Black-box Machi…

200 papers

With the rise of generative language models, machine-generated text detection has become a critical challenge. A wide variety of models is available, but inconsistent datasets, evaluation metrics, and assessment strategies obscure…

Computation and Language · Computer Science 2026-04-23 Kevin Stowe , Kailash Patil

Large Language Models (LLMs) are gearing up to surpass human creativity. The veracity of the statement needs careful consideration. In recent developments, critical questions arise regarding the authenticity of human work and the…

Computation and Language · Computer Science 2025-09-29 Sai Teja Lekkala , Yadagiri Annepaka , Arun Kumar Challa , Samatha Reddy Machireddy , Partha Pakray , Chukhu Chunka

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

Computation and Language · Computer Science 2023-08-21 Amrita Bhattacharjee , Huan Liu

The growing capability of large language models to produce fluent, contextually coherent text has created mounting pressure on the systems and institutions responsible for ensuring the authenticity of digital content. Advanced generative…

The advent of instruction-tuned language models that convincingly mimic human writing poses a significant risk of abuse. However, such abuse may be counteracted with the ability to detect whether a piece of text was composed by a language…

Computation and Language · Computer Science 2024-05-09 Rafael Rivera Soto , Kailin Koch , Aleem Khan , Barry Chen , Marcus Bishop , Nicholas Andrews

Machine-Generated Text (MGT) detection aims to identify a piece of text as machine or human written. Prior work has primarily formulated MGT detection as a binary classification task over an entire document, with limited work exploring…

Computation and Language · Computer Science 2024-06-12 Zhongping Zhang , Wenda Qin , Bryan A. Plummer

The increasing capability of large language models (LLMs) to generate fluent long-form texts is presenting new challenges in distinguishing machine-generated outputs from human-written ones, which is crucial for ensuring authenticity and…

Computation and Language · Computer Science 2024-10-08 Yufei Tian , Zeyu Pan , Nanyun Peng

Machine-Generated Text (MGT) is becoming increasingly difficult to distinguish from Human-Written Text (HWT). This trend has exacerbated malicious activities such as fake news and online fraud. The generalization ability of fine-tuned…

Computation and Language · Computer Science 2026-05-29 Anyang Song , Ying Cheng , Yiqian Xu , Rui Feng

With the widespread use of large language models (LLMs), many researchers have turned their attention to detecting text generated by them. However, there is no consistent or precise definition of their target, namely "LLM-generated text".…

Computation and Language · Computer Science 2025-10-24 Mingmeng Geng , Thierry Poibeau

With the recent proliferation of Large Language Models (LLMs), there has been an increasing demand for tools to detect machine-generated text. The effective detection of machine-generated text face two pertinent problems: First, they are…

Computation and Language · Computer Science 2024-04-04 Mazal Bethany , Brandon Wherry , Emet Bethany , Nishant Vishwamitra , Anthony Rios , Peyman Najafirad

The proliferation of large language models has raised growing concerns about their misuse, particularly in cases where AI-generated text is falsely attributed to human authors. Machine-generated content detectors claim to effectively…

Computation and Language · Computer Science 2025-02-11 Brian Tufts , Xuandong Zhao , Lei Li

The efficacy of detectors for texts generated by large language models (LLMs) substantially depends on the availability of large-scale training data. However, white-box zero-shot detectors, which require no such data, are limited by the…

Computation and Language · Computer Science 2025-03-04 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xuebo Liu , Lidia S. Chao , Min Zhang

ChatGPT is one of the most popular language models which achieve amazing performance on various natural language tasks. Consequently, there is also an urgent need to detect the texts generated ChatGPT from human written. One of the…

Computation and Language · Computer Science 2023-10-04 Han Xu , Jie Ren , Pengfei He , Shenglai Zeng , Yingqian Cui , Amy Liu , Hui Liu , Jiliang Tang

Machine-generated texts (MGTs) produced by large language models (LLMs) are increasingly prevalent across various applications, while their potential misuse in fake news propagation and phishing has raised serious concerns, highlighting the…

Computation and Language · Computer Science 2026-05-25 Chenwang Wu , Yiu-ming Cheung , Bo Han , Defu Lian

Existing methods for the zero-shot detection of machine-generated text are dominated by three statistical quantities: log-likelihood, log-rank, and entropy. As language models mimic the distribution of human text ever closer, this will…

Computation and Language · Computer Science 2025-03-27 Tom Kempton , Stuart Burrell , Connor Cheverall

Our research focuses on the crucial challenge of discerning text produced by Large Language Models (LLMs) from human-generated text, which holds significance for various applications. With ongoing discussions about attaining a model with…

Computation and Language · Computer Science 2023-11-28 Raghav Gaggar , Ashish Bhagchandani , Harsh Oza

Human and model-generated texts can be distinguished by examining the magnitude of likelihood in language. However, it is becoming increasingly difficult as language model's capabilities of generating human-like texts keep evolving. This…

Computation and Language · Computer Science 2024-10-10 Yang Xu , Yu Wang , Hao An , Zhichen Liu , Yongyuan Li

Detecting text generated by modern large language models is thought to be hard, as both LLMs and humans can exhibit a wide range of complex behaviors. However, we find that a score based on contrasting two closely related language models is…

Computation and Language · Computer Science 2024-10-15 Abhimanyu Hans , Avi Schwarzschild , Valeriia Cherepanova , Hamid Kazemi , Aniruddha Saha , Micah Goldblum , Jonas Geiping , Tom Goldstein

We introduce Ghostbuster, a state-of-the-art system for detecting AI-generated text. Our method works by passing documents through a series of weaker language models, running a structured search over possible combinations of their features,…

Computation and Language · Computer Science 2024-04-09 Vivek Verma , Eve Fleisig , Nicholas Tomlin , Dan Klein

$ $The usage of generative artificial intelligence (AI) tools based on large language models, including ChatGPT, Bard, and Claude, for text generation has many exciting applications with the potential for phenomenal productivity gains. One…

Computation and Language · Computer Science 2024-01-01 Antônio Junior Alves Caiado , Michael Hahsler