English
Related papers

Related papers: MGTEVAL: An Interactive Platform for Systemtic Eva…

200 papers

While machine-generated texts (MGTs) offer great convenience, they also pose risks such as disinformation and phishing, highlighting the need for reliable detection. Metric-based methods, which extract statistically distinguishable features…

Computation and Language · Computer Science 2026-02-10 Chenwang Wu , Yiu-ming Cheung , Shuhai Zhang , Bo Han , Defu Lian

We introduce MTG, a new benchmark suite for training and evaluating multilingual text generation. It is the first-proposed multilingual multiway text generation dataset with the largest human-annotated data (400k). It includes four…

Computation and Language · Computer Science 2022-06-13 Yiran Chen , Zhenqiao Song , Xianze Wu , Danqing Wang , Jingjing Xu , Jiaze Chen , Hao Zhou , Lei Li

Given Wikipedia's role as a trusted source of high-quality, reliable content, concerns are growing about the proliferation of low-quality machine-generated text (MGT) produced by large language models (LLMs) on its platform. Reliable…

Computation and Language · Computer Science 2025-07-08 Gerrit Quaremba , Elizabeth Black , Denny Vrandečić , Elena Simperl

Widely applied large language models (LLMs) can generate human-like content, raising concerns about the abuse of LLMs. Therefore, it is important to build strong AI-generated text (AIGT) detectors. Current works only consider document-level…

Computation and Language · Computer Science 2023-12-18 Pengyu Wang , Linyang Li , Ke Ren , Botian Jiang , Dong Zhang , Xipeng Qiu

Machine translation (MT) of user-generated content (UGC) poses unique challenges, including handling slang, emotion, and literary devices like irony and sarcasm. Evaluating the quality of these translations is challenging as current metrics…

Computation and Language · Computer Science 2024-10-07 Shenbin Qian , Constantin Orăsan , Diptesh Kanojia , Félix do Carmo

The widespread use of large language models (LLMs) is increasing the demand for methods that detect machine-generated text to prevent misuse. The goal of our study is to stress test the detectors' robustness to malicious attacks under…

Computation and Language · Computer Science 2024-02-20 Yichen Wang , Shangbin Feng , Abe Bohan Hou , Xiao Pu , Chao Shen , Xiaoming Liu , Yulia Tsvetkov , Tianxing He

This article gives an overview of the field of LLM text recognition. Different approaches and implemented detectors for the recognition of LLM-generated text are presented. In addition to discussing the implementations, the article focuses…

Computation and Language · Computer Science 2024-06-18 Thorsten Pröhl , Erik Putzier , Rüdiger Zarnekow

The recent proliferation of AI-generated content has prompted significant interest in developing reliable detection methods. This study explores techniques for identifying AI-generated text through sentence-level evaluation within hybrid…

Computation and Language · Computer Science 2024-12-30 Dima Galat

The impressive ability of large language models to generate natural text across various tasks has led to critical challenges in authorship authentication. Although numerous detection methods have been developed to differentiate between…

Computation and Language · Computer Science 2025-05-20 Xu Zheng , Zhuomin Chen , Esteban Schafir , Sipeng Chen , Hojat Allah Salehi , Haifeng Chen , Farhad Shirani , Wei Cheng , Dongsheng Luo

The rise of large language models (LLMs) has created an urgent need to distinguish between human-written and LLM-generated text to ensure authenticity and societal trust. Existing detectors typically provide a binary classification for an…

Computation and Language · Computer Science 2026-05-06 Mengchu Li , Jin Zhu , Jinglai Li , Chengchun Shi

Nowadays, the usage of Large Language Models (LLMs) has increased, and LLMs have been used to generate texts in different languages and for different tasks. Additionally, due to the participation of remarkable companies such as Google and…

Computation and Language · Computer Science 2024-02-26 Mohammad Heydari Rad , Farhan Farsi , Shayan Bali , Romina Etezadi , Mehrnoush Shamsfard

The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods…

Computation and Language · Computer Science 2025-08-27 Angela Yifei Yuan , Haoyi Li , Soyeon Caren Han , Christopher Leckie

The effective detection and governance of Large Language Model (LLM) generated content has become increasingly critical due to the growing risk of misuse. Despite the impressive performance of existing detectors, their reliability and…

Computation and Language · Computer Science 2026-05-20 Junchao Wu , Yefeng Liu , Chenyu Zhu , Hao Zhang , Zeyu Wu , Tianqi Shi , Yichao Du , Longyue Wang , Weihua Luo , Jinsong Su , Derek F. Wong

Large language models (LLMs) such as ChatGPT have exhibited remarkable performance in generating human-like texts. However, machine-generated texts (MGTs) may carry critical risks, such as plagiarism issues, misleading information, or…

Computation and Language · Computer Science 2024-03-01 Shuhai Zhang , Yiliao Song , Jiahao Yang , Yuanqing Li , Bo Han , Mingkui Tan

An ideal detection system for machine generated content is supposed to work well on any generator as many more advanced LLMs come into existence day by day. Existing systems often struggle with accurately identifying AI-generated content…

SemEval-2024 Task 8 provides a challenge to detect human-written and machine-generated text. There are 3 subtasks for different detection scenarios. This paper proposes a system that mainly deals with Subtask B. It aims to detect if given…

Computation and Language · Computer Science 2024-04-02 Renhua Gu , Xiangfeng Meng

The rapid improvement of language models has raised the specter of abuse of text generation systems. This progress motivates the development of simple methods for detecting generated text that can be used by and explained to non-experts. We…

Computation and Language · Computer Science 2019-06-11 Sebastian Gehrmann , Hendrik Strobelt , Alexander M. Rush

The rapid development of autoregressive Large Language Models (LLMs) has significantly improved the quality of generated texts, necessitating reliable machine-generated text detectors. A huge number of detectors and collections with AI…

Computation and Language · Computer Science 2025-03-10 German Gritsai , Anastasia Voznyuk , Andrey Grabovoy , Yury Chekhovich

The ability of large language models to generate complex texts allows them to be widely integrated into many aspects of life, and their output can quickly fill all network resources. As the impact of LLMs grows, it becomes increasingly…

Computation and Language · Computer Science 2024-11-12 Yongye Su , Yuqing Wu

The proliferation of high-quality text from Large Language Models (LLMs) demands reliable and efficient detection methods. While existing training-free approaches show promise, they often rely on surface-level statistics and overlook…

Computation and Language · Computer Science 2026-01-13 Haitong Luo , Weiyao Zhang , Suhang Wang , Wenji Zou , Chungang Lin , Xuying Meng , Yujun Zhang