English
Related papers

Related papers: M4GT-Bench: Evaluation Benchmark for Black-Box Mac…

200 papers

Detecting Machine-Generated Text (MGT) has emerged as a significant area of study within Natural Language Processing. While language models generate text, they often leave discernible traces, which can be scrutinized using either…

Our research focuses on the crucial challenge of discerning text produced by Large Language Models (LLMs) from human-generated text, which holds significance for various applications. With ongoing discussions about attaining a model with…

Computation and Language · Computer Science 2023-11-28 Raghav Gaggar , Ashish Bhagchandani , Harsh Oza

Nowadays, the usage of Large Language Models (LLMs) has increased, and LLMs have been used to generate texts in different languages and for different tasks. Additionally, due to the participation of remarkable companies such as Google and…

Computation and Language · Computer Science 2024-02-26 Mohammad Heydari Rad , Farhan Farsi , Shayan Bali , Romina Etezadi , Mehrnoush Shamsfard

The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods…

Computation and Language · Computer Science 2025-08-27 Angela Yifei Yuan , Haoyi Li , Soyeon Caren Han , Christopher Leckie

Large language models (LLMs) such as GPT, Claude, Gemini, and Grok have been deeply integrated into our daily life. They now support a wide range of tasks -- from dialogue and email drafting to assisting with teaching and coding, serving as…

Computation and Language · Computer Science 2026-01-13 Hongyi Zhou , Jin Zhu , Ying Yang , Chengchun Shi

The burgeoning capabilities of advanced large language models (LLMs) such as ChatGPT have led to an increase in synthetic content generation with implications across a variety of sectors, including media, cybersecurity, public discourse,…

Computation and Language · Computer Science 2023-10-25 Xianjun Yang , Liangming Pan , Xuandong Zhao , Haifeng Chen , Linda Petzold , William Yang Wang , Wei Cheng

The growing capability of large language models to produce fluent, contextually coherent text has created mounting pressure on the systems and institutions responsible for ensuring the authenticity of digital content. Advanced generative…

In recent years, large neural networks for natural language generation (NLG) have made leaps and bounds in their ability to generate fluent text. However, the tasks of evaluating quality differences between NLG systems and understanding how…

Computation and Language · Computer Science 2020-10-08 Liam Dugan , Daphne Ippolito , Arun Kirubarajan , Chris Callison-Burch

We introduce MTG, a new benchmark suite for training and evaluating multilingual text generation. It is the first-proposed multilingual multiway text generation dataset with the largest human-annotated data (400k). It includes four…

Computation and Language · Computer Science 2022-06-13 Yiran Chen , Zhenqiao Song , Xianze Wu , Danqing Wang , Jingjing Xu , Jiaze Chen , Hao Zhou , Lei Li

Large Language Models (LLMs) hold significant potential for advancing fact-checking by leveraging their capabilities in reasoning, evidence retrieval, and explanation generation. However, existing benchmarks fail to comprehensively evaluate…

Computation and Language · Computer Science 2025-06-17 Shuo Yang , Yuqin Dai , Guoqing Wang , Xinran Zheng , Jinfeng Xu , Jinze Li , Zhenzhe Ying , Weiqiang Wang , Edith C. H. Ngai

Detecting text generated by large language models (LLMs) is of great recent interest. With zero-shot methods like DetectGPT, detection capabilities have reached impressive levels. However, the reliability of existing detectors in real-world…

Computation and Language · Computer Science 2025-03-13 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xinyi Yang , Yulin Yuan , Lidia S. Chao

With ChatGPT under the spotlight, utilizing large language models (LLMs) to assist academic writing has drawn a significant amount of debate in the community. In this paper, we aim to present a comprehensive study of the detectability of…

Computation and Language · Computer Science 2024-03-19 Zeyan Liu , Zijun Yao , Fengjun Li , Bo Luo

The misuse of large language models (LLMs) poses potential risks, motivating the development of machine-generated text (MGT) detection. Existing literature primarily concentrates on binary, document-level detection, thereby neglecting texts…

Computation and Language · Computer Science 2025-06-04 Zhixiong Su , Yichen Wang , Herun Wan , Zhaohan Zhang , Minnan Luo

Since the release of ChatGPT, the field of Natural Language Processing has experienced rapid advancements, particularly in Large Language Models (LLMs) and their multimodal counterparts, Large Multimodal Models (LMMs). Despite their…

Computation and Language · Computer Science 2024-08-27 Florian Schneider , Sunayana Sitaram

An ideal detection system for machine generated content is supposed to work well on any generator as many more advanced LLMs come into existence day by day. Existing systems often struggle with accurately identifying AI-generated content…

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov

Large Language Models (LLMs) have demonstrated remarkable capabilities in generating text that closely resembles human writing across a wide range of styles and genres. However, such capabilities are prone to potential misuse, such as fake…

Computation and Language · Computer Science 2025-05-20 Harika Abburi , Sanmitra Bhattacharya , Edward Bowen , Nirmala Pudota

Since language models produce fake text quickly and easily, there is an oversupply of such content in the public domain. The degree of sophistication and writing style has reached a point where differentiating between human authored and…

Computation and Language · Computer Science 2024-02-06 Dmytro Valiaiev

The rapid development of large language models (LLMs), like ChatGPT, has resulted in the widespread presence of LLM-generated content on social media platforms, raising concerns about misinformation, data biases, and privacy violations,…

Computation and Language · Computer Science 2025-02-07 Zihao Cheng , Li Zhou , Feng Jiang , Benyou Wang , Haizhou Li

Existing machine-generated text (MGT) detection methods implicitly assume labels as the "golden standard". However, we reveal boundary ambiguity in MGT detection, implying that traditional training paradigms are inexact. Moreover,…

Computation and Language · Computer Science 2025-11-04 Chenwang Wu , Yiu-ming Cheung , Bo Han , Defu Lian