English
Related papers

Related papers: MGTBench: Benchmarking Machine-Generated Text Dete…

200 papers

The rapid advancement of Large Language Models (LLMs) has significantly enhanced the capabilities of text generators. With the potential for misuse escalating, the importance of discerning whether texts are human-authored or generated by…

Multimedia · Computer Science 2024-03-12 Travis Munyer , Abdullah Tanvir , Arjon Das , Xin Zhong

The misuse of large language models (LLMs) poses potential risks, motivating the development of machine-generated text (MGT) detection. Existing literature primarily concentrates on binary, document-level detection, thereby neglecting texts…

Computation and Language · Computer Science 2025-06-04 Zhixiong Su , Yichen Wang , Herun Wan , Zhaohan Zhang , Minnan Luo

SemEval-2024 Task 8 introduces the challenge of identifying machine-generated texts from diverse Large Language Models (LLMs) in various languages and domains. The task comprises three subtasks: binary classification in monolingual and…

Computation and Language · Computer Science 2024-01-24 Feng Xiong , Thanet Markchom , Ziwei Zheng , Subin Jung , Varun Ojha , Huizhi Liang

Large language models (LLMs), such as ChatGPT released by OpenAI, have attracted significant attention from both industry and academia due to their demonstrated ability to generate high-quality content for various tasks. Despite the…

Software Engineering · Computer Science 2024-11-08 Xiaodan Xu , Chao Ni , Xinrong Guo , Shaoxuan Liu , Xiaoya Wang , Kui Liu , Xiaohu Yang

We study the problem of determining whether a piece of text has been authored by a human or by a large language model (LLM). Existing state of the art logits-based detectors make use of statistics derived from the log-probability of the…

Computation and Language · Computer Science 2026-02-03 Hongyi Zhou , Jin Zhu , Pingfan Su , Kai Ye , Ying Yang , Shakeel A O B Gavioli-Akilagun , Chengchun Shi

Large Language Models (LLMs), characterized by being trained on broad amounts of data in a self-supervised manner, have shown impressive performance across a wide range of tasks. Indeed, their generative abilities have aroused interest on…

Machine Learning · Computer Science 2024-07-30 Jorge García-Carrasco , Alejandro Maté , Juan Trujillo

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

Computation and Language · Computer Science 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

ChatGPT is a conversational artificial intelligence that is a member of the generative pre-trained transformer of the large language model family. This text generative model was fine-tuned by both supervised learning and reinforcement…

Computation and Language · Computer Science 2023-06-06 Niful Islam , Debopom Sutradhar , Humaira Noor , Jarin Tasnim Raya , Monowara Tabassum Maisha , Dewan Md Farid

Large Language Models (LLMs) have excelled at language understanding and generating human-level text. However, even with supervised training and human alignment, these LLMs are susceptible to adversarial attacks where malicious users can…

Computation and Language · Computer Science 2024-08-08 Shachi H Kumar , Saurav Sahay , Sahisnu Mazumder , Eda Okur , Ramesh Manuvinakurike , Nicole Beckage , Hsuan Su , Hung-yi Lee , Lama Nachman

Large language models are increasingly used for many applications. To prevent illicit use, it is desirable to be able to detect AI-generated text. Training and evaluation of such detectors critically depend on suitable benchmark datasets.…

Machine Learning · Computer Science 2025-11-13 Philipp Dingfelder , Christian Riess

The rise of Large Language Models (LLMs) such as ChatGPT and Gemini has posed new challenges for the academic community. With the help of these models, students can easily complete their assignments and exams, while educators struggle to…

Computers and Society · Computer Science 2024-07-19 Shushanta Pudasaini , Luis Miralles-Pechuán , David Lillis , Marisa Llorens Salvador

Peer review is essential for maintaining academic quality, but the increasing volume of submissions places a significant burden on reviewers. Large language models (LLMs) offer potential assistance in this process, yet their susceptibility…

Computation and Language · Computer Science 2025-10-10 Tzu-Ling Lin , Wei-Chih Chen , Teng-Fang Hsiao , Hou-I Liu , Ya-Hsin Yeh , Yu Kai Chan , Wen-Sheng Lien , Po-Yen Kuo , Philip S. Yu , Hong-Han Shuai

To combat the misuse of Large Language Models (LLMs), many recent studies have presented LLM-generated-text detectors with promising performance. When users instruct LLMs to generate texts, the instruction can include different constraints…

Computation and Language · Computer Science 2024-10-02 Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

The dissemination of Large Language Models (LLMs), trained at scale, and endowed with powerful text-generating abilities, has made it easier for all to produce harmful, toxic, faked or forged content. In response, various proposals have…

Computation and Language · Computer Science 2025-06-12 Matthieu Dubois , François Yvon , Pablo Piantanida

Although Large Language Models (LLMs) are becoming increasingly powerful, they still exhibit significant but subtle weaknesses, such as mistakes in instruction-following or coding tasks. As these unexpected errors could lead to severe…

Computation and Language · Computer Science 2024-12-11 Jiale Cheng , Yida Lu , Xiaotao Gu , Pei Ke , Xiao Liu , Yuxiao Dong , Hongning Wang , Jie Tang , Minlie Huang

Large language models (LLMs) present significant risks when used to generate non-factual content and spread disinformation at scale. Detecting such LLM-generated content is crucial, yet current detectors often struggle to generalize in…

Computation and Language · Computer Science 2025-02-18 Ran Li , Wei Hao , Weiliang Zhao , Junfeng Yang , Chengzhi Mao

ChatGPT has the ability to generate grammatically flawless and seemingly-human replies to different types of questions from various domains. The number of its users and of its applications is growing at an unprecedented rate. Unfortunately,…

Computation and Language · Computer Science 2023-02-01 Sandra Mitrović , Davide Andreoletti , Omran Ayoub

The proliferation of Large Language Models (LLMs), such as ChatGPT, has raised concerns about their potential impact on academic integrity, prompting the need for LLM-resistant exam designs. This article investigates the performance of LLMs…

Computation and Language · Computer Science 2023-04-25 Simon kaare Larsen

This paper presents a novel approach for detecting ChatGPT-generated vs. human-written text using language models. To this end, we first collected and released a pre-processed dataset named OpenGPTText, which consists of rephrased content…

Computation and Language · Computer Science 2023-05-19 Yutian Chen , Hao Kang , Vivian Zhai , Liangze Li , Rita Singh , Bhiksha Raj

The widespread use of Large Language Models (LLMs), celebrated for their ability to generate human-like text, has raised concerns about misinformation and ethical implications. Addressing these concerns necessitates the development of…

Computation and Language · Computer Science 2024-03-28 Wissam Antoun , Benoît Sagot , Djamé Seddah