English
Related papers

Related papers: DetectRL: Benchmarking LLM-Generated Text Detectio…

200 papers

Recent advances in natural language processing (NLP) have led to the development of large language models (LLMs) such as ChatGPT. This paper proposes a methodology for developing and evaluating ChatGPT detectors for French text, with a…

Computation and Language · Computer Science 2023-06-12 Wissam Antoun , Virginie Mouilleron , Benoît Sagot , Djamé Seddah

Existing methods for the zero-shot detection of machine-generated text are dominated by three statistical quantities: log-likelihood, log-rank, and entropy. As language models mimic the distribution of human text ever closer, this will…

Computation and Language · Computer Science 2025-03-27 Tom Kempton , Stuart Burrell , Connor Cheverall

We present a novel evaluation paradigm for AI text detectors that prioritizes real-world and equitable assessment. Current approaches predominantly report conventional metrics like AUROC, overlooking that even modest false positive rates…

Computation and Language · Computer Science 2025-07-22 Navid Ayoobi , Sadat Shahriar , Arjun Mukherjee

The increasing availability of large language models (LLMs) has raised concerns about their potential misuse in online learning. While tools for detecting LLM-generated text exist and are widely used by researchers and educators, their…

Human-Computer Interaction · Computer Science 2025-06-23 Shambhavi Bhushan , Danielle R Thomas , Conrad Borchers , Isha Raghuvanshi , Ralph Abboud , Erin Gatz , Shivang Gupta , Kenneth Koedinger

With the launch of ChatGPT, large language models (LLMs) have attracted global attention. In the realm of article writing, LLMs have witnessed extensive utilization, giving rise to concerns related to intellectual property protection,…

Computation and Language · Computer Science 2024-06-14 Ying Zhou , Ben He , Le Sun

We study the problem of determining whether a piece of text has been authored by a human or by a large language model (LLM). Existing state of the art logits-based detectors make use of statistics derived from the log-probability of the…

Computation and Language · Computer Science 2026-02-03 Hongyi Zhou , Jin Zhu , Pingfan Su , Kai Ye , Ying Yang , Shakeel A O B Gavioli-Akilagun , Chengchun Shi

Large language models (LLMs) such as GPT, Claude, Gemini, and Grok have been deeply integrated into our daily life. They now support a wide range of tasks -- from dialogue and email drafting to assisting with teaching and coding, serving as…

Computation and Language · Computer Science 2026-01-13 Hongyi Zhou , Jin Zhu , Ying Yang , Chengchun Shi

Large language models (LLMs) have demonstrated remarkable capability to generate fluent responses to a wide variety of user queries. However, this has also raised concerns about the potential misuse of such texts in journalism, education,…

Detecting content generated by large language models (LLMs) is crucial for preventing misuse and building trustworthy AI systems. Although existing detection methods perform well, their robustness in out-of-distribution (OOD) scenarios is…

Computation and Language · Computer Science 2025-08-19 Xin Chen , Junchao Wu , Shu Yang , Runzhe Zhan , Zeyu Wu , Ziyang Luo , Di Wang , Min Yang , Lidia S. Chao , Derek F. Wong

The rapid development of large language models (LLMs), like ChatGPT, has resulted in the widespread presence of LLM-generated content on social media platforms, raising concerns about misinformation, data biases, and privacy violations,…

Computation and Language · Computer Science 2025-02-07 Zihao Cheng , Li Zhou , Feng Jiang , Benyou Wang , Haizhou Li

Detecting Large Language Model (LLM)-generated code is a growing challenge with implications for security, intellectual property, and academic integrity. We investigate the role of conditional probability distributions in improving…

Computation and Language · Computer Science 2025-06-09 Maor Ashkenazi , Ofir Brenner , Tal Furman Shohet , Eran Treister

Machine-generated texts (MGTs) produced by large language models (LLMs) are increasingly prevalent across various applications, while their potential misuse in fake news propagation and phishing has raised serious concerns, highlighting the…

Computation and Language · Computer Science 2026-05-25 Chenwang Wu , Yiu-ming Cheung , Bo Han , Defu Lian

The widespread adoption of large language models (LLMs) has created an urgent need for robust tools to detect LLM-generated text, especially in light of \textit{paraphrasing} techniques that often evade existing detection methods. To…

Computation and Language · Computer Science 2024-11-21 Weiqing He , Bojian Hou , Tianqi Shang , Davoud Ataee Tarzanagh , Qi Long , Li Shen

Large Language Models are a promising tool for automated vulnerability detection, thanks to their success in code generation and repair. However, despite widespread adoption, a critical question remains: Are LLMs truly effective at…

Cryptography and Security · Computer Science 2025-04-21 Yue Li , Xiao Li , Hao Wu , Minghui Xu , Yue Zhang , Xiuzhen Cheng , Fengyuan Xu , Sheng Zhong

The rapid advancement of large language models (LLMs) has resulted in increasingly sophisticated AI-generated content, posing significant challenges in distinguishing LLM-generated text from human-written language. Existing detection…

Computation and Language · Computer Science 2025-08-12 Siyuan Li , Xi Lin , Guangyan Li , Zehao Liu , Aodu Wulianghai , Li Ding , Jun Wu , Jianhua Li

The rapid advancement of large language models (LLMs) has blurred the line between AI-generated and human-written text. This progress brings societal risks such as misinformation, authorship ambiguity, and intellectual property concerns,…

Computation and Language · Computer Science 2025-10-10 Xiaowei Zhu , Yubing Ren , Fang Fang , Qingfeng Tan , Shi Wang , Yanan Cao

The rapid improvement of language models has raised the specter of abuse of text generation systems. This progress motivates the development of simple methods for detecting generated text that can be used by and explained to non-experts. We…

Computation and Language · Computer Science 2019-06-11 Sebastian Gehrmann , Hendrik Strobelt , Alexander M. Rush

Generated texts from large language models (LLMs) are remarkably close to high-quality human-authored text, raising concerns about their potential misuse in spreading false information and academic misconduct. Consequently, there is an…

Computation and Language · Computer Science 2023-11-06 Kangxi Wu , Liang Pang , Huawei Shen , Xueqi Cheng , Tat-Seng Chua

The rapid adoption of LLMs has increased the need for reliable AI text detection, yet existing detectors often fail outside controlled benchmarks. We systematically evaluate 2 dominant paradigms (training-free and supervised) and show that…

Computation and Language · Computer Science 2026-01-28 Jivnesh Sandhan , Harshit Jaiswal , Fei Cheng , Yugo Murawaki

The spread of fake news has emerged as a critical challenge, undermining trust and posing threats to society. In the era of Large Language Models (LLMs), the capability to generate believable fake content has intensified these concerns. In…

Computation and Language · Computer Science 2023-09-19 Jinyan Su , Terry Yue Zhuo , Jonibek Mansurov , Di Wang , Preslav Nakov