English
Related papers

Related papers: Black-Box Detection of LLM-Generated Text Using Ge…

200 papers

Large Language Models (LLMs) frequently generate plausible but non-factual content, a phenomenon known as hallucination. While existing detection methods typically rely on computationally expensive sampling-based consistency checks or…

Machine Learning · Computer Science 2026-05-07 Dan Wilson , Mohamed Akrout

The widespread adoption of Large Language Models (LLMs) has made the detection of AI-Generated text a pressing and complex challenge. Although many detection systems report high benchmark accuracy, their reliability in real-world settings…

Computation and Language · Computer Science 2026-04-23 Shushanta Pudasaini , Luis Miralles-Pechuán , David Lillis , Marisa Llorens Salvador

Detecting whether a given text is a member of the pre-training data of Large Language Models (LLMs) is crucial for ensuring data privacy and copyright protection. Most existing methods rely on the LLM's hidden information (e.g., model…

Computation and Language · Computer Science 2025-06-25 Ruihan Hu , Yu-Ming Shang , Jiankun Peng , Wei Luo , Yazhe Wang , Xi Zhang

The increasing difficulty to distinguish language-model-generated from human-written text has led to the development of detectors of machine-generated text (MGT). However, in many contexts, a black-box prediction is not sufficient, it is…

Machine Learning · Computer Science 2026-01-21 Loris Schoenegger , Yuxi Xia , Benjamin Roth

The increasing use of Large Language Models (LLMs) for generating highly coherent and contextually relevant text introduces new risks, including misuse for unethical purposes such as disinformation or academic dishonesty. To address these…

Computation and Language · Computer Science 2024-10-16 Zhenyu Xu , Kun Zhang , Victor S. Sheng

This paper introduces a novel approach for identifying the possible large language models (LLMs) involved in text generation. Instead of adding an additional classification layer to a base LM, we reframe the classification task as a…

Computation and Language · Computer Science 2024-02-08 Yutian Chen , Hao Kang , Vivian Zhai , Liangze Li , Rita Singh , Bhiksha Raj

Machine-generated texts (MGTs) produced by large language models (LLMs) are increasingly prevalent across various applications, while their potential misuse in fake news propagation and phishing has raised serious concerns, highlighting the…

Computation and Language · Computer Science 2026-05-25 Chenwang Wu , Yiu-ming Cheung , Bo Han , Defu Lian

Large Language Model (LLM)-based judgments leverage powerful LLMs to efficiently evaluate candidate content and provide judgment scores. However, the inherent biases and vulnerabilities of LLM-generated judgments raise concerns,…

Artificial Intelligence · Computer Science 2025-09-30 Dawei Li , Zhen Tan , Chengshuai Zhao , Bohan Jiang , Baixiang Huang , Pingchuan Ma , Abdullah Alnaibari , Kai Shu , Huan Liu

Large language models (LLMs) present significant risks when used to generate non-factual content and spread disinformation at scale. Detecting such LLM-generated content is crucial, yet current detectors often struggle to generalize in…

Computation and Language · Computer Science 2025-02-18 Ran Li , Wei Hao , Weiliang Zhao , Junfeng Yang , Chengzhi Mao

The misuse of large language models (LLMs) requires precise detection of synthetic text. Existing works mainly follow binary or ternary classification settings, which can only distinguish pure human/LLM text or collaborative text at best.…

Computation and Language · Computer Science 2026-05-19 Yang Li , Qiang Sheng , Zhengjia Wang , Yehan Yang , Danding Wang , Juan Cao

Large language models (LLMs) increasingly solve complex reasoning tasks via long chain-of-thought, but their forward-only autoregressive generation process is fragile; early token errors can cascade, which creates a clear need for…

Computation and Language · Computer Science 2025-10-06 Jian Mu , Qixin Zhang , Zhiyong Wang , Menglin Yang , Shuang Qiu , Chengwei Qin , Zhongxiang Dai , Yao Shu

The rapid proliferation of large language models (LLMs) has created an urgent need for robust and generalizable detectors of machine-generated text. Existing benchmarks typically evaluate a single detector on a single dataset under ideal…

Computation and Language · Computer Science 2026-03-19 Madhav S. Baidya , S. S. Baidya , Chirag Chawla

An increasing number of machine learning models have been deployed in domains with high stakes such as finance and healthcare. Despite their superior performances, many models are black boxes in nature which are hard to explain. There are…

Machine Learning · Computer Science 2022-04-01 Shivani Choudhary , Niladri Chatterjee , Subir Kumar Saha

Large Language Models (LLMs) have shown improved generation performance through retrieval-augmented generation (RAG) following the retriever-reader paradigm, which supplements model inputs with externally retrieved knowledge. However, prior…

Computation and Language · Computer Science 2025-11-14 Zhanghao Hu , Qinglin Zhu , Siya Qi , Yulan He , Hanqi Yan , Lin Gui

The advent of Large Language Models (LLMs) has revolutionized text generation, producing outputs that closely mimic human writing. This blurring of lines between machine- and human-written text presents new challenges in distinguishing one…

Computation and Language · Computer Science 2024-10-29 Cong Zeng , Shengkun Tang , Xianjun Yang , Yuanzhou Chen , Yiyou Sun , zhiqiang xu , Yao Li , Haifeng Chen , Wei Cheng , Dongkuan Xu

Verifiers or reward models are often used to enhance the reasoning performance of large language models (LLMs). A common approach is the Best-of-N method, where N candidate solutions generated by the LLM are ranked by a verifier, and the…

Machine Learning · Computer Science 2025-02-25 Lunjun Zhang , Arian Hosseini , Hritik Bansal , Mehran Kazemi , Aviral Kumar , Rishabh Agarwal

Anomaly detection is the process of finding data points that deviate from a baseline. In a real-life setting, anomalies are usually unknown or extremely rare. Moreover, the detection must be accomplished in a timely manner or the risk of…

Machine Learning · Computer Science 2019-04-26 Mariem Ben Fadhel , Kofi Nyarko

With the advancement in capabilities of Large Language Models (LLMs), one major step in the responsible and safe use of such LLMs is to be able to detect text generated by these models. While supervised AI-generated text detectors perform…

Computation and Language · Computer Science 2024-03-26 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

While machine-generated texts (MGTs) offer great convenience, they also pose risks such as disinformation and phishing, highlighting the need for reliable detection. Metric-based methods, which extract statistically distinguishable features…

Computation and Language · Computer Science 2026-02-10 Chenwang Wu , Yiu-ming Cheung , Shuhai Zhang , Bo Han , Defu Lian

The increasing fluency and widespread usage of large language models (LLMs) highlight the desirability of corresponding tools aiding detection of LLM-generated text. In this paper, we identify a property of the structure of an LLM's…

Computation and Language · Computer Science 2023-07-25 Eric Mitchell , Yoonho Lee , Alexander Khazatsky , Christopher D. Manning , Chelsea Finn