English
Related papers

Related papers: Zero-Shot Detection of Machine-Generated Codes

200 papers

The efficacy of detectors for texts generated by large language models (LLMs) substantially depends on the availability of large-scale training data. However, white-box zero-shot detectors, which require no such data, are limited by the…

Computation and Language · Computer Science 2025-03-04 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xuebo Liu , Lidia S. Chao , Min Zhang

With the rapid progress of large language models (LLMs) and the huge amount of text they generated, it becomes more and more impractical to manually distinguish whether a text is machine-generated. Given the growing use of LLMs in social…

Computation and Language · Computer Science 2023-06-12 Jinyan Su , Terry Yue Zhuo , Di Wang , Preslav Nakov

Large Language Models (LLMs) have demonstrated remarkable proficiency in generating code. However, the misuse of LLM-generated (synthetic) code has raised concerns in both educational and industrial contexts, underscoring the urgent need…

Software Engineering · Computer Science 2024-12-17 Tong Ye , Yangkai Du , Tengfei Ma , Lingfei Wu , Xuhong Zhang , Shouling Ji , Wenhai Wang

The increasing fluency and widespread usage of large language models (LLMs) highlight the desirability of corresponding tools aiding detection of LLM-generated text. In this paper, we identify a property of the structure of an LLM's…

Computation and Language · Computer Science 2023-07-25 Eric Mitchell , Yoonho Lee , Alexander Khazatsky , Christopher D. Manning , Chelsea Finn

Large language models (LLMs) have shown the ability to produce fluent and cogent content, presenting both productivity opportunities and societal risks. To build trustworthy AI systems, it is imperative to distinguish between…

Computation and Language · Computer Science 2024-12-17 Guangsheng Bao , Yanbin Zhao , Zhiyang Teng , Linyi Yang , Yue Zhang

The rampant proliferation of large language models, fluent enough to generate text indistinguishable from human-written language, gives unprecedented importance to the detection of machine-generated text. This work is motivated by an…

Computation and Language · Computer Science 2023-10-10 Xiao Pu , Jingyu Zhang , Xiaochuang Han , Yulia Tsvetkov , Tianxing He

To combat the potential misuse of Natural Language Generation (NLG) technology, a variety of algorithms have been developed for the detection of AI-generated texts. Traditionally, this task is treated as a binary classification problem.…

Computation and Language · Computer Science 2023-12-22 Yi-Fan Zhang , Zhang Zhang , Liang Wang , Tieniu Tan , Rong Jin

Detecting Large Language Model (LLM)-generated code is a growing challenge with implications for security, intellectual property, and academic integrity. We investigate the role of conditional probability distributions in improving…

Computation and Language · Computer Science 2025-06-09 Maor Ashkenazi , Ofir Brenner , Tal Furman Shohet , Eran Treister

In this paper, we study the problem of detecting machine-generated text when the large language model (LLM) it is possibly derived from is unknown. We do so by apply ensembling methods to the outputs from DetectGPT classifiers (Mitchell et…

Computation and Language · Computer Science 2024-06-19 Ivan Ong , Boon King Quek

Large language models (LLMs) have notably enhanced the fluency and diversity of machine-generated text. However, this progress also presents a significant challenge in detecting the origin of a given text, and current research on detection…

Computation and Language · Computer Science 2023-10-05 Xianjun Yang , Wei Cheng , Yue Wu , Linda Petzold , William Yang Wang , Haifeng Chen

Advanced large language models (LLMs) can generate text almost indistinguishable from human-written text, highlighting the importance of LLM-generated text detection. However, current zero-shot techniques face challenges as white-box…

Computation and Language · Computer Science 2025-02-20 Guangsheng Bao , Yanbin Zhao , Juncai He , Yue Zhang

Detecting text generated by modern large language models is thought to be hard, as both LLMs and humans can exhibit a wide range of complex behaviors. However, we find that a score based on contrasting two closely related language models is…

Computation and Language · Computer Science 2024-10-15 Abhimanyu Hans , Avi Schwarzschild , Valeriia Cherepanova , Hamid Kazemi , Aniruddha Saha , Micah Goldblum , Jonas Geiping , Tom Goldstein

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, their ability to generate human-like text has raised concerns about potential misuse. This underscores the need for reliable and effective…

Computation and Language · Computer Science 2026-04-24 Runheng Liu , Heyan Huang , Xingchen Xiao , Zhijing Wu

Retrained large language models (LLMs) have become extensively used across various sub-disciplines of natural language processing (NLP). In NLP, text classification problems have garnered considerable focus, but still faced with some…

Computation and Language · Computer Science 2023-12-05 Zhiqiang Wang , Yiran Pang , Yanbin Lin

Detecting text generated by large language models (LLMs) is of great recent interest. With zero-shot methods like DetectGPT, detection capabilities have reached impressive levels. However, the reliability of existing detectors in real-world…

Computation and Language · Computer Science 2025-03-13 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xinyi Yang , Yulin Yuan , Lidia S. Chao

Existing methods for the zero-shot detection of machine-generated text are dominated by three statistical quantities: log-likelihood, log-rank, and entropy. As language models mimic the distribution of human text ever closer, this will…

Computation and Language · Computer Science 2025-03-27 Tom Kempton , Stuart Burrell , Connor Cheverall

Large language models (LLMs) have demonstrated remarkable capabilities in generating high-quality texts across diverse domains. However, the potential misuse of LLMs has raised significant concerns, underscoring the urgent need for reliable…

Computation and Language · Computer Science 2024-10-10 Yihuai Xu , Yongwei Wang , Yifei Bi , Huangsen Cao , Zhouhan Lin , Yu Zhao , Fei Wu

The increasing capability and widespread usage of large language models (LLMs) highlight the desirability of automatic detection of LLM-generated text. Zero-shot detectors, due to their training-free nature, have received considerable…

Computation and Language · Computer Science 2024-09-26 Shixuan Ma , Quan Wang

LLM-generated text (LGT) detection is essential for reliable forensic analysis and for mitigating LLM misuse. Existing LGT detectors can generally be categorized into two broad classes: learning-based approaches and zero-shot methods.…

Computation and Language · Computer Science 2026-04-03 Kahim Wong , Kemou Li , Haiwei Wu , Jiantao Zhou

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

Computation and Language · Computer Science 2023-08-21 Amrita Bhattacharjee , Huan Liu
‹ Prev 1 2 3 10 Next ›