English
Related papers

Related papers: How well can machine-generated texts be identified…

200 papers

We consider the problem of distinguishing human-written creative fiction (excerpts from novels) from similar text generated by an LLM. Our results show that, while human observers perform poorly (near chance levels) on this binary…

Computation and Language · Computer Science 2026-01-13 Minerva Suvanto , Andrea McGlinchey , Mattias Wahde , Peter J Barclay

Prior studies have shown that distinguishing text generated by Large Language Models (LLMs) from human-written one is highly challenging for humans, and often no better than random guessing. To verify the generalizability of this finding…

ChatGPT has the ability to generate grammatically flawless and seemingly-human replies to different types of questions from various domains. The number of its users and of its applications is growing at an unprecedented rate. Unfortunately,…

Computation and Language · Computer Science 2023-02-01 Sandra Mitrović , Davide Andreoletti , Omran Ayoub

The increasing popularity of large language models has not only led to widespread use but has also brought various risks, including the potential for systematically spreading fake news. Consequently, the development of classification…

Computation and Language · Computer Science 2025-03-11 Sinclair Schneider , Florian Steuber , Joao A. G. Schneider , Gabi Dreo Rodosek

$ $The usage of generative artificial intelligence (AI) tools based on large language models, including ChatGPT, Bard, and Claude, for text generation has many exciting applications with the potential for phenomenal productivity gains. One…

Computation and Language · Computer Science 2024-01-01 Antônio Junior Alves Caiado , Michael Hahsler

There have been many recent advances in the fields of generative Artificial Intelligence (AI) and Large Language Models (LLM), with the Generative Pre-trained Transformer (GPT) model being a leading "chatbot." LLM-based chatbots have become…

Computation and Language · Computer Science 2024-08-12 Gauri Anil Godghase , Rishit Agrawal , Tanush Obili , Mark Stamp

Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching…

The power of natural language generation models has provoked a flurry of interest in automatic methods to detect if a piece of text is human or machine-authored. The problem so far has been framed in a standard supervised way and consists…

Computation and Language · Computer Science 2021-11-05 Matthias Gallé , Jos Rozen , Germán Kruszewski , Hady Elsahar

Generative AI offers a simple, prompt-based alternative to fine-tuning smaller BERT-style LLMs for text classification tasks. This promises to eliminate the need for manually labeled training data and task-specific model training. However,…

Computation and Language · Computer Science 2024-08-19 Martin Juan José Bucher , Marco Martini

In this paper, we study how well humans can detect text generated by commercial LLMs (GPT-4o, Claude, o1). We hire annotators to read 300 non-fiction English articles, label them as either human-written or AI-generated, and provide…

Computation and Language · Computer Science 2025-05-21 Jenna Russell , Marzena Karpinska , Mohit Iyyer

Deceptive text classification is a critical task in natural language processing that aims to identify deceptive o fraudulent content. This study presents a comparative analysis of machine learning and transformer-based approaches for…

Computation and Language · Computer Science 2023-08-14 Anusuya Krishnan

As text generated by large language models proliferates, it becomes vital to understand how humans engage with such text, and whether or not they are able to detect when the text they are reading did not originate with a human writer. Prior…

Computation and Language · Computer Science 2022-12-27 Liam Dugan , Daphne Ippolito , Arun Kirubarajan , Sherry Shi , Chris Callison-Burch

AI-generated text detection plays an increasingly important role in various fields. In this study, we developed an efficient AI-generated text detection model based on the BERT algorithm, which provides new ideas and methods for solving…

Computation and Language · Computer Science 2024-10-15 Hao Wang , Jianwei Li , Zhengyu Li

Large generative language models such as GPT-2 are well-known for their ability to generate text as well as their utility in supervised downstream tasks via fine-tuning. Our work is twofold: firstly we demonstrate via human evaluation that…

Computation and Language · Computer Science 2020-09-01 Dara Bahri , Yi Tay , Che Zheng , Donald Metzler , Cliff Brunk , Andrew Tomkins

The growing capability of large language models to produce fluent, contextually coherent text has created mounting pressure on the systems and institutions responsible for ensuring the authenticity of digital content. Advanced generative…

Large language models can produce convincing "fake text" in domains such as academic writing, product reviews, and political news. Many approaches have been investigated for the detection of artificially generated text. While this may seem…

Computation and Language · Computer Science 2025-06-27 Andrea McGlinchey , Peter J Barclay

With the recent proliferation of Large Language Models (LLMs), there has been an increasing demand for tools to detect machine-generated text. The effective detection of machine-generated text face two pertinent problems: First, they are…

Computation and Language · Computer Science 2024-04-04 Mazal Bethany , Brandon Wherry , Emet Bethany , Nishant Vishwamitra , Anthony Rios , Peyman Najafirad

Neural text detectors are models trained to detect whether a given text was generated by a language model or written by a human. In this paper, we investigate three simple and resource-efficient strategies (parameter tweaking, prompt…

Computation and Language · Computer Science 2023-11-06 Vitalii Fishchuk , Daniel Braun

In this paper, we study the problem of detecting machine-generated text when the large language model (LLM) it is possibly derived from is unknown. We do so by apply ensembling methods to the outputs from DetectGPT classifiers (Mitchell et…

Computation and Language · Computer Science 2024-06-19 Ivan Ong , Boon King Quek

Large language models (LLMs) have been widely employed for graph-to-text generation tasks. However, the process of finetuning LLMs requires significant training resources and annotation work. In this paper, we explore the capability of…

Computation and Language · Computer Science 2023-07-28 Shuzhou Yuan , Michael Färber