中文
相关论文

相关论文: Is GPT-3 Text Indistinguishable from Human Text? S…

200 篇论文

Crowd-sourcing is a cheap and popular means of creating training and evaluation datasets for machine learning, however it poses the problem of `truth inference', as individual workers cannot be wholly trusted to provide reliable…

机器学习 · 计算机科学 2019-02-26 Yuan Li , Benjamin I. P. Rubinstein , Trevor Cohn

We introduce Ghostbuster, a state-of-the-art system for detecting AI-generated text. Our method works by passing documents through a series of weaker language models, running a structured search over possible combinations of their features,…

计算与语言 · 计算机科学 2024-04-09 Vivek Verma , Eve Fleisig , Nicholas Tomlin , Dan Klein

This paper presents a novel approach for detecting ChatGPT-generated vs. human-written text using language models. To this end, we first collected and released a pre-processed dataset named OpenGPTText, which consists of rephrased content…

计算与语言 · 计算机科学 2023-05-19 Yutian Chen , Hao Kang , Vivian Zhai , Liangze Li , Rita Singh , Bhiksha Raj

The advent of instruction-tuned language models that convincingly mimic human writing poses a significant risk of abuse. However, such abuse may be counteracted with the ability to detect whether a piece of text was composed by a language…

计算与语言 · 计算机科学 2024-05-09 Rafael Rivera Soto , Kailin Koch , Aleem Khan , Barry Chen , Marcus Bishop , Nicholas Andrews

We report on novel investigations into training models that make sentences concise. We define the task and show that it is different from related tasks such as summarization and simplification. For evaluation, we release two test sets,…

计算与语言 · 计算机科学 2022-11-09 Felix Stahlberg , Aashish Kumar , Chris Alberti , Shankar Kumar

Due to advances in Large Language Models (LLMs) such as ChatGPT, the boundary between human-written text and AI-generated text has become blurred. Nevertheless, recent work has demonstrated that it is possible to reliably detect…

计算与语言 · 计算机科学 2025-06-17 Natesh Reddy , Mark Stamp

As LLMs rapidly advance, increasing concerns arise regarding risks about actual authorship of texts we see online and in real world. The task of distinguishing LLM-authored texts is complicated by the nuanced and overlapping behaviors of…

计算与语言 · 计算机科学 2025-06-25 Jiazhou Ji , Ruizhe Li , Shujun Li , Jie Guo , Weidong Qiu , Zheng Huang , Chiyu Chen , Xiaoyu Jiang , Xinru Lu

Human annotation plays a core role in machine learning -- annotations for supervised models, safety guardrails for generative models, and human feedback for reinforcement learning, to cite a few avenues. However, the fact that many of these…

The widespread use of social media platforms like Twitter and Facebook has enabled people of all ages to share their thoughts and experiences, leading to an immense accumulation of user-generated content. However, alongside the benefits,…

计算与语言 · 计算机科学 2025-03-26 Aniket Deroy , Subhankar Maity

Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching…

With increasing usage of generative models for text generation and widespread use of machine generated texts in various domains, being able to distinguish between human written and machine generated texts is a significant challenge. While…

计算与语言 · 计算机科学 2024-10-23 Ram Mohan Rao Kadiyala

With the growing interest in large language models, the need for evaluating the quality of machine text compared to reference (typically human-generated) text has become focal attention. Most recent works focus either on task-specific…

Shortage of available training data is holding back progress in the area of automated error detection. This paper investigates two alternative methods for artificially generating writing errors, in order to create additional resources. We…

计算与语言 · 计算机科学 2017-07-18 Marek Rei , Mariano Felice , Zheng Yuan , Ted Briscoe

Existing methods for the zero-shot detection of machine-generated text are dominated by three statistical quantities: log-likelihood, log-rank, and entropy. As language models mimic the distribution of human text ever closer, this will…

计算与语言 · 计算机科学 2025-03-27 Tom Kempton , Stuart Burrell , Connor Cheverall

Current state-of-the-art text generators build on powerful language models such as GPT-2, achieving impressive performance. However, to avoid degenerate text, they require sampling from a modified softmax, via temperature parameters or…

计算与语言 · 计算机科学 2020-10-06 Pedro Henrique Martins , Zita Marinho , André F. T. Martins

This study seeks to enhance academic integrity by providing tools to detect AI-generated content in student work using advanced technologies. The findings promote transparency and accountability, helping educators maintain ethical standards…

计算与语言 · 计算机科学 2025-01-07 Ayat A. Najjar , Huthaifa I. Ashqar , Omar A. Darwish , Eman Hammad

An open challenge in constructing dialogue systems is developing methods for automatically learning dialogue strategies from large amounts of unlabelled data. Recent work has proposed Next-Utterance-Classification (NUC) as a surrogate task…

计算与语言 · 计算机科学 2016-07-26 Ryan Lowe , Iulian V. Serban , Mike Noseworthy , Laurent Charlin , Joelle Pineau

Generative Artificial Intelligence (AI) has enabled the development of sophisticated models that are capable of producing high-caliber text, images, and other outputs through the utilization of large pre-trained models. Nevertheless,…

计算与语言 · 计算机科学 2023-02-14 Jinlan Fu , See-Kiong Ng , Zhengbao Jiang , Pengfei Liu

The growing capability of large language models to produce fluent, contextually coherent text has created mounting pressure on the systems and institutions responsible for ensuring the authenticity of digital content. Advanced generative…

Large Language Model (LLMs) can be used to write or modify documents, presenting a challenge for understanding the intent behind their use. For example, benign uses may involve using LLM on a human-written document to improve its grammar or…

计算与语言 · 计算机科学 2025-09-22 Yitong Wang , Zhongping Zhang , Margherita Piana , Zheng Zhou , Peter Gerstoft , Bryan A. Plummer