English
Related papers

Related papers: Spotlights and Blindspots: Evaluating Machine-Gene…

200 papers

Recent advances in neural network-based generative modeling have reignited the hopes in having computer systems capable of seamlessly conversing with humans and able to understand natural language. Neural architectures have been employed to…

Computation and Language · Computer Science 2020-08-03 Cristina Garbacea , Qiaozhu Mei

The misuse of large language models (LLMs) poses potential risks, motivating the development of machine-generated text (MGT) detection. Existing literature primarily concentrates on binary, document-level detection, thereby neglecting texts…

Computation and Language · Computer Science 2025-06-04 Zhixiong Su , Yichen Wang , Herun Wan , Zhaohan Zhang , Minnan Luo

Deep learning based models have surpassed classical machine learning based approaches in various text classification tasks, including sentiment analysis, news categorization, question answering, and natural language inference. In this…

Computation and Language · Computer Science 2021-01-05 Shervin Minaee , Nal Kalchbrenner , Erik Cambria , Narjes Nikzad , Meysam Chenaghlu , Jianfeng Gao

Large language models (LLMs) have convincing performance in a variety of downstream tasks. However, these systems are prone to generating undesirable outputs such as harmful and biased text. In order to remedy such generations, the…

Computation and Language · Computer Science 2025-08-08 Manish Nagireddy , Inkit Padhi , Soumya Ghosh , Prasanna Sattigeri

This paper presents a novel approach for detecting ChatGPT-generated vs. human-written text using language models. To this end, we first collected and released a pre-processed dataset named OpenGPTText, which consists of rephrased content…

Computation and Language · Computer Science 2023-05-19 Yutian Chen , Hao Kang , Vivian Zhai , Liangze Li , Rita Singh , Bhiksha Raj

The rapid improvement of language models has raised the specter of abuse of text generation systems. This progress motivates the development of simple methods for detecting generated text that can be used by and explained to non-experts. We…

Computation and Language · Computer Science 2019-06-11 Sebastian Gehrmann , Hendrik Strobelt , Alexander M. Rush

When generating text from probabilistic models, the chosen decoding strategy has a profound effect on the resulting text. Yet the properties elicited by various decoding strategies do not always transfer across natural language generation…

Computation and Language · Computer Science 2022-03-30 Gian Wiher , Clara Meister , Ryan Cotterell

This paper presents a systematic survey on recent development of neural text generation models. Specifically, we start from recurrent neural network language models with the traditional maximum likelihood estimation training scheme and…

Computation and Language · Computer Science 2018-03-21 Sidi Lu , Yaoming Zhu , Weinan Zhang , Jun Wang , Yong Yu

Recent text generation research has increasingly focused on open-ended domains such as story and poetry generation. Because models built for such tasks are difficult to evaluate automatically, most researchers in the space justify their…

Computation and Language · Computer Science 2021-09-15 Marzena Karpinska , Nader Akoury , Mohit Iyyer

Since ChatGPT has emerged as a major AIGC model, providing high-quality responses across a wide range of applications (including software development and maintenance), it has attracted much interest from many individuals. ChatGPT has great…

Computation and Language · Computer Science 2023-10-24 Arslan Akram

The paper surveys evaluation methods of natural language generation (NLG) systems that have been developed in the last few years. We group NLG evaluation methods into three categories: (1) human-centric evaluation metrics, (2) automatic…

Computation and Language · Computer Science 2021-05-19 Asli Celikyilmaz , Elizabeth Clark , Jianfeng Gao

Large language models (LLMs) have transformed human writing by enhancing grammar correction, content expansion, and stylistic refinement. However, their widespread use raises concerns about authorship, originality, and ethics, even…

Computation and Language · Computer Science 2024-10-21 Zhen Tao , Zhiyu Li , Runyu Chen , Dinghao Xi , Wei Xu

Energy-based models (EBMs), a.k.a. un-normalized models, have had recent successes in continuous spaces. However, they have not been successfully applied to model text sequences. While decreasing the energy at training samples is…

Machine Learning · Computer Science 2019-11-26 Anton Bakhtin , Sam Gross , Myle Ott , Yuntian Deng , Marc'Aurelio Ranzato , Arthur Szlam

Language serves as a powerful tool for the manifestation of societal belief systems. In doing so, it also perpetuates the prevalent biases in our society. Gender bias is one of the most pervasive biases in our society and is seen in online…

Computation and Language · Computer Science 2023-10-27 Rishav Hada , Agrima Seth , Harshita Diddee , Kalika Bali

Existing text recognition methods usually need large-scale training data. Most of them rely on synthetic training data due to the lack of annotated real images. However, there is a domain gap between the synthetic data and real data, which…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Mingkun Yang , Minghui Liao , Pu Lu , Jing Wang , Shenggao Zhu , Hualin Luo , Qi Tian , Xiang Bai

The remarkable capabilities and easy accessibility of large language models (LLMs) have significantly increased societal risks (e.g., fake news generation), necessitating the development of LLM-generated text (LGT) detection methods for…

Machine Learning · Computer Science 2024-11-08 Hyunseok Lee , Jihoon Tack , Jinwoo Shin

Within the text analysis and processing fields, generated text attacks have been made easier to create than ever before. To combat these attacks open sourcing models and datasets have become a major trend to create automated detection…

Computation and Language · Computer Science 2022-10-13 Jesus Guerrero , Izzat Alsmadi

The rapid development of large language models has led to an increase in AI-generated text, with students increasingly using LLM-generated content as their own work, which violates academic integrity. This paper presents an evaluation of AI…

Computation and Language · Computer Science 2026-01-08 Adilkhan Alikhanov , Aidar Amangeldi , Diar Demeubay , Dilnaz Akhmetzhan , Nurbek Moldakhmetov , Omar Polat , Galymzhan Zharas

Transformer language models have received widespread public attention, yet their generated text is often surprising even to NLP researchers. In this survey, we discuss over 250 recent studies of English language model behavior before…

Computation and Language · Computer Science 2023-08-29 Tyler A. Chang , Benjamin K. Bergen

Recent advances in large pre-trained language models have demonstrated strong results in generating natural languages and significantly improved performances for many natural language generation (NLG) applications such as machine…

Computation and Language · Computer Science 2022-09-27 Nanyun Peng