English
Related papers

Related papers: A Statistical Turing Test for Generative Models

200 papers

As large-scale, pre-trained language models achieve human-level and superhuman accuracy on existing language understanding tasks, statistical bias in benchmark data and probing studies have recently called into question their true…

Computation and Language · Computer Science 2021-09-13 Shane Storks , Joyce Chai

Providing a human-understandable explanation of classifiers' decisions has become imperative to generate trust in their use for day-to-day tasks. Although many works have addressed this problem by generating visual explanation maps, they…

Machine Learning · Computer Science 2021-06-22 Martin Charachon , Paul-Henry Cournède , Céline Hudelot , Roberto Ardon

This paper presents a systematic survey on recent development of neural text generation models. Specifically, we start from recurrent neural network language models with the traditional maximum likelihood estimation training scheme and…

Computation and Language · Computer Science 2018-03-21 Sidi Lu , Yaoming Zhu , Weinan Zhang , Jun Wang , Yong Yu

Generative AI models face the challenge of hallucinations that can undermine users' trust in such systems. We approach the problem of conversational information seeking as a two-step process, where relevant passages in a corpus are…

Information Retrieval · Computer Science 2024-01-23 Weronika Łajewska , Krisztian Balog

In this paper we analyze features to classify human- and AI-generated text for English, French, German and Spanish and compare them across languages. We investigate two scenarios: (1) The detection of text generated by AI from scratch, and…

Computation and Language · Computer Science 2024-01-31 Kristina Schaaff , Tim Schlippe , Lorenz Mindner

A major challenge in the field of Text Generation is evaluation: Human evaluations are cost-intensive, and automated metrics often display considerable disagreement with human judgments. In this paper, we propose a statistical model of Text…

Computation and Language · Computer Science 2023-06-07 Jan Deriu , Pius von Däniken , Don Tuggener , Mark Cieliebak

After the launch of ChatGPT v.4 there has been a global vivid discussion on the ability of this artificial intelligence powered platform and some other similar ones for the automatic production of all kinds of texts, including scientific…

Computation and Language · Computer Science 2024-04-16 Javier J. Sanchez-Medina

As advanced modern systems like deep neural networks (DNNs) and generative AI continue to enhance their capabilities in producing convincing and realistic content, the need to distinguish between user-generated and machine generated content…

Computation and Language · Computer Science 2024-04-01 Yaqi Xie , Anjali Rawal , Yujing Cen , Dixuan Zhao , Sunil K Narang , Shanu Sushmita

The chapter discusses the foundational impact of modern generative AI models on information access (IA) systems. In contrast to traditional AI, the large-scale training and superior data modeling of generative AI models enable them to…

Information Retrieval · Computer Science 2025-01-07 Qingyao Ai , Jingtao Zhan , Yiqun Liu

Generic generation and manipulation of text is challenging and has limited success compared to recent deep generative modeling in visual domain. This paper aims at generating plausible natural language sentences, whose attributes are…

Machine Learning · Computer Science 2018-09-14 Zhiting Hu , Zichao Yang , Xiaodan Liang , Ruslan Salakhutdinov , Eric P. Xing

We propose a method to determine whether a given article was written entirely by a generative language model or perhaps contains edits by a different author, possibly a human. Our process involves multiple tests for the origin of individual…

Information Theory · Computer Science 2024-08-27 Idan Kashtan , Alon Kipnis

Writers generally rely on plans or sketches to write long stories, but most current language models generate word by word from left to right. We explore coarse-to-fine models for creating narrative texts of several hundred words, and…

Computation and Language · Computer Science 2019-06-18 Angela Fan , Mike Lewis , Yann Dauphin

The aim of this paper is to review the use of GenAI in scientometrics, and to begin a debate on the broader implications for the field. First, we provide an introduction on GenAI's generative and probabilistic nature as rooted in…

Computation and Language · Computer Science 2025-07-02 Benedetto Lepori , Jens Peter Andersen , Karsten Donnay

The comparison between discriminative and generative classifiers has intrigued researchers since Efron's seminal analysis of logistic regression versus discriminant analysis. While early theoretical work established that generative…

Recent genomic and bioinformatic advances have motivated the development of numerous random network models purporting to describe graphs of biological, technological, and sociological origin. The success of a model has been evaluated by how…

Molecular Networks · Quantitative Biology 2007-05-23 Manuel Middendorf , Etay Ziv , Carter Adams , Jen Hom , Robin Koytcheff , Chaya Levovitz , Gregory Woods , Linda Chen , Chris Wiggins

Natural Language Inference is an important task for Natural Language Understanding. It is concerned with classifying the logical relation between two sentences. In this paper, we propose several text generative neural networks for…

Artificial Intelligence · Computer Science 2017-03-28 Janez Starc , Dunja Mladenić

Advances in generative models have led to significant interest in image synthesis, demonstrating the ability to generate high-quality images for a diverse range of text prompts. Despite this progress, most studies ignore the presence of…

Artificial Intelligence · Computer Science 2024-07-02 Nila Masrourisaadat , Nazanin Sedaghatkish , Fatemeh Sarshartehrani , Edward A. Fox

In the last two decades, the landscape of text generation has undergone tremendous changes and is being reshaped by the success of deep learning. New technologies for text generation ranging from template-based methods to neural…

Computation and Language · Computer Science 2019-05-07 Qiuyun Zhang , Bin Guo , Hao Wang , Yunji Liang , Shaoyang Hao , Zhiwen Yu

Large generative language models such as GPT-2 are well-known for their ability to generate text as well as their utility in supervised downstream tasks via fine-tuning. Our work is twofold: firstly we demonstrate via human evaluation that…

Computation and Language · Computer Science 2020-09-01 Dara Bahri , Yi Tay , Che Zheng , Donald Metzler , Cliff Brunk , Andrew Tomkins

The increasing capability of large language models (LLMs) to generate fluent long-form texts is presenting new challenges in distinguishing machine-generated outputs from human-written ones, which is crucial for ensuring authenticity and…

Computation and Language · Computer Science 2024-10-08 Yufei Tian , Zeyu Pan , Nanyun Peng