English
Related papers

Related papers: Spotlights and Blindspots: Evaluating Machine-Gene…

200 papers

Automatic evaluation of language generation systems is a well-studied problem in Natural Language Processing. While novel metrics are proposed every year, a few popular metrics remain as the de facto metrics to evaluate tasks such as image…

Computation and Language · Computer Science 2020-10-27 Ozan Caglayan , Pranava Madhyastha , Lucia Specia

Natural language generation tools are powerful and effective for generating content. However, language models are known to display bias and fairness issues, making them impractical to deploy for many use cases. We here focus on how fairness…

Computation and Language · Computer Science 2024-05-03 Kevin Stowe , Benny Longwill , Alyssa Francis , Tatsuya Aoyama , Debanjan Ghosh , Swapna Somasundaran

High-quality text generation capability of recent Large Language Models (LLMs) causes concerns about their misuse (e.g., in massive generation/spread of disinformation). Machine-generated text (MGT) detection is important to cope with such…

Automatic readability assessment plays a key role in ensuring effective and accessible written communication. Despite significant progress, the field is hindered by inconsistent definitions of readability and measurements that rely on…

Computation and Language · Computer Science 2025-10-20 Catarina G Belem , Parker Glenn , Alfy Samuel , Anoop Kumar , Daben Liu

Detecting AI-generated text is a difficult problem to begin with; detecting AI-generated text on social media is made even more difficult due to the short text length and informal, idiosyncratic language of the internet. It is nonetheless…

Computation and Language · Computer Science 2025-06-17 Hillary Dawkins , Kathleen C. Fraser , Svetlana Kiritchenko

Large language models (LLMs) have reached human-like proficiency in generating diverse textual content, underscoring the necessity for effective fake text detection to avoid potential risks such as fake news in social media. Previous…

Machine Learning · Computer Science 2024-03-21 Zhixin Lai , Xuesheng Zhang , Suiyao Chen

Detecting text generated by large language models (LLMs) is of great recent interest. With zero-shot methods like DetectGPT, detection capabilities have reached impressive levels. However, the reliability of existing detectors in real-world…

Computation and Language · Computer Science 2025-03-13 Junchao Wu , Runzhe Zhan , Derek F. Wong , Shu Yang , Xinyi Yang , Yulin Yuan , Lidia S. Chao

This paper describes the approach of the Unibuc - NLP team in tackling the Coling 2025 GenAI Workshop, Task 1: Binary Multilingual Machine-Generated Text Detection. We explored both masked language models and causal models. For Subtask A,…

Computation and Language · Computer Science 2025-01-20 Teodor-George Marchitan , Claudiu Creanga , Liviu P. Dinu

A significant proportion of queries to large language models ask them to edit user-provided text, rather than generate new text from scratch. While previous work focuses on detecting fully AI-generated text, we demonstrate that AI-edited…

Computation and Language · Computer Science 2025-10-06 Katherine Thai , Bradley Emi , Elyas Masrour , Mohit Iyyer

The potential of artificial intelligence (AI)-based large language models (LLMs) holds considerable promise in revolutionizing education, research, and practice. However, distinguishing between human-written and AI-generated text has become…

Computation and Language · Computer Science 2023-11-14 Kadhim Hayawi , Sakib Shahriar , Sujith Samuel Mathew

As texts generated by Large Language Models (LLMs) are ever more common and often indistinguishable from human-written content, research on automatic text detection has attracted growing attention. Many recent detectors report near-perfect…

Computation and Language · Computer Science 2025-10-16 Matthieu Dubois , François Yvon , Pablo Piantanida

Large Language Models (LLMs) possess an extraordinary capability to produce text that is not only coherent and contextually relevant but also strikingly similar to human writing. They adapt to various styles and genres, producing content…

Computation and Language · Computer Science 2025-07-08 Chinnappa Guggilla , Budhaditya Roy , Trupti Ramdas Chavan , Abdul Rahman , Edward Bowen

Text generation has become more accessible than ever, and the increasing interest in these systems, especially those using large language models, has spurred an increasing number of related publications. We provide a systematic literature…

Computation and Language · Computer Science 2024-09-02 Jonas Becker , Jan Philip Wahle , Bela Gipp , Terry Ruas

Recently there have been many shared tasks targeting the detection of generated text from Large Language Models (LLMs). However, these shared tasks tend to focus either on cases where text is limited to one particular domain or cases where…

Computation and Language · Computer Science 2025-01-16 Liam Dugan , Andrew Zhu , Firoj Alam , Preslav Nakov , Marianna Apidianaki , Chris Callison-Burch

In this paper we analyze features to classify human- and AI-generated text for English, French, German and Spanish and compare them across languages. We investigate two scenarios: (1) The detection of text generated by AI from scratch, and…

Computation and Language · Computer Science 2024-01-31 Kristina Schaaff , Tim Schlippe , Lorenz Mindner

This article gives an overview of the field of LLM text recognition. Different approaches and implemented detectors for the recognition of LLM-generated text are presented. In addition to discussing the implementations, the article focuses…

Computation and Language · Computer Science 2024-06-18 Thorsten Pröhl , Erik Putzier , Rüdiger Zarnekow

Recent advancements in Large Language Models (LLMs) have led to high-quality Machine-Generated Text (MGT), giving rise to countless new use cases and applications. However, easy access to LLMs is posing new challenges due to misuse. To…

Computation and Language · Computer Science 2024-04-15 Areg Mikael Sarvazyan , José Ángel González , Marc Franco-Salvador

This paper describes our system developed for SemEval-2024 Task 8, ``Multigenerator, Multidomain, and Multilingual Black-Box Machine-Generated Text Detection'' Machine-generated texts have been one of the main concerns due to the use of…

Computation and Language · Computer Science 2024-03-29 Shubhashis Roy Dipta , Sadat Shahriar

Language generation models' democratization benefits many domains, from answering health-related questions to enhancing education by providing AI-driven tutoring services. However, language generation models' democratization also makes it…

Computation and Language · Computer Science 2021-06-03 Paras Bhatt , Anthony Rios

Detecting texts generated by Large Language Models (LLMs) could cause grave mistakes due to incorrect decisions, such as undermining students' academic dignity. LLM text detection thus needs to ensure the interpretability of the decision,…

Computation and Language · Computer Science 2026-05-06 Ryuto Koike , Masahiro Kaneko , Ayana Niwa , Preslav Nakov , Naoaki Okazaki
‹ Prev 1 3 4 5 6 7 10 Next ›