English
Related papers

Related papers: Testing the Reliability of ChatGPT for Text Annota…

200 papers

Recently, generative AIs like ChatGPT have become available to the wide public. These tools can for instance be used by students to generate essays or whole theses. But how does a teacher know whether a text is written by a student or an…

Computation and Language · Computer Science 2023-11-14 Lorenz Mindner , Tim Schlippe , Kristina Schaaff

In this study we argue that integrating ChatGPT into the data processing pipeline of automated sensors in precision agriculture has the potential to bring several benefits and enhance various aspects of modern farming practices. Policy…

Artificial Intelligence · Computer Science 2023-11-14 Ilyas Potamitis

This paper presents a novel framework for quantitatively evaluating the interactive ChatGPT model in the context of suicidality assessment from social media posts, utilizing the University of Maryland Reddit suicidality dataset. We conduct…

Computation and Language · Computer Science 2023-06-19 Hamideh Ghanadian , Isar Nejadgholi , Hussein Al Osman

Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data, which has gained increasing attention. In this work, we investigate the understanding ability of ChatGPT for zero-shot dialogue…

Computation and Language · Computer Science 2023-04-11 Wenbo Pan , Qiguang Chen , Xiao Xu , Wanxiang Che , Libo Qin

This work conducts a comprehensive exploration into the proficiency of OpenAI's ChatGPT-4 in sourcing scientific references within an array of research disciplines. Our in-depth analysis encompasses a wide scope of fields including Computer…

Digital Libraries · Computer Science 2023-06-19 Zhi Cao

Large Language Models (LLMs) have gathered significant attention due to their impressive performance on a variety of tasks. ChatGPT, developed by OpenAI, is a recent addition to the family of language models and is being called a disruptive…

Computation and Language · Computer Science 2023-08-29 Mayank Soni , Vincent Wade

Evaluating the quality of academic journal articles is a time consuming but critical task for national research evaluation exercises, appointments and promotion. It is therefore important to investigate whether Large Language Models (LLMs)…

Digital Libraries · Computer Science 2024-12-02 Mike Thelwall

We conducted controlled experimental bias audits for four versions of ChatGPT, which we asked to recommend an opening offer in salary negotiations for a new hire. We submitted 98,800 prompts to each version, systematically varying the…

Computers and Society · Computer Science 2024-10-10 R. Stuart Geiger , Flynn O'Sullivan , Elsie Wang , Jonathan Lo

This study aims to understand the perceptions and opinions of academicians towards ChatGPT-3 by collecting and analyzing social media comments, and a survey was conducted with library and information science professionals. The research uses…

Computers and Society · Computer Science 2023-02-15 Subaveerapandiyan A , Vinoth A , Neelam Tiwary

Background: Large language models (LLMs) such as ChatGPT are increasingly used in introductory programming courses to provide real-time code generation, debugging, and explanations. While these tools can boost productivity and code quality,…

Software Engineering · Computer Science 2025-10-02 Shiza Andleeb , Brandon Kantorski , Jeffrey C. Carver

Text summarization has been a crucial problem in natural language processing (NLP) for several decades. It aims to condense lengthy documents into shorter versions while retaining the most critical information. Various methods have been…

Computation and Language · Computer Science 2023-02-17 Xianjun Yang , Yan Li , Xinlu Zhang , Haifeng Chen , Wei Cheng

This paper explores and assesses in what ways generative AI can assist in translating survey instruments. Writing effective survey questions is a challenging and complex task, made even more difficult for surveys that will be translated and…

Computation and Language · Computer Science 2025-01-13 Erica Ann Metheney , Lauren Yehle

This paper adopts a critical approach to ChatGPT, showing how its huge reach makes it a useful tool for people with simple requirements but a bad, even misleading guide to those with more complex problems which are more rarely present in…

Software Engineering · Computer Science 2023-09-04 Patrick O'Beirne

Providing explainable and faithful feedback is crucial for automated student answer assessment. In this paper, we introduce a novel framework that explores using ChatGPT, a cutting-edge large language model, for the concurrent tasks of…

Computation and Language · Computer Science 2023-10-25 Jiazheng Li , Lin Gui , Yuxiang Zhou , David West , Cesare Aloisi , Yulan He

Background: Large language models such as ChatGPT are capable of generating grammatically perfect and human-like text content, and a large number of ChatGPT-generated texts have appeared on the Internet. However, medical texts such as…

Computation and Language · Computer Science 2024-01-01 Wenxiong Liao , Zhengliang Liu , Haixing Dai , Shaochen Xu , Zihao Wu , Yiyang Zhang , Xiaoke Huang , Dajiang Zhu , Hongmin Cai , Tianming Liu , Xiang Li

Upon release, ChatGPT3.5 shocked the software engineering community by its ability to generate answers to specialized questions about coding. Immediately, many educators wondered if it was possible to use the chatbot as a support tool that…

Computers and Society · Computer Science 2024-11-27 Yaiza Aragonés-Soria , Julia Kotovich , Chitsutha Soomlek , Manuel Oriol

Large language models have become increasingly effective in software engineering tasks such as code generation, debugging and repair. Language models like ChatGPT can not only generate code, but also explain its inner workings and in…

Software Engineering · Computer Science 2025-10-15 Christian Janßen , Cedric Richter , Heike Wehrheim

Recent research has highlighted the potential of LLM applications, like ChatGPT, for performing label annotation on social computing text. However, it is already well known that performance hinges on the quality of the input prompts. To…

Computation and Language · Computer Science 2024-02-21 Yiming Zhu , Zhizhuo Yin , Gareth Tyson , Ehsan-Ul Haq , Lik-Hang Lee , Pan Hui

The rampant spread of fake news has adversely affected society, resulting in extensive research on curbing its spread. As a notable milestone in large language models (LLMs), ChatGPT has gained significant attention due to its exceptional…

Computation and Language · Computer Science 2024-04-09 Yue Huang , Lichao Sun

Scientific articles play a crucial role in advancing knowledge and informing research directions. One key aspect of evaluating scientific articles is the analysis of citations, which provides insights into the impact and reception of the…

Digital Libraries · Computer Science 2026-03-09 Walid Hariri