English
Related papers

Related papers: Testing the Reliability of ChatGPT for Text Annota…

200 papers

This paper assesses the accuracy, reliability and bias of the Large Language Model (LLM) ChatGPT-4 on the text analysis task of classifying the political affiliation of a Twitter poster based on the content of a tweet. The LLM is compared…

Computation and Language · Computer Science 2023-04-14 Petter Törnberg

This paper introduces a method for detecting inappropriately targeting language in online conversations by integrating crowd and expert annotations with ChatGPT. We focus on English conversation threads from Reddit, examining comments that…

Computation and Language · Computer Science 2025-05-23 Baran Barbarestani , Isa Maks , Piek Vossen

Large pre-trained language models have exhibited unprecedented capabilities in producing high-quality text via prompting techniques. This fact introduces new possibilities for data collection and annotation, particularly in situations where…

Computation and Language · Computer Science 2023-05-25 Tiziano Labruna , Sofia Brenna , Andrea Zaninello , Bernardo Magnini

We conducted a survey of 135 software engineering (SE) practitioners to understand how they use Generative AI-based chatbots like ChatGPT for SE tasks. We find that they want to use ChatGPT for SE tasks like software library selection but…

Software Engineering · Computer Science 2024-03-26 Minaoar Hossain Tanzil , Junaed Younus Khan , Gias Uddin

Sentiment analysis is a well-known natural language processing task that involves identifying the emotional tone or polarity of a given piece of text. With the growth of social media and other online platforms, sentiment analysis has become…

Computation and Language · Computer Science 2023-07-03 Mohammad Belal , James She , Simon Wong

Harmful content is pervasive on social media, poisoning online communities and negatively impacting participation. A common approach to address this issue is to develop detection models that rely on human annotations. However, the tasks…

Computation and Language · Computer Science 2024-04-29 Lingyao Li , Lizhou Fan , Shubham Atreja , Libby Hemphill

ChatGPT, an AI-based chatbot, was released to provide coherent and useful replies based on analysis of large volumes of data. In this article, leading scientists, researchers and engineers discuss the transformative effects of ChatGPT on…

Recently, the emergence of ChatGPT has attracted wide attention from the computational linguistics community. Many prior studies have shown that ChatGPT achieves remarkable performance on various NLP tasks in terms of automatic evaluation…

Computation and Language · Computer Science 2023-10-25 Jiaan Wang , Yunlong Liang , Fandong Meng , Zengkui Sun , Haoxiang Shi , Zhixu Li , Jinan Xu , Jianfeng Qu , Jie Zhou

ChatGPT is one of the most popular language models which achieve amazing performance on various natural language tasks. Consequently, there is also an urgent need to detect the texts generated ChatGPT from human written. One of the…

Computation and Language · Computer Science 2023-10-04 Han Xu , Jie Ren , Pengfei He , Shenglai Zeng , Yingqian Cui , Amy Liu , Hui Liu , Jiliang Tang

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

Computation and Language · Computer Science 2023-08-21 Amrita Bhattacharjee , Huan Liu

This exploratory study investigates the potential of the artificial intelligence tool, ChatGPT, to support systems thinking (ST) in various subjects. Using both general and subject specific prompts, the study assesses the accuracy,…

Human-Computer Interaction · Computer Science 2023-07-27 Holger Arndt

This article presents a comparative analysis of the ability of two large language model (LLM)-based chatbots, ChatGPT and Bing Chat, recently rebranded to Microsoft Copilot, to detect veracity of political information. We use AI auditing…

Computation and Language · Computer Science 2023-12-21 Elizaveta Kuznetsova , Mykola Makhortykh , Victoria Vziatysheva , Martha Stolze , Ani Baghumyan , Aleksandra Urman

ChatGPT has garnered significant interest due to its impressive performance; however, there is growing concern about its potential risks, particularly in the detection of AI-generated content (AIGC), which is often challenging for untrained…

Computation and Language · Computer Science 2024-10-10 Zhenpeng Su , Xing Wu , Wei Zhou , Guangyuan Ma , Songlin Hu

The way users acquire information is undergoing a paradigm shift with the advent of ChatGPT. Unlike conventional search engines, ChatGPT retrieves knowledge from the model itself and generates answers for users. ChatGPT's impressive…

Cryptography and Security · Computer Science 2023-10-06 Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

ChatGPT, as a language model based on large-scale pre-training, has exerted a profound influence on the domain of machine translation. In ChatGPT, a "Prompt" refers to a segment of text or instruction employed to steer the model towards…

Computation and Language · Computer Science 2024-06-05 Hui Jiao , Bei Peng , Lu Zong , Xiaojun Zhang , Xinwei Li

ChatGPT and Bard are AI chatbots based on Large Language Models (LLM) that are slated to promise different applications in diverse areas. In education, these AI technologies have been tested for applications in assessment and teaching. In…

Computation and Language · Computer Science 2023-05-11 Abdolvahab Khademi

Column type annotation is the task of annotating the columns of a relational table with the semantic type of the values contained in each column. Column type annotation is an important pre-processing step for data search and data…

Computation and Language · Computer Science 2023-08-01 Keti Korini , Christian Bizer

Large Language Models (LLMs) have recently shown impressive abilities in handling various natural language-related tasks. Among different LLMs, current studies have assessed ChatGPT's superior performance across manifold tasks, especially…

Educational chatbots come with a promise of interactive and personalized learning experiences, yet their development has been limited by the restricted free interaction capabilities of available platforms and the difficulty of encoding…

Transportation equity is an interdisciplinary agenda that requires both transportation and social inputs. Traditionally, transportation equity information are sources from public libraries, conferences, televisions, social media, among…

Information Retrieval · Computer Science 2023-03-21 Boniphace Kutela , Shoujia Li , Subasish Das , Jinli Liu