中文
相关论文

相关论文: Testing the Reliability of ChatGPT for Text Annota…

200 篇论文

This paper assesses the accuracy, reliability and bias of the Large Language Model (LLM) ChatGPT-4 on the text analysis task of classifying the political affiliation of a Twitter poster based on the content of a tweet. The LLM is compared…

计算与语言 · 计算机科学 2023-04-14 Petter Törnberg

This paper introduces a method for detecting inappropriately targeting language in online conversations by integrating crowd and expert annotations with ChatGPT. We focus on English conversation threads from Reddit, examining comments that…

计算与语言 · 计算机科学 2025-05-23 Baran Barbarestani , Isa Maks , Piek Vossen

Large pre-trained language models have exhibited unprecedented capabilities in producing high-quality text via prompting techniques. This fact introduces new possibilities for data collection and annotation, particularly in situations where…

计算与语言 · 计算机科学 2023-05-25 Tiziano Labruna , Sofia Brenna , Andrea Zaninello , Bernardo Magnini

We conducted a survey of 135 software engineering (SE) practitioners to understand how they use Generative AI-based chatbots like ChatGPT for SE tasks. We find that they want to use ChatGPT for SE tasks like software library selection but…

软件工程 · 计算机科学 2024-03-26 Minaoar Hossain Tanzil , Junaed Younus Khan , Gias Uddin

Sentiment analysis is a well-known natural language processing task that involves identifying the emotional tone or polarity of a given piece of text. With the growth of social media and other online platforms, sentiment analysis has become…

计算与语言 · 计算机科学 2023-07-03 Mohammad Belal , James She , Simon Wong

Harmful content is pervasive on social media, poisoning online communities and negatively impacting participation. A common approach to address this issue is to develop detection models that rely on human annotations. However, the tasks…

计算与语言 · 计算机科学 2024-04-29 Lingyao Li , Lizhou Fan , Shubham Atreja , Libby Hemphill

ChatGPT, an AI-based chatbot, was released to provide coherent and useful replies based on analysis of large volumes of data. In this article, leading scientists, researchers and engineers discuss the transformative effects of ChatGPT on…

Recently, the emergence of ChatGPT has attracted wide attention from the computational linguistics community. Many prior studies have shown that ChatGPT achieves remarkable performance on various NLP tasks in terms of automatic evaluation…

计算与语言 · 计算机科学 2023-10-25 Jiaan Wang , Yunlong Liang , Fandong Meng , Zengkui Sun , Haoxiang Shi , Zhixu Li , Jinan Xu , Jianfeng Qu , Jie Zhou

ChatGPT is one of the most popular language models which achieve amazing performance on various natural language tasks. Consequently, there is also an urgent need to detect the texts generated ChatGPT from human written. One of the…

计算与语言 · 计算机科学 2023-10-04 Han Xu , Jie Ren , Pengfei He , Shenglai Zeng , Yingqian Cui , Amy Liu , Hui Liu , Jiliang Tang

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

计算与语言 · 计算机科学 2023-08-21 Amrita Bhattacharjee , Huan Liu

This exploratory study investigates the potential of the artificial intelligence tool, ChatGPT, to support systems thinking (ST) in various subjects. Using both general and subject specific prompts, the study assesses the accuracy,…

人机交互 · 计算机科学 2023-07-27 Holger Arndt

This article presents a comparative analysis of the ability of two large language model (LLM)-based chatbots, ChatGPT and Bing Chat, recently rebranded to Microsoft Copilot, to detect veracity of political information. We use AI auditing…

ChatGPT has garnered significant interest due to its impressive performance; however, there is growing concern about its potential risks, particularly in the detection of AI-generated content (AIGC), which is often challenging for untrained…

计算与语言 · 计算机科学 2024-10-10 Zhenpeng Su , Xing Wu , Wei Zhou , Guangyuan Ma , Songlin Hu

The way users acquire information is undergoing a paradigm shift with the advent of ChatGPT. Unlike conventional search engines, ChatGPT retrieves knowledge from the model itself and generates answers for users. ChatGPT's impressive…

密码学与安全 · 计算机科学 2023-10-06 Xinyue Shen , Zeyuan Chen , Michael Backes , Yang Zhang

ChatGPT, as a language model based on large-scale pre-training, has exerted a profound influence on the domain of machine translation. In ChatGPT, a "Prompt" refers to a segment of text or instruction employed to steer the model towards…

计算与语言 · 计算机科学 2024-06-05 Hui Jiao , Bei Peng , Lu Zong , Xiaojun Zhang , Xinwei Li

ChatGPT and Bard are AI chatbots based on Large Language Models (LLM) that are slated to promise different applications in diverse areas. In education, these AI technologies have been tested for applications in assessment and teaching. In…

计算与语言 · 计算机科学 2023-05-11 Abdolvahab Khademi

Column type annotation is the task of annotating the columns of a relational table with the semantic type of the values contained in each column. Column type annotation is an important pre-processing step for data search and data…

计算与语言 · 计算机科学 2023-08-01 Keti Korini , Christian Bizer

Large Language Models (LLMs) have recently shown impressive abilities in handling various natural language-related tasks. Among different LLMs, current studies have assessed ChatGPT's superior performance across manifold tasks, especially…

Educational chatbots come with a promise of interactive and personalized learning experiences, yet their development has been limited by the restricted free interaction capabilities of available platforms and the difficulty of encoding…

Transportation equity is an interdisciplinary agenda that requires both transportation and social inputs. Traditionally, transportation equity information are sources from public libraries, conferences, televisions, social media, among…

信息检索 · 计算机科学 2023-03-21 Boniphace Kutela , Shoujia Li , Subasish Das , Jinli Liu