中文
相关论文

相关论文: Testing the Reliability of ChatGPT for Text Annota…

200 篇论文

ChatGPT has recently gathered attention from the general public and academia as a tool that is able to generate plausible and human-sounding text answers to various questions. One potential use, or abuse, of ChatGPT is in answering various…

计算机与社会 · 计算机科学 2023-04-17 Sanjay Deshpande , Jakub Szefer

The emergence of ChatGPT has recently garnered significant attention from the computational linguistics community. To demonstrate its capabilities as a keyphrase generator, we conduct a preliminary evaluation of ChatGPT for the keyphrase…

计算与语言 · 计算机科学 2023-12-25 Mingyang Song , Haiyun Jiang , Shuming Shi , Songfang Yao , Shilong Lu , Yi Feng , Huafeng Liu , Liping Jing

The advent of ChatGPT, a large language model-powered chatbot, has prompted questions about its potential implications for traditional search engines. In this study, we investigate the differences in user behavior when employing search…

人工智能 · 计算机科学 2023-07-04 Ruiyun Xu , Yue Feng , Hailiang Chen

This study explores how generative artificial intelligence, specifically ChatGPT, can assist in the evaluation of laboratory reports in Experimental Physics. Two interaction modalities were implemented: an automated API-based evaluation and…

物理教育 · 物理学 2026-03-24 Marcos Abreu , Álvaro Suárez , Cecilia Stari , Arturo C. Marti

This study explores how generative artificial intelligence, specifically ChatGPT, can assist in the evaluation of laboratory reports in Experimental Physics. Two interaction modalities were implemented: an automated API-based evaluation and…

物理教育 · 物理学 2025-10-21 Marcos Abreu , Álvaro Suárez , Cecilia Stari , Arturo C. Marti

ChatGPT, a software seeking to simulate human conversational abilities, is attracting increasing attention. It is sometimes portrayed as a groundbreaking productivity aid, including for creative work. In this paper, we run an experiment to…

计算与语言 · 计算机科学 2023-09-08 Claudia Biancotti , Carolina Camassa

Large language models such as ChatGPT are increasingly explored in medical domains. However, the absence of standard guidelines for performance evaluation has led to methodological inconsistencies. This study aims to summarize the available…

统计方法学 · 统计学 2024-03-12 Qiuhong Wei , Zhengxiong Yao , Ying Cui , Bo Wei , Zhezhen Jin , Ximing Xu

In recent years, artificial intelligence has had a conspicuous growth in almost every aspect of life. One of the most applicable areas is security code review, in which a lot of AI-based tools and approaches have been proposed. Recently,…

密码学与安全 · 计算机科学 2023-08-29 Atieh Bakhshandeh , Abdalsamad Keramatfar , Amir Norouzi , Mohammad Mahdi Chekidehkhoun

This technical report explores the ability of ChatGPT in recognizing emotions from text, which can be the basis of various applications like interactive chatbots, data annotation, and mental health analysis. While prior research has shown…

机器人学 · 计算机科学 2023-12-05 Naoki Wake , Atsushi Kanehira , Kazuhiro Sasabuchi , Jun Takamatsu , Katsushi Ikeuchi

Is it possible accurately classify political relations within evolving event ontologies without extensive annotations? This study investigates zero-shot learning methods that use expert knowledge from existing annotation codebook, and…

计算与语言 · 计算机科学 2024-06-07 Yibo Hu , Erick Skorupa Parolin , Latifur Khan , Patrick T. Brandt , Javier Osorio , Vito J. D'Orazio

The large language based-model chatbot ChatGPT gained a lot of popularity since its launch and has been used in a wide range of situations. This research centers around a particular situation, when the ChatGPT is used to produce news that…

计算与语言 · 计算机科学 2023-10-26 Amanda Ferrari Iaquinta , Gustavo Voltani von Atzingen

Recently, ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries. Several prior studies have shown that ChatGPT attains remarkable generation ability compared with existing models.…

计算与语言 · 计算机科学 2023-03-03 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Dacheng Tao

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

计算与语言 · 计算机科学 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu

Software logs play an essential role in ensuring the reliability and maintainability of large-scale software systems, as they are often the sole source of runtime information. Log parsing, which converts raw log messages into structured…

软件工程 · 计算机科学 2023-08-22 Van-Hoang Le , Hongyu Zhang

Since its launch in November 2022, ChatGPT has had a transformative effect on education where students are using it to help with homework assignments and teachers are actively employing it in their teaching practices. This includes using…

计算与语言 · 计算机科学 2023-10-11 Su-Youn Yoon , Eva Miszoglad , Lisa R. Pierce

This report provides a preliminary evaluation of ChatGPT for machine translation, including translation prompt, multilingual translation, and translation robustness. We adopt the prompts advised by ChatGPT to trigger its translation ability…

计算与语言 · 计算机科学 2023-11-03 Wenxiang Jiao , Wenxuan Wang , Jen-tse Huang , Xing Wang , Shuming Shi , Zhaopeng Tu

Collaborative problem solving (CPS) is widely recognized as a critical 21st-century skill. Assessing CPS depends heavily on coding the communication data using a construct-relevant framework, and this process has long been a major…

人机交互 · 计算机科学 2026-03-04 Jiangang Hao , Wenju Cui , Patrick Kyllonen , Emily Kerzabi , Lei Liu , Michael Flor

This study explores the problem solving capabilities of ChatGPT and its prospective applications in standardized test preparation, focusing on the GRE quantitative exam. Prior research has shown great potential for the utilization of…

计算机与社会 · 计算机科学 2023-09-27 Umer Farooq , Saira Anwar

The use of large language models like ChatGPT in code review offers promising efficiency gains but also raises concerns about correctness and safety. Existing evaluation methods for code review generation either rely on automatic…

软件工程 · 计算机科学 2025-12-18 Robert Heumüller , Frank Ortmeier