English
Related papers

Related papers: ChatGPT Incorrectness Detection in Software Review…

200 papers

ChatGPT is a large language model recently released by the OpenAI company. In this technical report, we explore for the first time the capability of ChatGPT for programming numerical algorithms. Specifically, we examine the capability of…

Machine Learning · Computer Science 2023-04-28 Ali Kashefi , Tapan Mukerji

The capability of Large Language Models (LLMs) like ChatGPT to comprehend user intent and provide reasonable responses has made them extremely popular lately. In this paper, we focus on assessing the overall ability of ChatGPT using 7…

Computation and Language · Computer Science 2023-04-25 Bo Li , Gexiang Fang , Yang Yang , Quansen Wang , Wei Ye , Wen Zhao , Shikun Zhang

A comparison between three chatbots which are based on large language models, namely ChatGPT-3.5, ChatGPT-4 and Google Bard is presented, focusing on their ability to give correct answers to mathematics and logic problems. In particular, we…

Computation and Language · Computer Science 2025-01-28 Vagelis Plevris , George Papazafeiropoulos , Alejandro Jiménez Rios

Large language models (LLMs) such as ChatGPT are increasingly being used for various use cases, including text content generation at scale. Although detection methods for such AI-generated text exist already, we investigate ChatGPT's…

Computation and Language · Computer Science 2023-08-21 Amrita Bhattacharjee , Huan Liu

The new capabilities of generative artificial intelligence tools Generative AI, such as ChatGPT, allow users to interact with the system in intuitive ways, such as simple conversations, and receive (mostly) good-quality answers. These…

Human-Computer Interaction · Computer Science 2024-10-14 Matin Amoozadeh , Daye Nam , Daniel Prol , Ali Alfageeh , James Prather , Michael Hilton , Sruti Srinivasa Ragavan , Mohammad Amin Alipour

This research aims to take advantage of artificial intelligence techniques in producing students assessment that is compatible with the different academic accreditations of the same program. The possibility of using generative artificial…

Computers and Society · Computer Science 2023-12-04 Rania Anwar Aboalela

Advancements in Artificial Intelligence, particularly with ChatGPT, have significantly impacted software development. Utilizing novel data from GitHub Innovation Graph, we hypothesize that ChatGPT enhances software production efficiency.…

Software Engineering · Computer Science 2024-06-18 Alexander Quispe , Rodrigo Grijalba

Recent advances in generative pre-trained transformer large language models have emphasised the potential risks of unfair use of artificial intelligence (AI) generated content in an academic environment and intensified efforts in searching…

Chatbots are software typically embedded in Web and Mobile applications designed to assist the user in a plethora of activities, from chit-chatting to task completion. They enable diverse forms of interactions, like text and voice commands.…

Software Engineering · Computer Science 2025-03-10 Rocco Gianni Rapisarda , Davide Ginelli , Diego Clerissi , Leonardo Mariani

This paper explores and assesses in what ways generative AI can assist in translating survey instruments. Writing effective survey questions is a challenging and complex task, made even more difficult for surveys that will be translated and…

Computation and Language · Computer Science 2025-01-13 Erica Ann Metheney , Lauren Yehle

Generative AI models continue to become more powerful. The launch of ChatGPT in November 2022 has ushered in a new era of AI. ChatGPT and other similar chatbots have a range of capabilities, from answering student homework questions to…

Computers and Society · Computer Science 2023-06-14 Yanchen Wang , Lisa Singh

Research suggests that providing specific and timely feedback to human tutors enhances their performance. However, it presents challenges due to the time-consuming nature of assessing tutor performance by human evaluators. Large language…

Computation and Language · Computer Science 2023-07-06 Dollaya Hirunyasiri , Danielle R. Thomas , Jionghao Lin , Kenneth R. Koedinger , Vincent Aleven

One critical issue for chat systems is to stay consistent about preferences, opinions, beliefs and facts of itself, which has been shown a difficult problem. In this work, we study methods to assess and bolster utterance consistency of chat…

Computation and Language · Computer Science 2024-01-22 Mian Zhang , Lifeng Jin , Linfeng Song , Haitao Mi , Dong Yu

The fundamental principles, potential applications, and ethical concerns of ChatGPT are analyzed and discussed in this study. Since ChatGPT emerged, it has gained a rapidly growing popularity, with more than 600 million users today. The…

Other Computer Science · Computer Science 2023-08-15 Ioannis D. Apostolopoulos , Mpesi Tzani , Sokratis I. Aznaouridis

Conversational AI, such as ChatGPT, is increasingly used for information seeking. However, little is known about how ordinary users actually prompt and how ChatGPT adapts its responses in real-world conversational information seeking (CIS).…

Human-Computer Interaction · Computer Science 2026-04-22 Haoning Xue , Yoo Jung Oh , Xinyi Zhou , Xinyu Zhang , Berit Oxley

This paper presents a comprehensive evaluation of the code generation capabilities of ChatGPT, a prominent large language model, compared to human programmers. A novel dataset of 131 code-generation prompts across 5 categories was curated…

Software Engineering · Computer Science 2023-11-07 Muhammad Fawad Akbar Khan , Max Ramsdell , Erik Falor , Hamid Karimi

Stack Overflow is a popular Q&A platform where users ask technical questions and receive answers from a community of experts. Recently, there has been a significant increase in the number of answers generated by ChatGPT, which can lead to…

Software Engineering · Computer Science 2026-02-05 Suyu Ma , Chunyang Chen , Hourieh Khalajzadeh , John Grundy

With the launch of ChatGPT, serious concerns have reasonably been raised of its ill-effect on the integrity of remote take-home exams. By way of mitigating the concern, in this study, a rather straightforward Artificial-Intelligence…

Physics Education · Physics 2023-06-06 P G Kubendran Amos

In recent times, large language models (LLMs) have made significant strides in generating computer code, blurring the lines between code created by humans and code produced by artificial intelligence (AI). As these technologies evolve…

Machine Learning · Computer Science 2024-07-04 Marc Oedingen , Raphael C. Engelhardt , Robin Denz , Maximilian Hammer , Wolfgang Konen

This study explores the integration and impact of ChatGPT, a generative AI that utilizes natural language processing, in an educational environment. The main goal is to evaluate how ChatGPT affects project performance. To this end, we…

Computers and Society · Computer Science 2024-09-09 Sunhee Hwang , Yudoo Kim , Heejin Lee