English
Related papers

Related papers: Can ChatGPT Pass An Introductory Level Functional …

200 papers

The use of AI assistants, along with the challenges they present, has sparked significant debate within the community of computer science education. While these tools demonstrate the potential to support students' learning and instructors'…

Human-Computer Interaction · Computer Science 2023-11-14 Tianjia Wang , Daniel Vargas-Díaz , Chris Brown , Yan Chen

ChatGPT, a large-scale language model based on the advanced GPT-3.5 architecture, has shown remarkable potential in various Natural Language Processing (NLP) tasks. However, there is currently a dearth of comprehensive study exploring its…

Computation and Language · Computer Science 2023-04-05 Tao Fang , Shu Yang , Kaixin Lan , Derek F. Wong , Jinpeng Hu , Lidia S. Chao , Yue Zhang

Higher education scholars are interested in an artificial intelligence (AI) technology called ChatGPT, which was developed by OpenAI. Whether ChatGPT can improve learning is still a topic of debate among experts. This concise overview of…

Computers and Society · Computer Science 2024-03-29 Joshua Ebere Chukwuere

Code review is an essential activity for ensuring the quality and maintainability of software projects. However, it is a time-consuming and often error-prone task that can significantly impact the development process. Recently, ChatGPT, a…

Software Engineering · Computer Science 2023-09-18 Qi Guo , Junming Cao , Xiaofei Xie , Shangqing Liu , Xiaohong Li , Bihuan Chen , Xin Peng

The emergence of conversational natural language processing models presents a significant challenge for Higher Education. In this work, we use the entirety of a UK physics undergraduate (BSc with Honours) degree including all examinations…

Physics Education · Physics 2024-12-03 Kevin A. Pimbblet , Lesley J. Morrell

Generative AI technologies such as ChatGPT, Gemini, and MidJourney have made remarkable progress in recent years. Recent literature has documented ChatGPT's positive impact on productivity in areas where it has strong expertise,…

General Economics · Economics 2024-03-05 Voraprapa Nakavachara , Tanapong Potipiti , Thanee Chaiwat

Large Language Models (LLMs) have had considerable difficulty when prompted with mathematical questions, especially those within theory of computing (ToC) courses. In this paper, we detail two experiments regarding our own ToC course and…

Computers and Society · Computer Science 2024-07-11 Matei A. Golesteanu , Garrett B. Vowinkel , Ryan E. Dougherty

In recent years, advanced artificial intelligence technologies, such as ChatGPT, have significantly impacted various fields, including education and research. Developed by OpenAI, ChatGPT is a powerful language model that presents numerous…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Abu Saleh Musa Miah , Md Mahbubur Rahman Tusher , Md. Moazzem Hossain , Md Mamun Hossain , Md Abdur Rahim , Md Ekramul Hamid , Md. Saiful Islam , Jungpil Shin

The authors of this study aim to assess the capabilities of the OpenAI ChatGPT tool to understand just how effective such a system might be for students to utilize in their studies as well as deepen understanding of faculty/staff and…

Human-Computer Interaction · Computer Science 2024-08-31 Lance White , Trini Balart , Sara Amani , Kristi J. Shryock , Karan L. Watson

ChatGPT is a type of artificial intelligence language model that uses deep learning algorithms to generate human-like responses to text-based prompts. The introduction of the latest ChatGPT version in November of 2022 has caused shockwaves…

Computers and Society · Computer Science 2023-05-02 Mohammad Fraiwan , Natheer Khasawneh

This exploratory study investigates the potential of the artificial intelligence tool, ChatGPT, to support systems thinking (ST) in various subjects. Using both general and subject specific prompts, the study assesses the accuracy,…

Human-Computer Interaction · Computer Science 2023-07-27 Holger Arndt

Evaluating the capabilities of Large Language Models (LLMs) to assist teachers and students in educational tasks is receiving increasing attention. In this paper, we assess ChatGPT's capacities to solve and grade real programming exams,…

Artificial Intelligence · Computer Science 2025-03-21 Pablo Saborido-Fernández , Marcos Fernández-Pichel , David E. Losada

This study investigates the influence of ChatGPT, an AI-based language model, on student performance in a physics course. We conducted an experimental analysis with two cohorts of students in a second-semester engineering physics course.…

Physics Education · Physics 2023-12-06 Manuel G. Forero , H. J. Herrera-Suárez

The development of large language models (LLMs) such as ChatGPT has brought a lot of attention recently. However, their evaluation in the benchmark academic datasets remains under-explored due to the difficulty of evaluating the generative…

Computation and Language · Computer Science 2023-07-07 Md Tahmid Rahman Laskar , M Saiful Bari , Mizanur Rahman , Md Amran Hossen Bhuiyan , Shafiq Joty , Jimmy Xiangji Huang

This study evaluated the ability of ChatGPT, a recently developed artificial intelligence (AI) agent, to perform high-level cognitive tasks and produce text that is indistinguishable from human-generated text. This capacity raises concerns…

Artificial Intelligence · Computer Science 2022-12-20 Teo Susnjak

ChatGPT is a chatbot that can answer text prompts fairly accurately, even performing very well on postgraduate-level questions. Many educators have found that their take-home or remote tests and exams are vulnerable to ChatGPT-based…

Computation and Language · Computer Science 2024-02-26 Shanker Ram , Chen Qian

ChatGPT is a powerful language model from OpenAI that is arguably able to comprehend and generate text. ChatGPT is expected to have a large impact on society, research, and education. An essential step to understand ChatGPT's expected…

Human-Computer Interaction · Computer Science 2023-09-20 Lukas Schulze Balhorn , Jana M. Weber , Stefan Buijsman , Julian R. Hildebrandt , Martina Ziefle , Artur M. Schweidtmann

Large Language Models (LLMs) have taken the world by storm, and students are assumed to use related tools at a great scale. In this research paper we aim to gain an understanding of how introductory programming students chat with LLMs and…

Artificial Intelligence · Computer Science 2024-05-30 Andreas Scholl , Daniel Schiffner , Natalie Kiesler

Recently, the ChatGPT LLM has received great attention: it can be used as a bot for discussing source code, prompting it to suggest changes, provide descriptions or even generate code. Typical demonstrations generally focus on existing…

Software Engineering · Computer Science 2023-09-01 Haoye Tian , Weiqi Lu , Tsz On Li , Xunzhu Tang , Shing-Chi Cheung , Jacques Klein , Tegawendé F. Bissyandé

ChatGPT is a cutting-edge artificial intelligence language model developed by OpenAI, which has attracted a lot of attention due to its surprisingly strong ability in answering follow-up questions. In this report, we aim to evaluate ChatGPT…

Computation and Language · Computer Science 2023-03-27 Haoran Wu , Wenxuan Wang , Yuxuan Wan , Wenxiang Jiao , Michael Lyu