English
Related papers

Related papers: Generative AI for Programming Education: Benchmark…

200 papers

In the era of exponential technology growth, one unexpected guest has claimed a seat in classrooms worldwide, Artificial Intelligence. Generative AI, such as ChatGPT, promises a revolution in education, yet it arrives with a double-edged…

Computers and Society · Computer Science 2024-05-20 Harris Bin Munawar , Nikolaos Misirlis

The increasing demand for programming language education and growing class sizes require immediate and personalized feedback. However, traditional code review methods have limitations in providing this level of feedback. As the capabilities…

Software Engineering · Computer Science 2025-06-23 Lee Dong-Kyu

We evaluated the capability of generative pre-trained transformers (GPT), to pass assessments in introductory and intermediate Python programming courses at the postsecondary level. Discussions of potential uses (e.g., exercise generation,…

Artificial Intelligence · Computer Science 2023-10-11 Jaromir Savelka , Arav Agarwal , Christopher Bogart , Yifan Song , Majd Sakr

Generative AI systems such as ChatGPT challenge traditional assumptions about academic assessment by enabling students to generate explanations, code, and solutions in real time. Rather than attempting to restrict AI use, this study…

Computers and Society · Computer Science 2026-05-13 Qusay H. Mahmoud

Over the past decade, predictive language modeling for code has proven to be a valuable tool for enabling new forms of automation for developers. More recently, we have seen the advent of general purpose "large language models", based on…

Software Engineering · Computer Science 2023-06-05 Sajed Jalil , Suzzana Rafi , Thomas D. LaToza , Kevin Moran , Wing Lam

This study evaluates the capabilities of ChatGPT versions 3.5 and 4 in generating code across a diverse range of programming languages. Our objective is to assess the effectiveness of these AI models for generating scientific programs. To…

Software Engineering · Computer Science 2025-05-13 Patrick Diehl , Noujoud Nader , Steve Brandt , Hartmut Kaiser

Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The…

The advent of large language models is reshaping computing education. Recent research has demonstrated that these models can produce better explanations than students, answer multiple-choice questions at or above the class average, and…

Computation and Language · Computer Science 2023-11-10 Irene Hou , Owen Man , Sophie Mettille , Sebastian Gutierrez , Kenneth Angelikas , Stephen MacNeil

We analyzed effectiveness of three generative pre-trained transformer (GPT) models in answering multiple-choice question (MCQ) assessments, often involving short snippets of code, from introductory and intermediate programming courses at…

Computation and Language · Computer Science 2023-03-15 Jaromir Savelka , Arav Agarwal , Christopher Bogart , Majd Sakr

Conversational Generative AI (convo-genAI) is revolutionizing Software Engineering (SE) as engineers and academics embrace this technology in their work. However, there is a gap in understanding the current potential and pitfalls of this…

Software Engineering · Computer Science 2024-03-06 Rudrajit Choudhuri , Dylan Liu , Igor Steinmacher , Marco Gerosa , Anita Sarma

This is the study that presents an AI-Python-based chatbot that helps students to learn programming by demonstrating solutions to such problems as debugging errors, solving syntax problems or converting abstract theoretical concepts to…

Software Engineering · Computer Science 2025-09-26 Sayed Mahbub Hasan Amiri , Md Mainul Islam

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

Computers and Society · Computer Science 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

This study explores the integration and impact of ChatGPT, a generative AI that utilizes natural language processing, in an educational environment. The main goal is to evaluate how ChatGPT affects project performance. To this end, we…

Computers and Society · Computer Science 2024-09-09 Sunhee Hwang , Yudoo Kim , Heejin Lee

Background: Recently, ChatGPT and similar generative AI models have attracted hundreds of millions of users and become part of the public discourse. Many believe that such models will disrupt society and will result in a significant change…

Computation and Language · Computer Science 2023-04-28 Steffen Herbold , Annette Hautli-Janisz , Ute Heuer , Zlata Kikteva , Alexander Trautsch

Generative Pre-trained Transformer 4 (GPT-4) is the fourth-generation language model in the GPT series, developed by OpenAI, which promises significant advancements in the field of natural language processing (NLP). In this research…

Computation and Language · Computer Science 2023-05-08 Jawid Ahmad Baktash , Mursal Dawodi

In the burgeoning field of artificial intelligence (AI), understanding the capabilities and limitations of programming-oriented models is crucial. This paper presents a novel evaluation of the programming proficiency of Generative…

Artificial Intelligence · Computer Science 2023-06-06 Zizhuo Zhang , Lian Wen , Shaoyang Zhang , David Chen , Yanfei Jiang

The integration of ChatGPT as a supportive tool in education, notably in programming courses, addresses the unique challenges of programming education by providing assistance with debugging, code generation, and explanations. Despite…

Computers and Society · Computer Science 2024-04-08 Boxaun Ma , Li Chen , Shin'ichi Konomi

Timely formative feedback is considered as one of the most important drivers for effective learning. Delivering timely and individualized feedback is particularly challenging in large classes in higher education. Recently Large Language…

Computers and Society · Computer Science 2023-12-15 Imen Azaiz , Oliver Deckarm , Sven Strickroth

ChatGPT, the most accessible generative artificial intelligence (AI) tool, offers considerable potential for veterinary medicine, yet a dedicated review of its specific applications is lacking. This review concisely synthesizes the latest…

Computers and Society · Computer Science 2024-05-24 Candice P. Chu