English
Related papers

Related papers: Can Generative Pre-trained Transformers (GPT) Pass…

200 papers

We present a new method for automatically providing feedback for introductory programming problems. In order to use this method, we need a reference implementation of the assignment, and an error model consisting of potential corrections to…

Programming Languages · Computer Science 2012-11-19 Rishabh Singh , Sumit Gulwani , Armando Solar-Lezama

Pre-trained language models have recently emerged as a powerful tool for fine-tuning a variety of language tasks. Ideally, when models are pre-trained on large amount of data, they are expected to gain implicit knowledge. In this paper, we…

Computation and Language · Computer Science 2023-06-22 Mohamad Ballout , Ulf Krumnack , Gunther Heidemann , Kai-Uwe Kühnberger

Large Language Models possess skills such as answering questions, writing essays or solving programming exercises. Since these models are easily accessible, researchers have investigated their capabilities and risks for programming…

Computers and Society · Computer Science 2023-12-19 Lianne Roest , Hieke Keuning , Johan Jeuring

Grading programming assignments is a labor-intensive and time-consuming process that demands careful evaluation across multiple dimensions of the code. To overcome these challenges, automated grading systems are leveraged to enhance…

Software Engineering · Computer Science 2025-03-28 Mohammad Akyash , Kimia Zamiri Azar , Hadi Mardani Kamali

Large Language Models (LLMs), such as GitHub Copilot and ChatGPT have become popular among programming students. Students use LLMs to assist them in programming courses, including generating source code. Previous work has evaluated the…

Artificial Intelligence · Computer Science 2025-04-22 Emir Catir , Robin Claesson , Rodothea Myrsini Tsoupidi

This research investigates the use of customized GPT models to enhance prompting proficiency among architecture students when generating AI-driven images. Prompt engineering is increasingly essential in architectural education due to the…

Human-Computer Interaction · Computer Science 2025-04-28 Juan David Salazar Rodriguez , Sam Conrad Joyce , Julfendi

Empirical software engineering research on production systems has brought forth a better understanding of the software engineering process for practitioners and researchers alike. However, only a small subset of production systems is…

Software Engineering · Computer Science 2024-06-21 Jenny T. Liang , Carmen Badea , Christian Bird , Robert DeLine , Denae Ford , Nicole Forsgren , Thomas Zimmermann

Large-scale pre-trained language models such as GPT-3 have shown remarkable performance across various natural language processing tasks. However, applying prompt-based methods with GPT-3 for Grammatical Error Correction (GEC) tasks and…

Computation and Language · Computer Science 2023-05-30 Mengsay Loem , Masahiro Kaneko , Sho Takase , Naoaki Okazaki

Generative AI (GAI) tools have seen rapid adoption in educational settings, yet their role in fostering critical thinking remains underexplored. While previous studies have examined GAI as a tutor for specific lessons or as a tool for…

Computers and Society · Computer Science 2025-09-10 W. F. Lamberti , S. R. Lawrence , D. White , S. Kim , S. Abdullah

GenAI has a potential to enhance the learning and teaching processes in engineering education. For instance, GenAI feedback on students' task performance can be effective depending on when such feedback is provided. However, little is known…

Computers and Society · Computer Science 2026-03-17 Kadir Kozan , Ozgur Keles , Sihan Jian , Serkan Ayvaz , Krzysztof Sierszecki , Sewon Joo

In mathematical proof education, there remains a need for interventions that help students learn to write mathematical proofs. Research has shown that timely feedback can be very helpful to students learning new skills. While for many years…

Artificial Intelligence · Computer Science 2025-07-15 Chenyan Zhao , Mariana Silva , Seth Poulsen

To complete an open-ended programming exercise, students need to both plan a high-level solution and implement it using the appropriate syntax. However, these problems are often autograded on the correctness of the final submission through…

Computation and Language · Computer Science 2025-04-15 Mehmet Arif Demirtaş , Claire Zheng , Max Fowler , Kathryn Cunningham

Recent advances in Natural Language Processing, and in particular on the construction of very large pre-trained language representation models, is opening up new perspectives on the construction of conversational information seeking (CIS)…

Computation and Language · Computer Science 2022-04-08 Patrizio Bellan , Mauro Dragoni , Chiara Ghidini

The impact of Large Language Models (LLMs) like GPT-3, GPT-4, and Bard in computer science (CS) education is expected to be profound. Students now have the power to generate code solutions for a wide array of programming assignments. For…

Computers and Society · Computer Science 2024-12-03 Pedro Alves , Bruno Pereira Cipriano

The integration of artificial intelligence tools such as ChatGPT in the education system has gained attention in recent years. This experience report explores students' perceptions and suggestions for integrating ChatGPT in a computer…

Computers and Society · Computer Science 2024-02-06 Kehinde Aruleba , Ismaila Temitayo Sanusi , George Obaido , Blessing Ogbuokiri

In this work, we present some recommendations on the evaluation of state-of-the-art generative models for constrained generation tasks. The progress on generative models has been rapid in recent years. These large-scale models have had…

Human-Computer Interaction · Computer Science 2022-12-02 Vikas Raunak , Matt Post , Arul Menezes

The rapid advancement of large language models, such as the Generative Pre-trained Transformer (GPT) series, has had significant implications across various disciplines. In this study, we investigate the potential of the state-of-the-art…

Computation and Language · Computer Science 2023-09-06 Yunhao Yang , Anshul Tomar

Research suggests that tutors should adopt a strategic approach when addressing math errors made by low-efficacy students. Rather than drawing direct attention to the error, tutors should guide the students to identify and correct their…

Human-Computer Interaction · Computer Science 2024-01-09 Sanjit Kakarla , Danielle Thomas , Jionghao Lin , Shivang Gupta , Kenneth R. Koedinger

Recent studies have highlighted the limitations of large language models in mathematical reasoning, particularly their inability to capture the underlying logic. Inspired by meta-learning, we propose that models should acquire not only…

Computation and Language · Computer Science 2024-12-19 Kejie Chen , Lin Wang , Qinghai Zhang , Renjun Xu

Generative AI has the potential to enhance education by providing personalized feedback to students at scale. Recent work has proposed techniques to improve AI-generated programming hints and has evaluated their performance based on…

Computers and Society · Computer Science 2025-09-04 Tung Phung , Mengyan Wu , Heeryung Choi , Gustavo Soares , Sumit Gulwani , Adish Singla , Christopher Brooks