English
Related papers

Related papers: Next-Step Hint Generation for Introductory Program…

200 papers

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

This paper assesses the potential for large language models (LLMs) to serve as assistive tools in the creative writing process, by means of a single, in-depth case study. In the course of the study, we develop interactive and multi-voice…

Computation and Language · Computer Science 2023-12-08 Murray Shanahan , Catherine Clarke

Large Language Models (LLMs) are transforming how people find information, and many users turn nowadays to chatbots to obtain answers to their questions. Despite the instant access to abundant information that LLMs offer, it is still…

Computation and Language · Computer Science 2025-02-04 Jamshid Mozafari , Bhawna Piryani , Abdelrahman Abdallah , Adam Jatowt

This paper analyzes Large Language Models (LLMs) with regard to their programming exercise generation capabilities. Through a survey study, we defined the state of the art, extracted their strengths and weaknesses and finally proposed an…

Artificial Intelligence · Computer Science 2024-05-31 Eduard Frankford , Ingo Höhn , Clemens Sauerwein , Ruth Breu

Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension…

Computers and Society · Computer Science 2024-04-19 Teemu Lehtinen , Charles Koutcheme , Arto Hellas

Large language models (LLMs) have demonstrated remarkable performance across a wide array of NLP tasks. However, their efficacy is undermined by undesired and inconsistent behaviors, including hallucination, unfaithful reasoning, and toxic…

Computation and Language · Computer Science 2023-08-31 Liangming Pan , Michael Saxon , Wenda Xu , Deepak Nathani , Xinyi Wang , William Yang Wang

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

Research suggests that tutors should adopt a strategic approach when addressing math errors made by low-efficacy students. Rather than drawing direct attention to the error, tutors should guide the students to identify and correct their…

Human-Computer Interaction · Computer Science 2024-01-09 Sanjit Kakarla , Danielle Thomas , Jionghao Lin , Shivang Gupta , Kenneth R. Koedinger

The rapid emergence of Large Language Models (LLMs) presents both opportunities and challenges for programming education. While students increasingly use generative AI tools, direct access often hinders the learning process by providing…

Artificial Intelligence · Computer Science 2026-03-31 Thomas Van Mullem , Bart Mesuere , Peter Dawyndt

Large language models (LLMs) have shown great potential for the automatic generation of feedback in a wide range of computing contexts. However, concerns have been voiced around the privacy and ethical implications of sending student work…

Computation and Language · Computer Science 2024-05-09 Charles Koutcheme , Nicola Dainese , Sami Sarsa , Arto Hellas , Juho Leinonen , Paul Denny

Research has shown assistance can provide many benefits to novices lacking the mental models needed for problem solving in a new domain. However, varying approaches to assistance, such as subgoals and next-step hints, have been implemented…

Human-Computer Interaction · Computer Science 2021-02-12 Christa Cody , Mehak Maniktala , Nicholas Lytle , Min Chi , Tiffany Barnes

An advantage of Large Language Models (LLMs) is their contextualization capability - providing different responses based on student inputs like solution strategy or prior discussion, to potentially better engage students than standard…

With the proliferation of large language model (LLM) applications since 2022, their use in education has sparked both excitement and concern. Recent studies consistently highlight students' (mis)use of LLMs can hinder learning outcomes.…

Human-Computer Interaction · Computer Science 2025-07-01 Ruiwei Xiao , Xinying Hou , Runlong Ye , Majeed Kazemitabaar , Nicholas Diana , Michael Liut , John Stamper

The rapid development of Large Language Models (LLMs) opens up the possibility of using them as personal tutors. This has led to the development of several intelligent tutoring systems and learning assistants that use LLMs as back-ends with…

Emerging Technologies · Computer Science 2025-06-11 Sankalan Pal Chowdhury , Terry Jingchen Zhang , Donya Rooein , Dirk Hovy , Tanja Käser , Mrinmaya Sachan

Large language models (LLMs) enable system builders today to create competent NLP systems through prompting, where they only need to describe the task in natural language and provide a few examples. However, in other ways, LLMs are a step…

Computation and Language · Computer Science 2023-08-24 Vijay Viswanathan , Chenyang Zhao , Amanda Bertsch , Tongshuang Wu , Graham Neubig

Large Language Models (LLMs) have shown considerable potential in automating decision logic within knowledge-intensive processes. However, their effectiveness largely depends on the strategy and quality of prompting. Since decision logic is…

Artificial Intelligence · Computer Science 2025-09-05 Shaghayegh Abedi , Amin Jalali

The dream of achieving a student-teacher ratio of 1:1 is closer than ever thanks to the emergence of large language models (LLMs). One potential application of these models in the educational field would be to provide feedback to students…

Computers and Society · Computer Science 2025-05-06 Marc Ballestero-Ribó , Daniel Ortiz-Martínez

Large Language Models (LLMs) represent a leap in artificial intelligence, excelling in tasks using human language(s). Although the main focus of general-purpose LLMs is not code generation, they have shown promising results in the domain.…

Software Engineering · Computer Science 2024-01-30 Sanka Rasnayaka , Guanlin Wang , Ridwan Shariffdeen , Ganesh Neelakanta Iyer

Providing students with flexible and timely academic support is a challenge at most colleges and universities, leaving many students without help outside scheduled hours. Large language models (LLMs) are promising for bridging this gap, but…

Computers and Society · Computer Science 2025-09-12 Chang Liu , Loc Hoang , Andrew Stolman , Rene F. Kizilcec , Bo Wu

Large Language Models (LLMs) have become part of how students solve programming tasks, offering immediate explanations and even full solutions. Previous work has highlighted that novice programmers often heavily rely on LLMs, thereby…

Computers and Society · Computer Science 2026-04-15 Iris Groher , Patrick Heissenberger , Michael Vierhauser