English
Related papers

Related papers: Amplifiers or Equalizers? A Longitudinal Study of …

200 papers

Following the rise of large language models (LLMs), many studies have emerged in recent years focusing on exploring the adoption of LLM-based tools for software development by novice developers: computer science/software engineering…

Software Engineering · Computer Science 2025-08-04 Samuel Ferino , Rashina Hoda , John Grundy , Christoph Treude

Background: Cheating in university education is commonly described as context dependent and influenced by assessment design, institutional norms, and student interpretation. In software engineering education, programming oriented coursework…

Computers and Society · Computer Science 2026-03-20 Ronnie de Souza Santos , Italo Santos , Mariana Bento , Giuseppe Destefanis , Cleyton Magalhães , Mairieli Wessel

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi

The adoption of Large Language Models (LLMs) across multiple contexts has sparked interest in understanding how scaling model size might lead to behavioral changes, as LLMs can exhibit behaviors not observed in their smaller counterparts.…

Software Engineering · Computer Science 2024-11-28 Conor O'Brien , Daniel Rodriguez-Cardenas , Alejandro Velasco , David N. Palacio , Denys Poshyvanyk

This paper investigates supervised fine-tuning of large language models (LLMs) to improve their pedagogical alignment in computing education, addressing concerns that LLMs may hinder learning outcomes. The project utilised a proprietary…

Computation and Language · Computer Science 2024-11-05 Alexandra Vassar , Jake Renzella , Emily Ross , Andrew Taylor

Assessing student's answers and in particular natural language answers is a crucial challenge in the field of education. Advances in machine learning, including transformer-based models such as Large Language Models(LLMs), have led to…

Computers and Society · Computer Science 2024-01-12 Priti Oli , Rabin Banjade , Jeevan Chapagain , Vasile Rus

Large language models (LLMs) can transform education, but their optimization for direct question-answering often undermines effective pedagogy which requires strategically withholding answers. To mitigate this, we propose an online…

Computation and Language · Computer Science 2025-10-14 David Dinucu-Jianu , Jakub Macina , Nico Daheim , Ido Hakimi , Iryna Gurevych , Mrinmaya Sachan

Large Language Models (LLMs) are increasingly used as proxy students in the development of Intelligent Tutoring Systems (ITSs) and in piloting test questions. However, to what extent these proxy students accurately emulate the behavior and…

Computation and Language · Computer Science 2025-07-14 KV Aditya Srivatsa , Kaushal Kumar Maurya , Ekaterina Kochmar

Large Language Models (LLMs) have demonstrated remarkable capabilities for reinforcement learning (RL) models, such as planning and reasoning capabilities. However, the problems of LLMs and RL model collaboration still need to be solved. In…

Computation and Language · Computer Science 2025-03-04 Shangding Gu

Worked examples are step-by-step solutions to problems in a specific domain, offered to students to acquire domain-specific problem-solving skills. The effectiveness of worked examples could be enhanced by combining them with…

Human-Computer Interaction · Computer Science 2026-05-22 Arun-Balajiee Lekshmi-Narayanan , Mohammad Hassany , Peter Brusilovsky

Online education platforms, leveraging the internet to distribute education resources, seek to provide convenient education but often fall short in real-time communication with students. They often struggle to address the diverse obstacles…

Artificial Intelligence · Computer Science 2024-04-29 Qingyao Li , Lingyue Fu , Weiming Zhang , Xianyu Chen , Jingwei Yu , Wei Xia , Weinan Zhang , Ruiming Tang , Yong Yu

The rapid advancement of large language models (LLMs) has inspired researchers to integrate them extensively into the academic workflow, potentially reshaping how research is practiced and reviewed. While previous studies highlight the…

Computation and Language · Computer Science 2025-10-15 Rui Li , Jia-Chen Gu , Po-Nien Kung , Heming Xia , Junfeng liu , Xiangwen Kong , Zhifang Sui , Nanyun Peng

Standardized math assessments require expensive human pilot studies to establish the difficulty of test items. We investigate the predictive value of open-source large language models (LLMs) for evaluating the difficulty of multiple-choice…

Computation and Language · Computer Science 2026-04-22 Christabel Acquaye , Yi Ting Huang , Marine Carpuat , Rachel Rudinger

The effectiveness of feedback in enhancing learning outcomes is well documented within Educational Data Mining (EDM). Various prior research has explored methodologies to enhance the effectiveness of feedback. Recent developments in Large…

Computers and Society · Computer Science 2024-11-15 Sami Baral , Eamon Worden , Wen-Chiang Lim , Zhuang Luo , Christopher Santorelli , Ashish Gurung , Neil Heffernan

To improve the performance of large language models (LLMs), researchers have explored providing LLMs with textual task-solving experience via prompts. However, they rely on manual efforts to acquire and apply such experience for each task,…

Computation and Language · Computer Science 2024-07-15 Jinglong Gao , Xiao Ding , Yiming Cui , Jianbai Zhao , Hepeng Wang , Ting Liu , Bing Qin

Large Language Models (LLMs) have shown much promise in powering a variety of software engineering (SE) tools. Offering natural language as an intuitive interaction mechanism, LLMs have recently been employed as conversational ``programming…

Software Engineering · Computer Science 2026-04-15 Jonan Richards

Large Language Models (LLMs) have demonstrated remarkable capabilities in software engineering, yet comprehensive benchmarks covering diverse SE activities remain limited. We present a multi-task evaluation of 11 state-of-the-art LLMs…

Software Engineering · Computer Science 2026-02-10 Go Frendi Gunawan , Mukhlis Amien

Large Language Models (LLMs) are rapidly becoming ubiquitous both as stand-alone tools and as components of current and future software systems. To enable usage of LLMs in the high-stake or safety-critical systems of 2030, they need to…

Software Engineering · Computer Science 2024-06-13 Sinclair Hudson , Sophia Jit , Boyue Caroline Hu , Marsha Chechik

Large Language Models (LLMs) are increasingly adopted in educational contexts to provide personalized support to students and teachers. The unprecedented capacity of LLM-based applications to understand and generate natural language can…

Computers and Society · Computer Science 2024-07-17 Jinsook Lee , Yann Hicke , Renzhe Yu , Christopher Brooks , René F. Kizilcec

Large Language Models (LLMs) are increasingly explored for educational tasks such as grading, yet their alignment with human evaluation in real classrooms remains underexamined. In this study, we investigate the feasibility of using an LLM…

Computation and Language · Computer Science 2025-11-19 Grace Byun , Swati Rajwal , Jinho D. Choi