English
Related papers

Related papers: Chat-Based Support Alone May Not Be Enough: Compar…

200 papers

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

Robot systems in education can leverage Large language models' (LLMs) natural language understanding capabilities to provide assistance and facilitate learning. This paper proposes a multimodal interactive robot (PhysicsAssistant) built on…

Robotics · Computer Science 2024-06-05 Ehsan Latif , Ramviyas Parasuraman , Xiaoming Zhai

Generative AI tools such as ChatGPT now provide novice programmers with unprecedented access to instant, personalized support. While this holds clear promise, their influence on students' metacognitive processes remains underexplored.…

Human-Computer Interaction · Computer Science 2025-11-07 Boxuan Ma , Huiyong Li , Gen Li , Li Chen , Cheng Tang , Yinjie Xie , Chenghao Gu , Atsushi Shimada , Shin'ichi Konomi

This study compares the design practices and performance of ChatGPT 4.0, a large language model (LLM), against graduate engineering students in a 48-hour prototyping hackathon, based on a dataset comprising more than 100 prototypes. The LLM…

Human-Computer Interaction · Computer Science 2025-03-04 Daniel Nygård Ege , Henrik H. Øvrebø , Vegar Stubberud , Martin Francis Berg , Christer Elverum , Martin Steinert , Håvard Vestad

Teachers' growth mindset supportive language (GMSL)--rhetoric emphasizing that one's skills can be improved over time--has been shown to significantly reduce disparities in academic achievement and enhance students' learning outcomes.…

Computation and Language · Computer Science 2023-10-17 Kunal Handa , Margaret Clapper , Jessica Boyle , Rose E Wang , Diyi Yang , David S Yeager , Dorottya Demszky

This study evaluates the performance of Large Language Models (LLMs) as an Artificial Intelligence-based tutor for a university course. In particular, different advanced techniques are utilized, such as prompt engineering,…

The increasing reliance on Large Language Models (LLMs) across various domains extends to education, where students progressively use generative AI as a tool for learning. While prior work has examined LLMs' mathematical ability, their…

Computation and Language · Computer Science 2026-01-21 Wei-Ling Hsu , Yu-Chien Tang , An-Zi Yen

AI-based chatbots have the potential to accelerate learning and teaching, but may also have counterproductive consequences without thoughtful design and scaffolding. To better understand teachers' perspectives on large language model…

This paper describes the systems submitted by team6 for ChatEval, the DSTC 11 Track 4 competition. We present three different approaches to predicting turn-level qualities of chatbot responses based on large language models (LLMs). We…

Computation and Language · Computer Science 2023-08-15 Ondřej Plátek , Vojtěch Hudeček , Patricia Schmidtová , Mateusz Lango , Ondřej Dušek

Automated explanatory feedback systems play a crucial role in facilitating learning for a large cohort of learners by offering feedback that incorporates explanations, significantly enhancing the learning process. However, delivering such…

Computation and Language · Computer Science 2024-07-17 Jionghao Lin , Eason Chen , Zeifei Han , Ashish Gurung , Danielle R. Thomas , Wei Tan , Ngoc Dang Nguyen , Kenneth R. Koedinger

Problem solving plays an essential role in science education, and generative AI (GAI) chatbots have emerged as a promising tool for supporting students' science problem solving. However, general-purpose chatbots (e.g., ChatGPT), which often…

Social and Information Networks · Computer Science 2026-04-06 Hanyu Su , Huilin Zhang , Shihui Feng

Question answering systems are rapidly advancing, but their opaque nature may impact user trust. We explored trust through an anti-monitoring framework, where trust is predicted to be correlated with presence of citations and inversely…

Computation and Language · Computer Science 2025-01-03 Yifan Ding , Matthew Facciani , Amrit Poudel , Ellen Joyce , Salvador Aguinaga , Balaji Veeramani , Sanmitra Bhattacharya , Tim Weninger

E-learning environments are increasingly harnessing large language models (LLMs) like GPT-3.5 and GPT-4 for tailored educational support. This study introduces an approach that integrates dynamic knowledge graphs with LLMs to offer nuanced…

Artificial Intelligence · Computer Science 2024-12-06 Patrick Ocheja , Brendan Flanagan , Yiling Dai , Hiroaki Ogata

This paper explores the development and adoption of AI-based formative feedback in the context of biweekly reports in an engineering Capstone program. Each student is required to write a short report detailing their individual…

Computers and Society · Computer Science 2025-12-18 Tiago Fernandes Tavares , Luciano Pereira Soares

To improve the performance of large language models (LLMs), researchers have explored providing LLMs with textual task-solving experience via prompts. However, they rely on manual efforts to acquire and apply such experience for each task,…

Computation and Language · Computer Science 2024-07-15 Jinglong Gao , Xiao Ding , Yiming Cui , Jianbai Zhao , Hepeng Wang , Ting Liu , Bing Qin

Large language models (LLMs) like ChatGPT are increasingly used in academic writing, yet issues such as incorrect or fabricated references raise ethical concerns. Moreover, current content quality evaluations often rely on subjective human…

Computation and Language · Computer Science 2025-09-15 Jing Ren , Weiqi Wang

Artificial Intelligence has demonstrated its significance in software engineering through notable improvements in productivity, accuracy, collaboration, and learning outcomes. This study examines the impact of generative AI tools,…

Software Engineering · Computer Science 2024-02-23 Muhammad Waseem , Teerath Das , Aakash Ahmad , Peng Liang , Mahdi Fehmideh , Tommi Mikkonen

Intelligent tutoring systems have long enabled automated immediate feedback on student work when it is presented in a tightly structured format and when problems are very constrained, but reliably assessing free-form mathematical reasoning…

Computers and Society · Computer Science 2026-01-08 Aron Gohr , Marie-Amelie Lawn , Kevin Gao , Inigo Serjeant , Stephen Heslip

We explore the evolving efficacy of three generative pre-trained transformer (GPT) models in generating answers for multiple-choice questions (MCQ) from introductory and intermediate Python programming courses in higher education. We focus…

Computers and Society · Computer Science 2023-11-17 Jaromir Savelka , Arav Agarwal , Christopher Bogart , Majd Sakr

The proliferation of large language models (LLMs) in educational settings has paradoxically undermined the cognitive processes they purport to support. Students increasingly outsource critical thinking to AI assistants that generate…

Artificial Intelligence · Computer Science 2026-05-08 Ran Bi , Shiyao Wei , Yuanyiyi Zhou