English
Related papers

Related papers: Generative AI alone may not be enough: Evaluating …

200 papers

The growing use of generative AI tools like ChatGPT has raised urgent concerns about their impact on student learning, particularly the potential erosion of critical thinking and creativity. As students increasingly turn to these tools to…

Computers and Society · Computer Science 2025-04-01 Muhammad Sajjad Akbar

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

The introduction of ChatGPT has fuelled a public debate on the use of generative AI (large language models; LLMs), including its use by researchers. In the current work, we test whether delegating parts of the research process to LLMs leads…

Human-Computer Interaction · Computer Science 2023-05-23 Paweł Niszczota , Paul Conway

Large Language Models (LLMs) like GPT and Bard are capable of producing code based on textual descriptions, with remarkable efficacy. Such technology will have profound implications for computing education, raising concerns about cheating,…

Emerging Technologies · Computer Science 2024-04-29 Bruno Pereira Cipriano , Pedro Alves

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

Providing rich, constructive feedback to students is essential for supporting and enhancing their learning. Recent advancements in Generative Artificial Intelligence (AI), particularly with large language models (LLMs), present new…

Computers and Society · Computer Science 2025-07-11 Euan D Lindsay , Mike Zhang , Aditya Johri , Johannes Bjerva

Behavioral analysis of tutoring dialogues is essential for understanding student learning, yet manual coding remains a bottleneck. We present a methodology where LLM coding agents autonomously improve the prompts used by LLM classifiers to…

Human-Computer Interaction · Computer Science 2026-03-31 Eason Chen , Isabel Wang , Nina Yuan , Sophia Judicke , Kayla Beigh , Xinyi Tang

This study investigates how LLMs, specifically GPT-3.5 and GPT-4, can develop tailored questions for Grade 9 math, aligning with active learning principles. By utilizing an iterative method, these models adjust questions based on difficulty…

Computation and Language · Computer Science 2024-06-21 Hamdireza Rouzegar , Masoud Makrehchi

The widespread availability of large language models (LLMs), such as ChatGPT, has significantly impacted education, raising both opportunities and challenges. Students can frequently interact with LLM-powered, interactive learning tools,…

Artificial Intelligence · Computer Science 2026-03-06 Hunter McNichols , Fareya Ikram , Andrew Lan

Artificial Intelligence has demonstrated its significance in software engineering through notable improvements in productivity, accuracy, collaboration, and learning outcomes. This study examines the impact of generative AI tools,…

Software Engineering · Computer Science 2024-02-23 Muhammad Waseem , Teerath Das , Aakash Ahmad , Peng Liang , Mahdi Fehmideh , Tommi Mikkonen

Caregivers (i.e., parents and members of a child's caring community) are underappreciated stakeholders in learning analytics. Although caregiver involvement can enhance student academic outcomes, many obstacles hinder involvement, most…

Human-Computer Interaction · Computer Science 2024-12-17 Devika Venugopalan , Ziwen Yan , Conrad Borchers , Jionghao Lin , Vincent Aleven

The landscape of software developer learning resources has continuously evolved, with recent trends favoring engaging formats like video tutorials. The emergence of Large Language Models (LLMs) like ChatGPT presents a new learning paradigm.…

Software Engineering · Computer Science 2024-10-14 Ahmad Tayeb , Mohammad D. Alahmadi , Elham Tajik , Sonia Haiduc

The effect of large language models (LLMs) in education is debated: Previous research shows that LLMs can help as well as hurt learning. In two pre-registered and incentivized laboratory experiments, we find no effect of LLMs on overall…

Computers and Society · Computer Science 2025-03-11 Matthias Lehmann , Philipp B. Cornelius , Fabian J. Sting

Users are increasingly being warned to check AI-generated content for correctness. Still, as LLMs (and other generative models) generate more complex output, such as summaries, tables, or code, it becomes harder for the user to audit or…

This paper presents a comprehensive investigation into the capability of Large Language Models (LLMs) to successfully complete a semester-long undergraduate control systems course. Through evaluation of 115 course deliverables, we assess…

Computers and Society · Computer Science 2025-05-19 Gokul Puthumanaillam , Timothy Bretl , Melkior Ornik

Effective prompt engineering is critical to realizing the promised productivity gains of large language models (LLMs) in knowledge-intensive tasks. Yet, many users struggle to craft prompts that yield high-quality outputs, limiting the…

Human-Computer Interaction · Computer Science 2025-10-02 Niklas Gutheil , Valentin Mayer , Leopold Müller , Jörg Rommelt , Niklas Kühl

Traditional end-of-quarter surveys often fail to provide instructors with timely, detailed, and actionable feedback about their teaching. In this paper, we explore how Large Language Model (LLM)-powered chatbots can reimagine the classroom…

Computers and Society · Computer Science 2025-08-19 Sai Siddartha Maram , Ulia Zaman , Magy Seif El-Nasr

With the continuous development of technological and educational innovation, learners nowadays can obtain a variety of support from agents such as teachers, peers, education technologies, and recently, generative artificial intelligence…

Artificial Intelligence · Computer Science 2024-12-13 Yizhou Fan , Luzhen Tang , Huixiao Le , Kejie Shen , Shufang Tan , Yueying Zhao , Yuan Shen , Xinyu Li , Dragan Gašević

In the rapidly evolving landscape of education, digital technologies have repeatedly disrupted traditional pedagogical methods. This paper explores the latest of these disruptions: the potential integration of large language models (LLMs)…

Computers and Society · Computer Science 2023-12-21 Mahyar Abedi , Ibrahem Alshybani , Muhammad Rubayat Bin Shahadat , Michael S. Murillo

While Large Language Models (LLMs) are increasingly envisioned as intelligent assistants for personalized learning, systematic head-to-head evaluations in authentic learning scenarios remain scarce. This study presents an empirical…

Artificial Intelligence · Computer Science 2025-10-23 Bo Yuan , Jiazi Hu