English
Related papers

Related papers: Integrating Large Language Models and Evaluating S…

200 papers

The advent of ChatGPT by OpenAI has prompted extensive discourse on its potential implications for science and higher education. While the impact on education has been a primary focus, there is limited empirical research on the effects of…

Computers and Society · Computer Science 2023-06-19 Benedikt Fecher , Marcel Hebing , Melissa Laufer , Jörg Pohle , Fabian Sofsky

Generative AI increasingly supports educational design tasks, e.g., through Large Language Models (LLMs), demonstrating the capability to design assessment questions that are aligned with pedagogical frameworks (e.g., Bloom's taxonomy).…

Artificial Intelligence · Computer Science 2026-05-15 Chris Davis Jaldi , Anmol Saini , Shan Zhang , Noah Schroeder , Cogan Shimizu , Eleni Ilkou

Over the last year, the ascent of Generative AI (GenAI) has raised concerns about its impact on core skill development, such as problem-solving and algorithmic thinking, in Computer Science students. Preliminary anonymous surveys show that…

Computers and Society · Computer Science 2024-09-23 Ethan Dickey , Andres Bejarano , Chirayu Garg

Large Language Models (LLMs) have made significant strides in natural language processing and are increasingly being integrated into recommendation systems. However, their potential in educational recommendation systems has yet to be fully…

Information Retrieval · Computer Science 2025-04-14 Boxuan Ma , Md Akib Zabed Khan , Tianyuan Yang , Agoritsa Polyzou , Shin'ichi Konomi

Background: Cheating in university education is commonly described as context dependent and influenced by assessment design, institutional norms, and student interpretation. In software engineering education, programming oriented coursework…

Computers and Society · Computer Science 2026-03-20 Ronnie de Souza Santos , Italo Santos , Mariana Bento , Giuseppe Destefanis , Cleyton Magalhães , Mairieli Wessel

Identifying logical errors in complex, incomplete or even contradictory and overall heterogeneous data like students' experimentation protocols is challenging. Recognizing the limitations of current evaluation methods, we investigate the…

Artificial Intelligence · Computer Science 2024-09-20 Arne Bewersdorff , Kathrin Seßler , Armin Baur , Enkelejda Kasneci , Claudia Nerdel

The growing enrollments in computer science courses and increase in class sizes necessitate scalable, automated tutoring solutions to adequately support student learning. While Large Language Models (LLMs) like GPT-4 have demonstrated…

Computers and Society · Computer Science 2024-07-31 Ty Feng , Sa Liu , Dipak Ghosal

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective…

Computation and Language · Computer Science 2025-06-06 Junior Cedric Tonga , KV Aditya Srivatsa , Kaushal Kumar Maurya , Fajri Koto , Ekaterina Kochmar

This perspective paper proposes a series of interactive scenarios that utilize Artificial Intelligence (AI) to enhance classroom teaching, such as dialogue auto-completion, knowledge and style transfer, and assessment of AI-generated…

Artificial Intelligence · Computer Science 2023-06-13 Kehui Tan , Tianqi Pang , Chenyou Fan , Song Yu

The widespread availability of generative artificial intelligence (GenAI) has created a pressing challenge in computer science (CS) education: how to incorporate powerful AI tools into programming coursework without undermining student…

Computers and Society · Computer Science 2026-01-27 Chan-Jin Chung

Generative Artificial Intelligence (GAI) can be seen as a double-edged weapon in education. Indeed, it may provide personalized, interactive and empowering pedagogical sequences that could favor students' intrinsic motivation, active…

Computers and Society · Computer Science 2023-11-13 Rania Abdelghani , Hélène Sauzéon , Pierre-Yves Oudeyer

Manual grading of programming assignments in introductory computer science courses can be time-consuming and prone to inconsistencies. While unit testing is commonly used for automatic evaluation, it typically follows a binary pass/fail…

Software Engineering · Computer Science 2025-11-20 Ahmad Memon , Abdallah Mohamed

Large Language Models (LLMs) are rapidly becoming integral to a wide range of tools, tasks, and problem-solving processes, especially in software development. Originally designed for natural language processing tasks such as text…

Human-Computer Interaction · Computer Science 2025-04-25 Prashant Chandrasekar , Mariel Couvillion , Ayshwarya Saktheeswaran , Jessica Zeitz

The ability to comprehend code has long been recognized as an essential skill in software engineering. As programmers lean more heavily on generative artificial intelligence (GenAI) assistants to develop code solutions, it is becoming…

Software Engineering · Computer Science 2025-12-17 Yunhan Qiao , Md Istiak Hossain Shihab , Christopher Hundhausen

The rise of generative large language models (LLMs) has opened new opportunities for automating knowledge representation through concept maps, a long-standing pedagogical tool valued for fostering meaningful learning and higher-order…

Computers and Society · Computer Science 2025-09-19 Xiaoming Zhai

Computer Science (CS) departments often serve large student populations, making timely academic monitoring and personalized feedback difficult. While the recommended counselor-to-student ratio is 250:1, it often exceeds 350:1 in practice,…

Computers and Society · Computer Science 2025-12-24 Samuel Jacob Chacko , An-I Andy Wang , Lara Perez-Felkner , Sonia Haiduc , David Whalley , Xiuwen Liu

This tutorial addresses the challenge of incorporating large language models (LLMs), such as ChatGPT, in a data analytics class. It details several new in-class and out-of-class teaching techniques enabled by AI. For example, instructors…

Computers and Society · Computer Science 2024-11-13 Robert L. Bray

Personalized chatbot-based teaching assistants can be crucial in addressing increasing classroom sizes, especially where direct teacher presence is limited. Large language models (LLMs) offer a promising avenue, with increasing research…

Human-Computer Interaction · Computer Science 2024-08-21 Harsh Kumar , Ilya Musabirov , Mohi Reza , Jiakai Shi , Xinyuan Wang , Joseph Jay Williams , Anastasia Kuzminykh , Michael Liut

Reasoning about code and explaining its purpose are fundamental skills for computer scientists. There has been extensive research in the field of computing education on the relationship between a student's ability to explain code and other…

Computers and Society · Computer Science 2024-04-03 Juho Leinonen , Paul Denny , Stephen MacNeil , Sami Sarsa , Seth Bernstein , Joanne Kim , Andrew Tran , Arto Hellas

Large language models (LLMs) are quickly being adopted in a wide range of learning experiences, especially via ubiquitous and broadly accessible chat interfaces like ChatGPT and Copilot. This type of interface is readily available to…

Computers and Society · Computer Science 2025-07-16 Allen Nie , Yash Chandak , Miroslav Suzara , Ali Malik , Juliette Woodrow , Matt Peng , Mehran Sahami , Emma Brunskill , Chris Piech