English
Related papers

Related papers: Evaluating LLM-Generated Q&A Test: a Student-Cente…

200 papers

In response to the increasing mental health challenges faced by college students, we sought to understand their perspectives on how AI applications, particularly Large Language Models (LLMs), can be leveraged to enhance their mental…

Human-Computer Interaction · Computer Science 2024-09-27 Owen Xingjian Zhang , Shuyao Zhou , Jiayi Geng , Yuhan Liu , Sunny Xun Liu

Research suggests that tutors should adopt a strategic approach when addressing math errors made by low-efficacy students. Rather than drawing direct attention to the error, tutors should guide the students to identify and correct their…

Human-Computer Interaction · Computer Science 2024-01-09 Sanjit Kakarla , Danielle Thomas , Jionghao Lin , Shivang Gupta , Kenneth R. Koedinger

As Artificial Intelligence (AI) becomes increasingly integrated into education, university students preparing for English language tests are frequently shifting between traditional search engines like Google and large language models (LLMs)…

Human-Computer Interaction · Computer Science 2026-02-18 Tarek Rahman , Md Shaharia Hossen , Mark Protik Mondol , Jannatun Noor Mukta

Large language models (LLMs) like GPT-4 show potential for scaling motivational interviewing (MI) in addiction care, but require systematic evaluation of therapeutic capabilities. We present a computational framework assessing…

Computation and Language · Computer Science 2025-05-26 Yinghui Huang , Yuxuan Jiang , Hui Liu , Yixin Cai , Weiqing Li , Xiangen Hu

The importance of managing feedback practices in higher education has been widely recognised, as they play a crucial role in enhancing teaching, learning, and assessment processes. In today's educational landscape, feedback practices are…

Computers and Society · Computer Science 2026-02-04 Daniele Agostini , Federica Picasso

The humanlike responses of large language models (LLMs) have prompted social scientists to investigate whether LLMs can be used to simulate human participants in experiments, opinion polls and surveys. Of central interest in this line of…

Computation and Language · Computer Science 2024-05-14 Nikolay B Petrov , Gregory Serapio-García , Jason Rentfrow

Using large language models (LLMs) to evaluate text quality has recently gained popularity. Some prior works explore the idea of using LLMs for evaluation, while they differ in some details of the evaluation process. In this paper, we…

Computation and Language · Computer Science 2023-10-10 Cheng-Han Chiang , Hung-yi Lee

Constructed-response questions are crucial to encourage generative processing and test a learner's understanding of core concepts. However, the limited availability of instructor time, large class sizes, and other resource constraints pose…

Computers and Society · Computer Science 2025-12-05 Shyam Agarwal , Ali Moghimi , Kevin C. Haudek

Artificial Intelligence (AI) technologies like ChatGPT now threaten bibliometrics as the primary generators of research quality indicators. They are already used in at least one research quality evaluation system and evidence suggests that…

Digital Libraries · Computer Science 2025-06-10 Mike Thelwall

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

Providing explainable and faithful feedback is crucial for automated student answer assessment. In this paper, we introduce a novel framework that explores using ChatGPT, a cutting-edge large language model, for the concurrent tasks of…

Computation and Language · Computer Science 2023-10-25 Jiazheng Li , Lin Gui , Yuxiang Zhou , David West , Cesare Aloisi , Yulan He

Systematic literature reviews (SLRs) are a cornerstone of academic research, yet they are often labour-intensive and time-consuming due to the detailed literature curation process. The advent of generative AI and large language models…

Information Retrieval · Computer Science 2024-11-25 Moritz Staudinger , Wojciech Kusa , Florina Piroi , Aldo Lipani , Allan Hanbury

Our work addresses the critical issue of distinguishing text generated by Large Language Models (LLMs) from human-produced text, a task essential for numerous applications. Despite ongoing debate about the feasibility of such…

Computation and Language · Computer Science 2023-10-04 Souradip Chakraborty , Amrit Singh Bedi , Sicheng Zhu , Bang An , Dinesh Manocha , Furong Huang

In this paper, we study how well humans can detect text generated by commercial LLMs (GPT-4o, Claude, o1). We hire annotators to read 300 non-fiction English articles, label them as either human-written or AI-generated, and provide…

Computation and Language · Computer Science 2025-05-21 Jenna Russell , Marzena Karpinska , Mohit Iyyer

Digital technologies are increasingly used in education to reduce the workload of teachers and students. However, creating open-ended study or examination questions and grading their answers is still a tedious task. This thesis presents the…

Computation and Language · Computer Science 2025-06-17 Gérôme Meyer , Philip Breuer

Large language models (LLMs) such as ChatGPT have demonstrated superior performance on a variety of natural language processing (NLP) tasks including sentiment analysis, mathematical reasoning and summarization. Furthermore, since these…

Computation and Language · Computer Science 2023-10-18 Shiyuan Huang , Siddarth Mamidanna , Shreedhar Jangam , Yilun Zhou , Leilani H. Gilpin

Generating unit tests is a crucial task in software development, demanding substantial time and effort from programmers. The advent of Large Language Models (LLMs) introduces a novel avenue for unit test script generation. This research…

Software Engineering · Computer Science 2024-02-14 Shreya Bhatia , Tarushi Gandhi , Dhruv Kumar , Pankaj Jalote

Student commitment towards a learning recommendation is not separable from their understanding of the reasons it was recommended to them; and their ability to modify it based on that understanding. Among explainability approaches, chatbots…

Artificial Intelligence · Computer Science 2024-01-25 Hasan Abu-Rasheed , Mohamad Hussam Abdulsalam , Christian Weber , Madjid Fathi

AI assistants are being increasingly used by students enrolled in higher education institutions. While these tools provide opportunities for improved teaching and education, they also pose significant challenges for assessment and learning…

Computers and Society · Computer Science 2024-11-28 Beatriz Borges , Negar Foroutan , Deniz Bayazit , Anna Sotnikova , Syrielle Montariol , Tanya Nazaretzky , Mohammadreza Banaei , Alireza Sakhaeirad , Philippe Servant , Seyed Parsa Neshaei , Jibril Frej , Angelika Romanou , Gail Weiss , Sepideh Mamooler , Zeming Chen , Simin Fan , Silin Gao , Mete Ismayilzada , Debjit Paul , Alexandre Schöpfer , Andrej Janchevski , Anja Tiede , Clarence Linden , Emanuele Troiani , Francesco Salvi , Freya Behrens , Giacomo Orsi , Giovanni Piccioli , Hadrien Sevel , Louis Coulon , Manuela Pineros-Rodriguez , Marin Bonnassies , Pierre Hellich , Puck van Gerwen , Sankalp Gambhir , Solal Pirelli , Thomas Blanchard , Timothée Callens , Toni Abi Aoun , Yannick Calvino Alonso , Yuri Cho , Alberto Chiappa , Antonio Sclocchi , Étienne Bruno , Florian Hofhammer , Gabriel Pescia , Geovani Rizk , Leello Dadi , Lucas Stoffl , Manoel Horta Ribeiro , Matthieu Bovel , Yueyang Pan , Aleksandra Radenovic , Alexandre Alahi , Alexander Mathis , Anne-Florence Bitbol , Boi Faltings , Cécile Hébert , Devis Tuia , François Maréchal , George Candea , Giuseppe Carleo , Jean-Cédric Chappelier , Nicolas Flammarion , Jean-Marie Fürbringer , Jean-Philippe Pellet , Karl Aberer , Lenka Zdeborová , Marcel Salathé , Martin Jaggi , Martin Rajman , Mathias Payer , Matthieu Wyart , Michael Gastpar , Michele Ceriotti , Ola Svensson , Olivier Lévêque , Paolo Ienne , Rachid Guerraoui , Robert West , Sanidhya Kashyap , Valerio Piazza , Viesturs Simanis , Viktor Kuncak , Volkan Cevher , Philippe Schwaller , Sacha Friedli , Patrick Jermann , Tanja Käser , Antoine Bosselut

Large Language Models (LLMs) have demonstrated exceptional capabilities in solving various tasks, progressively evolving into general-purpose assistants. The increasing integration of LLMs into society has sparked interest in whether they…

Computation and Language · Computer Science 2025-10-20 Yuan Li , Yue Huang , Hongyi Wang , Ying Cheng , Xiangliang Zhang , James Zou , Lichao Sun