English
Related papers

Related papers: Evaluating the Effectiveness of Large Language Mod…

200 papers

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

The evolving pedagogy paradigms are leading toward educational transformations. One fundamental aspect of effective learning is relevant, immediate, and constructive feedback to students. Providing constructive feedback to large cohorts in…

Computers and Society · Computer Science 2025-10-14 Javed Ali Khan , Muhammad Yaqoob , Mamoona Tasadduq , Hafsa Shareef Dar , Aitezaz Ahsan

This study explores the application of Large Language Models (LLMs), specifically GPT-4, in the analysis of classroom dialogue, a crucial research task for both teaching diagnosis and quality improvement. Recognizing the knowledge-intensive…

Computation and Language · Computer Science 2024-10-08 Yun Long , Haifeng Luo , Yu Zhang

The widespread availability of large language models (LLMs) has changed how students engage with coding and problem-solving. While these tools may increase student productivity, they also make it more difficult for instructors to assess…

Software Engineering · Computer Science 2026-01-23 Yufan Zhang , Jaromir Savelka , Seth Copen Goldstein , Michael Conway

This study investigates the efficacy of large language models (LLMs) as tools for grading master-level student essays. Utilizing a sample of 60 essays in political science, the study compares the accuracy of grades suggested by the GPT-4…

General Economics · Economics 2024-06-25 Magnus Lundgren

Background: Log messages provide valuable information about the status of software systems. This information is provided in an unstructured fashion and automated approaches are applied to extract relevant parameters. To ease this process,…

Software Engineering · Computer Science 2024-09-05 Merve Astekin , Max Hort , Leon Moonen

The disruptive technology provided by large-scale pre-trained language models (LLMs) such as ChatGPT or GPT-4 has received significant attention in several application domains, often with an emphasis on high-level opportunities and…

Human-Computer Interaction · Computer Science 2023-06-27 Philippe J. Giabbanelli

Large language models (LLMs) are now accessible to anyone with a computer, a web browser, and an internet connection via browser-based interfaces, shifting the dynamics of participation in AI development. This article examines how…

Human-Computer Interaction · Computer Science 2025-10-31 Ned Cooper , Alexandra Zafiroglu

Providing students with flexible and timely academic support is a challenge at most colleges and universities, leaving many students without help outside scheduled hours. Large language models (LLMs) are promising for bridging this gap, but…

Computers and Society · Computer Science 2025-09-12 Chang Liu , Loc Hoang , Andrew Stolman , Rene F. Kizilcec , Bo Wu

The adoption of Large Language Models (LLMs) for code generation in data science offers substantial potential for enhancing tasks such as data manipulation, statistical analysis, and visualization. However, the effectiveness of these models…

Software Engineering · Computer Science 2024-11-20 Nathalia Nascimento , Everton Guimaraes , Sai Sanjna Chintakunta , Santhosh Anitha Boominathan

Large Language Model (LLM) assistants, such as ChatGPT, have emerged as potential alternatives to search methods for helping users navigate complex, feature-rich software. LLMs use vast training data from domain-specific texts, software…

Human-Computer Interaction · Computer Science 2024-02-14 Anjali Khurana , Hari Subramonyam , Parmit K Chilana

Achieving consensus in group decision-making often involves overcoming significant challenges, particularly in reconciling diverse perspectives and mitigating biases that hinder agreement. Traditional methods relying on human facilitators…

Human-Computer Interaction · Computer Science 2025-03-21 Loukas Triantafyllopoulos , Dimitris Kalles

Large Language Models (LLMs) such as ChatGPT have quickly become part of student programmers' toolkits, whether allowed by instructors or not. This paper examines how introductory programming (CS1) students integrate LLMs into their…

Human-Computer Interaction · Computer Science 2025-10-07 Jade Hak , Nathaniel Lam Johnson , Matin Amoozadeh , Amin Alipour , Souti Chattopadhyay

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

The application of Large Language Models (LLMs) is growing in the productive completion of Software Engineering tasks. Yet, studies investigating the productive prompting techniques often employed a limited problem space, primarily focusing…

Software Engineering · Computer Science 2025-08-07 Sangwon Hyun , Hyunjun Kim , Jinhyuk Jang , Hyojin Choi , M. Ali Babar

This study investigates the capacity of Large Language Models (LLMs) to infer the Big Five personality traits from free-form user interactions. The results demonstrate that a chatbot powered by GPT-4 can infer personality with moderate…

Human-Computer Interaction · Computer Science 2024-05-24 Heinrich Peters , Moran Cerf , Sandra C. Matz

Large language models (LLMs) have recently been applied in software engineering to perform tasks such as translating code between programming languages, generating code from natural language, and autocompleting code as it is being written.…

Human-Computer Interaction · Computer Science 2023-02-15 Steven I. Ross , Fernando Martinez , Stephanie Houde , Michael Muller , Justin D. Weisz

Large language models have not only captivated the public imagination but have also sparked a profound rethinking of how we learn. In the third year following the breakthrough launch of ChatGPT, everyday informal learning has been…

Human-Computer Interaction · Computer Science 2025-06-16 Nađa Terzimehić , Babette Bühler , Enkelejda Kasneci

Large Language Models (LLMs) are increasingly explored for educational tasks such as grading, yet their alignment with human evaluation in real classrooms remains underexamined. In this study, we investigate the feasibility of using an LLM…

Computation and Language · Computer Science 2025-11-19 Grace Byun , Swati Rajwal , Jinho D. Choi

The development of large language models (LLMs) capable of following instructions and engaging in conversational interactions sparked increased interest in their utilization across various support tools. We investigate the utility of modern…

Human-Computer Interaction · Computer Science 2024-01-31 Tuhin Chakrabarty , Vishakh Padmakumar , Faeze Brahman , Smaranda Muresan