English
Related papers

Related papers: Simulation as Reality? The Effectiveness of LLM-Ge…

200 papers

In the era of generative artificial intelligence (AI), the fusion of large language models (LLMs) offers unprecedented opportunities for innovation in the field of modern education. We embark on an exploration of prompted LLMs within the…

Computation and Language · Computer Science 2024-05-21 Subhankar Maity , Aniket Deroy , Sudeshna Sarkar

Data augmentation can mitigate limited training data in machine-learning automated scoring engines for constructed response items. This study seeks to determine how well three approaches to large language model prompting produce essays that…

Machine Learning · Computer Science 2026-02-09 Edward W. Wolfe , Justin O. Barber

The effect of large language models (LLMs) in education is debated: Previous research shows that LLMs can help as well as hurt learning. In two pre-registered and incentivized laboratory experiments, we find no effect of LLMs on overall…

Computers and Society · Computer Science 2025-03-11 Matthias Lehmann , Philipp B. Cornelius , Fabian J. Sting

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

Context: Manual qualitative data analysis is time-intensive and can compromise validity and replicability, affecting analysis design, implementation, and reporting. Large Language Models (LLMs) enable human-bot collaboration in Software…

Software Engineering · Computer Science 2025-10-14 Zeeshan Rasheed , Muhammad Waseem , Aakash Ahmad , Kai-Kristian Kemell , Wang Xiaofeng , Anh Nguyen Duc , Pekka Abrahamsson

Large language models (LLMs) are revolutionizing education, with LLM-based agents playing a key role in simulating student behavior. A major challenge in student simulation is modeling the diverse learning patterns of students at various…

Machine Learning · Computer Science 2025-08-12 Tao Wu , Jingyuan Chen , Wang Lin , Mengze Li , Yumeng Zhu , Ang Li , Kun Kuang , Fei Wu

Recent advances in large language model (LLM) training have highlighted the need for diverse, high-quality instruction data. Recently, many works are exploring synthetic data generation using LLMs. However, they primarily focus on prompt…

Computation and Language · Computer Science 2024-12-10 Yifang Chen , David Zhu , Simon Du , Kevin Jamieson , Yang Liu

The influence of Artificial Intelligence (AI), and specifically Large Language Models (LLM), on education is continuously increasing. These models are frequently used by students, giving rise to the question whether current forms of…

Human-Computer Interaction · Computer Science 2025-07-02 Patrick Stokkink

Machine learning heavily relies on data, but real-world applications often encounter various data-related issues. These include data of poor quality, insufficient data points leading to under-fitting of machine learning models, and…

Machine Learning · Computer Science 2025-04-07 Yingzhou Lu , Lulu Chen , Yuanyuan Zhang , Minjie Shen , Huazheng Wang , Xiao Wang , Capucine van Rechem , Tianfan Fu , Wenqi Wei

Survey research is a fundamental empirical method in software engineering, enabling the systematic collection of data on professional practices, perceptions, and experiences. However, recent advances in large language models (LLMs) have…

Software Engineering · Computer Science 2025-12-22 Ronnie de Souza Santos , Italo Santos , Maria Teresa Baldassarre , Cleyton Magalhaes , Mairieli Wessel

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

When Artificial Intelligence (AI) is used to replace consumers (e.g., synthetic data), it is often assumed that AI emulates established consumers, and more generally human behaviors. Ten experiments with Large Language Models (LLMs)…

Human-Computer Interaction · Computer Science 2025-10-10 Antonios Stamatogiannakis , Arsham Ghodsinia , Sepehr Etminanrad , Dilney Gonçalves , David Santos

The evaluation of machine learning models using human-labeled validation data can be expensive and time-consuming. AI-labeled synthetic data can be used to decrease the number of human annotations required for this purpose in a process…

Machine Learning · Computer Science 2024-05-29 Pierre Boyeau , Anastasios N. Angelopoulos , Nir Yosef , Jitendra Malik , Michael I. Jordan

The impressive capabilities of Large Language Models (LLMs) raise the possibility that synthetic agents can serve as substitutes for real participants in human-subject research. To evaluate this claim, prior research has largely focused on…

Artificial Intelligence · Computer Science 2026-05-11 James Mooney , Josef Woldense , Zheng Robert Jia , Shirley Anugrah Hayati , My Ha Nguyen , Vipul Raheja , Dongyeop Kang

The use of large language models (LLMs) to simulate human behavior has gained significant attention, particularly through personas that approximate individual characteristics. Persona-based simulations hold promise for transforming…

Computation and Language · Computer Science 2025-03-24 Ang Li , Haozhe Chen , Hongseok Namkoong , Tianyi Peng

The field of Artificial Intelligence in Education (AIED) focuses on the intersection of technology, education, and psychology, placing a strong emphasis on supporting learners' needs with compassion and understanding. The growing prominence…

Human-Computer Interaction · Computer Science 2024-05-14 John Stamper , Ruiwei Xiao , Xinying Hou

Recent studies have shown that Large Language Models (LLMs) struggle to accurately retrieve information and maintain reasoning capabilities when processing long-context inputs. To address these limitations, we propose a finetuning approach…

Machine Learning · Computer Science 2024-10-15 Zheyang Xiong , Vasilis Papageorgiou , Kangwook Lee , Dimitris Papailiopoulos

Large Action Models (LAMs) for AI Agents offer incredible potential but face challenges due to the need for high-quality training data, especially for multi-steps tasks that involve planning, executing tool calls, and responding to…

Large Language Models (LLMs) have demonstrated remarkable multilingual capabilities, making them promising tools in both high- and low-resource languages. One particularly valuable use case is generating synthetic samples that can be used…

Computation and Language · Computer Science 2026-01-26 Branislav Pecher , Jan Cegin , Robert Belanec , Ivan Srba , Jakub Simko , Maria Bielikova

Large, human-annotated datasets are central to the development of natural language processing models. Collecting these datasets can be the most challenging part of the development process. We address this problem by introducing a general…

Computation and Language · Computer Science 2020-04-29 Alana Marzoev , Samuel Madden , M. Frans Kaashoek , Michael Cafarella , Jacob Andreas