English
Related papers

Related papers: LLM-Based Educational Simulation: Evaluating Tempo…

200 papers

Large language models (LLMs) that do not give consistent answers across contexts are problematic when used for tasks with expectations of consistency, e.g., question-answering, explanations, etc. Our work presents an evaluation benchmark…

Computation and Language · Computer Science 2023-10-23 Henning Bartsch , Ole Jorgensen , Domenic Rosati , Jason Hoelscher-Obermaier , Jacob Pfau

People are increasingly using technologies equipped with large language models (LLM) to write texts for formal communication, which raises two important questions at the intersection of technology and society: Who do LLMs write like (model…

Computation and Language · Computer Science 2026-01-23 Jinsook Lee , AJ Alvero , Thorsten Joachims , René Kizilcec

The tendency of users to anthropomorphise large language models (LLMs) is of growing interest to AI developers, researchers, and policy-makers. Here, we present a novel method for empirically evaluating anthropomorphic LLM behaviours in…

The development and popularization of large language models (LLMs) have raised concerns that they will be used to create tailor-made, convincing arguments to push false or misleading narratives online. Early work has found that language…

Computers and Society · Computer Science 2025-05-21 Francesco Salvi , Manoel Horta Ribeiro , Riccardo Gallotti , Robert West

Effective patient communication is pivotal in healthcare, yet traditional medical training often lacks exposure to diverse, challenging interpersonal dynamics. To bridge this gap, this study proposes the use of Large Language Models (LLMs)…

As large language models (LLMs) appear to behave increasingly human-like in text-based interactions, more and more researchers become interested in investigating personality in LLMs. However, the diversity of psychological personality…

Computation and Language · Computer Science 2024-06-26 Zhiyuan Wen , Yu Yang , Jiannong Cao , Haoming Sun , Ruosong Yang , Shuaiqi Liu

LLM fairness should be evaluated through in-situ conversational behavior rather than standardized-test Q&A benchmarks. We show that the standardized-test paradigm can be structurally unreliable: surface-level prompt construction choices,…

Computation and Language · Computer Science 2026-05-14 Zeyu Tang , Sang T. Truong , Deonna Owens , Shreyas Sharma , Yibo Jacky Zhang , Brando Miranda , Sanmi Koyejo

Large language models (LLMs) exhibit robust capabilities in text generation and comprehension, mimicking human behavior and exhibiting synthetic personalities. However, some LLMs have displayed offensive personality, propagating toxic…

Computation and Language · Computer Science 2024-06-10 Yanquan Chen , Zhen Wu , Junjie Guo , Shujian Huang , Xinyu Dai

Despite rapid advances in large language models (LLMs), their integration with traditional supervised machine learning (ML) techniques that have proven applicability to medical data remains underexplored. This is particularly true for…

Computation and Language · Computer Science 2025-05-28 Yuxin Zhu , Yuting Guo , Noah Marchuck , Abeed Sarker , Yun Wang

Large language models (LLMs) sometimes exhibit qualitative shifts in response style under sustained self-referential dialogue conditions (Berg et al., 2025). This study refers to this phenomenon as "transfer" and explores the application…

Computation and Language · Computer Science 2026-05-04 Minori Noguchi

This paper investigates the potentials of Large Language Models (LLMs) as adaptive tutors in the context of second-language learning. In particular, we evaluate whether system prompting can reliably constrain LLMs to generate only text…

Computation and Language · Computer Science 2025-06-10 Mina Almasi , Ross Deans Kristensen-McLachlan

Human cognition, driven by complex neurochemical processes, oscillates between imagination and reality and learns to self-correct whenever such subtle drifts lead to hallucinations or unsafe associations. In recent years, LLMs have…

Computation and Language · Computer Science 2026-01-09 Sharanya Dasgupta , Arkaprabha Basu , Sujoy Nath , Swagatam Das

Prevailing large language models (LLMs) are capable of human responses simulation through its unprecedented content generation and reasoning abilities. However, it is not clear whether and how to leverage LLMs to simulate field experiments.…

Artificial Intelligence · Computer Science 2024-08-20 Yaoyu Chen , Yuheng Hu , Yingda Lu

Deception is a pervasive feature of human communication and an emerging concern in large language models (LLMs). While recent studies document instances of LLM deception, most evaluations remain confined to single-turn prompts and fail to…

Computation and Language · Computer Science 2026-02-06 Yang Xu , Xuanming Zhang , Samuel Yeh , Jwala Dhamala , Ousmane Dia , Rahul Gupta , Sharon Li

As large language models (LLMs) are increasingly integrated into daily life, in roles ranging from high-stakes decision support to companionship, understanding their behavioral dispositions becomes critical. A growing literature uses…

Artificial Intelligence · Computer Science 2026-04-22 Valentin Kriegmair , Dirk U. Wulff

Despite the many use cases for large language models (LLMs) in creating personalized chatbots, there has been limited research on evaluating the extent to which the behaviors of personalized LLMs accurately and consistently reflect specific…

Computation and Language · Computer Science 2024-04-03 Hang Jiang , Xiajie Zhang , Xubo Cao , Cynthia Breazeal , Deb Roy , Jad Kabbara

This study investigates the reliability and validity of five advanced Large Language Models (LLMs), Claude 3.5, DeepSeek v2, Gemini 2.5, GPT-4, and Mistral 24B, for automated essay scoring in a real world higher education context. A total…

Computers and Society · Computer Science 2025-08-05 Andrea Gaggioli , Giuseppe Casaburi , Leonardo Ercolani , Francesco Collova' , Pietro Torre , Fabrizio Davide

Large Language Models (LLMs) have demonstrated remarkable human-like capabilities, yet their ability to replicate a specific individual remains under-explored. This paper presents a case study to investigate LLM-based individual simulation…

Computation and Language · Computer Science 2026-03-03 Minghao Guo , Ziyi Ye , Wujiang Xu , Xi Zhu , Wenyue Hua , Dimitris N. Metaxas

Personality manipulation in large language models (LLMs) is increasingly applied in customer service and agentic scenarios, yet its mechanisms and trade-offs remain unclear. We present a systematic study of personality control using the Big…

Computation and Language · Computer Science 2025-09-08 Gunmay Handa , Zekun Wu , Adriano Koshiyama , Philip Treleaven

Large Language Models (LLMs) often exhibit pronounced context-dependent variability that undermines predictable multi-agent behavior in tasks requiring strategic thinking. Focusing on models that range from 7 to 9 billion parameters in size…

Multiagent Systems · Computer Science 2026-02-09 Nunzio Lore , Babak Heydari