English
Related papers

Related papers: Personality Matters: User Traits Predict LLM Prefe…

200 papers

The rapid evolution of LLMs represents an impactful paradigm shift in digital interaction and content engagement. While they encode vast amounts of human-generated knowledge and excel in processing diverse data types, they often face the…

Human-Computer Interaction · Computer Science 2024-11-20 Anna Bodonhelyi , Efe Bozkir , Shuo Yang , Enkelejda Kasneci , Gjergji Kasneci

Automatic systems are increasingly used to assess the originality of responses in creative tasks. They offer a potential solution to key limitations of human assessment (cost, fatigue, and subjectivity), but there is preliminary evidence of…

Human-Computer Interaction · Computer Science 2026-04-24 Umberto Domanti , Moritz Mock , Sergio Agnoli , Antonella De Angeli

This study validates Large Language Models (LLMs) as a dynamic alternative to questionnaire-based personality assessment. Using a within-subjects experiment (N=33), we compared Big Five personality scores derived from guided LLM…

Computation and Language · Computer Science 2026-02-19 Andrius Matšenas , Anet Lello , Tõnis Lees , Hans Peep , Kim Lilii Tamm

Causal reasoning is a core component of intelligence. Large language models (LLMs) have shown impressive capabilities in generating human-like text, raising questions about whether their responses reflect true understanding or statistical…

Artificial Intelligence · Computer Science 2025-06-09 Hanna M. Dettki , Brenden M. Lake , Charley M. Wu , Bob Rehder

This paper introduces an innovative task focused on editing the personality traits of Large Language Models (LLMs). This task seeks to adjust the models' responses to opinion-related questions on specified topics since an individual's…

Computation and Language · Computer Science 2024-09-04 Shengyu Mao , Xiaohan Wang , Mengru Wang , Yong Jiang , Pengjun Xie , Fei Huang , Ningyu Zhang

What makes an interaction with the LLM more preferable for the user? While it is intuitive to assume that information accuracy in the LLM's responses would be one of the influential variables, recent studies have found that inaccurate LLM's…

Computation and Language · Computer Science 2025-04-25 Rendi Chevi , Kentaro Inui , Thamar Solorio , Alham Fikri Aji

This paper investigates the voting behaviors of Large Language Models (LLMs), specifically GPT-4 and LLaMA-2, their biases, and how they align with human voting patterns. Our methodology involved using a dataset from a human voting…

Computation and Language · Computer Science 2024-12-20 Joshua C. Yang , Damian Dailisan , Marcin Korecki , Carina I. Hausladen , Dirk Helbing

Large Language Models (LLMs) demonstrate increasingly human-like abilities across a wide variety of tasks. In this paper, we investigate whether LLMs like ChatGPT can accurately infer the psychological dispositions of social media users and…

Computation and Language · Computer Science 2024-06-06 Heinrich Peters , Sandra Matz

Large Language Models (LLMs) are increasingly serving as personal assistants, where users share complex and diverse preferences over extended interactions. However, assessing how well LLMs can follow these preferences in realistic,…

Artificial Intelligence · Computer Science 2026-03-05 Qianyun Guo , Yibo Li , Yue Liu , Bryan Hooi

Large language models (LLMs) excel in both closed tasks (including problem-solving, and code generation) and open tasks (including creative writing), yet existing explanations for their capabilities lack connections to real-world human…

Computation and Language · Computer Science 2025-05-28 Yifan Duan , Yihong Tang , Xuefeng Bai , Kehai Chen , Juntao Li , Min Zhang

User preferences are increasingly used to personalize Large Language Model (LLM) responses, yet how to reliably leverage preference signals for answer generation remains under-explored. In practice, preferences can be noisy, incomplete, or…

Computation and Language · Computer Science 2026-04-09 Tianyu Zhao , Siqi Li , Yasser Shoukry , Salma Elmalaki

Large language models (LLMs) are employed to simulate human-like responses in social surveys, yet it remains unclear if they develop biases like social desirability response (SDR) bias. To investigate this, GPT-4 was assigned personas from…

Artificial Intelligence · Computer Science 2024-10-22 Sanguk Lee , Kai-Qi Yang , Tai-Quan Peng , Ruth Heo , Hui Liu

Large language models enable unscripted conversations while maintaining a consistent personality. One desirable personality trait in cooperative partners, known to improve task performance, is agreeableness. To explore the impact of large…

Human-Computer Interaction · Computer Science 2025-12-09 Dennis Becker , Kyra Ahrens , Connor Gäde , Erik Strahl , Stefan Wermter

The humanlike responses of large language models (LLMs) have prompted social scientists to investigate whether LLMs can be used to simulate human participants in experiments, opinion polls and surveys. Of central interest in this line of…

Computation and Language · Computer Science 2024-05-14 Nikolay B Petrov , Gregory Serapio-García , Jason Rentfrow

Human problem-solving is enriched by a diversity of styles and personality traits, yet the development of Large Language Models (LLMs) has largely prioritized uniform performance benchmarks that favour specific behavioural tendencies such…

Computation and Language · Computer Science 2026-03-09 Xi Wang , Mengdie Zhuang , Jiqun Liu

People have different creative writing preferences, and large language models (LLMs) for these tasks can benefit from adapting to each user's preferences. However, these models are often trained over a dataset that considers varying…

A growing body of research examines personality traits in Large Language Models (LLMs), particularly in human-agent collaboration. Prior work has frequently applied the Big Five inventory to assess LLM behavior analogous to human…

Human-Computer Interaction · Computer Science 2026-03-20 Kim Zierahn , Cristina Cachero , Anna Korhonen , Nuria Oliver

Having been trained on massive pretraining data, large language models have shown excellent performance on many knowledge-intensive tasks. However, pretraining data tends to contain misleading and even conflicting information, and it is…

Computation and Language · Computer Science 2024-10-08 Jiahuan Li , Yiqing Cao , Shujian Huang , Jiajun Chen

Recent advancements in Large Language Models (LLMs) have led to their adaptation in various domains as conversational agents. We wonder: can personality tests be applied to these agents to analyze their behavior, similar to humans? We…

As large language models (LLMs) become more deeply integrated into various sectors, understanding how they make moral judgments has become crucial, particularly in the realm of autonomous driving. This study utilized the Moral Machine…

Computation and Language · Computer Science 2024-02-08 Kazuhiro Takemoto