English
Related papers

Related papers: Can LLMs Assess Personality? Validating Conversati…

200 papers

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Artificial Intelligence · Computer Science 2024-11-25 Aadesh Salecha , Molly E. Ireland , Shashanka Subrahmanya , João Sedoc , Lyle H. Ungar , Johannes C. Eichstaedt

Questionnaires are a common method for detecting the personality of Large Language Models (LLMs). However, their reliability is often compromised by two main issues: hallucinations (where LLMs produce inaccurate or irrelevant responses) and…

Computation and Language · Computer Science 2024-10-14 Baohua Zhan , Yongyi Huang , Wenyao Cui , Huaping Zhang , Jianyun Shang

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

Computation and Language · Computer Science 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

Large language models (LLMs) make it possible to generate synthetic behavioural data at scale, offering an ethical and low-cost alternative to human experiments. Whether such data can faithfully capture psychological differences driven by…

Computation and Language · Computer Science 2025-11-27 Manuel Pratelli , Marinella Petrocchi

Generative AI models garnered a large amount of public attention and speculation with the release of OpenAIs chatbot, ChatGPT. At least two opinion camps exist: one excited about possibilities these models offer for fundamental changes to…

Artificial Intelligence · Computer Science 2024-06-28 Ann Speed

Recent studies have shown that prompting can enable large language models (LLMs) to simulate specific personality traits and produce behaviors that align with those traits. However, there is limited understanding of how these simulated…

Computation and Language · Computer Science 2026-01-06 Nuo Chen , Hanpei Fang , Piaohong Wang , Jiqun Liu , Tetsuya Sakai , Xiao-Ming Wu

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like…

Computation and Language · Computer Science 2025-10-14 Dana Sotto Porat , Ella Rabinovich

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains, including psychological assessment. This study evaluates whether LLMs, specifically GPT-4o and GPT-4o mini, can infer Big Five…

Computation and Language · Computer Science 2025-01-14 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Accurate and verifiable large language model (LLM) simulations of human research subjects promise an accessible data source for understanding human behavior and training new AI systems. However, results to date have been limited, and few…

Human-Computer Interaction · Computer Science 2025-06-06 Jacy Reese Anthis , Ryan Liu , Sean M. Richardson , Austin C. Kozlowski , Bernard Koch , James Evans , Erik Brynjolfsson , Michael Bernstein

This paper explores the advancements in making large language models (LLMs) more human-like. We focus on techniques that enhance natural language understanding, conversational coherence, and emotional intelligence in AI systems. The study…

Computation and Language · Computer Science 2026-02-03 Ethem Yağız Çalık , Talha Rüzgar Akkuş

As Large Language Models (LLMs) become integral to human-centered applications, understanding their personality-like behaviors is increasingly important for responsible development and deployment. This paper systematically evaluates six…

Computation and Language · Computer Science 2025-11-07 Christos-Nikolaos Zacharopoulos , Revekka Kyriakoglou

Large Language Models (LLMs) such as ChatGPT have shown remarkable abilities in producing human-like text. However, it is unclear how accurately these models internalize concepts that shape human thought and behavior. Here, we developed a…

Machine Learning · Computer Science 2025-07-01 Hiro Taiyo Hamada , Ippei Fujisawa , Genji Kawakita , Yuki Yamada

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Large language models (LLMs) increasingly reach real-world applications, necessitating a better understanding of their behaviour. Their size and complexity complicate traditional assessment methods, causing the emergence of alternative…

Artificial Intelligence · Computer Science 2025-05-13 Sanne Peereboom , Inga Schwabe , Bennett Kleinberg

Large Language Models (LLMs) have achieved remarkable results on a range of standardized tests originally designed to assess human cognitive and psychological traits, such as intelligence and personality. While these results are often…

Machine Learning · Computer Science 2026-05-12 Tom Sühr , Florian E. Dorner , Olawale Salaudeen , Augustin Kelava , Samira Samadi

In this work, we tackle the challenge of embedding realistic human personality traits into LLMs. Previous approaches have primarily focused on prompt-based methods that describe the behavior associated with the desired personality traits,…

Computation and Language · Computer Science 2025-07-30 Wenkai Li , Jiarui Liu , Andy Liu , Xuhui Zhou , Mona Diab , Maarten Sap

Personality manipulation in large language models (LLMs) is increasingly applied in customer service and agentic scenarios, yet its mechanisms and trade-offs remain unclear. We present a systematic study of personality control using the Big…

Computation and Language · Computer Science 2025-09-08 Gunmay Handa , Zekun Wu , Adriano Koshiyama , Philip Treleaven

Large Language Models (LLMs) have demonstrated the ability to adopt a personality and behave in a human-like manner. There is a large body of research that investigates the behavioural impacts of personality in less obvious areas such as…

Statistical Finance · Quantitative Finance 2024-11-12 Harris Borman , Anna Leontjeva , Luiz Pizzato , Max Kun Jiang , Dan Jermyn

Large language models (LLMs) are used as "digital twins" to replace human respondents, yet their psychometric comparability to humans is uncertain. We propose a construct-validity framework spanning construct representation and the…

Computers and Society · Computer Science 2026-01-23 Yufei Zhang , Zhihao Ma