English
Related papers

Related papers: Misalignment of LLM-Generated Personas with Human …

200 papers

Large Language Models (LLMs) are increasingly used in everyday life and research. One of the most common use cases is conversational interactions, enabled by the language generation capabilities of LLMs. Just as between two humans, a…

Computation and Language · Computer Science 2024-11-12 Jingyao Zheng , Xian Wang , Simo Hosio , Xiaoxian Xu , Lik-Hang Lee

Psychological profiling of large language models (LLMs) using psychometric questionnaires designed for humans has become widespread. However, it remains unclear whether the resulting profiles mirror the models' psychological characteristics…

Computation and Language · Computer Science 2026-04-06 Woojung Song , Dongmin Choi , Yoonah Park , Jongwook Han , Yohan Jo

Large Language Models (LLMs) are increasingly regarded as having the potential to generate persuasive content at scale. While previous studies have focused on the risks associated with LLM-generated misinformation, the role of LLMs in…

Computers and Society · Computer Science 2026-04-06 John Caffier , Olga Stavrova , Bennett Kleinberg

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and generation, serving as the foundation for advanced persona simulation and Role-Playing Language Agents (RPLAs). However, achieving authentic alignment…

Computation and Language · Computer Science 2026-04-20 Xintao Wang , Jian Yang , Weiyuan Li , Rui Xie , Jen-tse Huang , Jun Gao , Shuai Huang , Yueping Kang , Yuanli Gou , Hongwei Feng , Yanghua Xiao

In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language…

Computation and Language · Computer Science 2025-03-11 Ryan Liu , Jiayi Geng , Joshua C. Peterson , Ilia Sucholutsky , Thomas L. Griffiths

Large language models (LLMs) may not equitably represent diverse global perspectives on societal issues. In this paper, we develop a quantitative framework to evaluate whose opinions model-generated responses are more similar to. We first…

Large Language Models (LLMs) have transformed artificial intelligence by excelling in complex natural language processing tasks. Their ability to generate human-like text has opened new possibilities for market research, particularly in…

Artificial Intelligence · Computer Science 2026-04-20 Mengxin Wang , Dennis J. Zhang , Heng Zhang

Large Language Model (LLM) agents are increasingly deployed in settings where they interact with a wide variety of people, including users who are unclear, impatient, or reluctant to share information. However, collecting real interaction…

Artificial Intelligence · Computer Science 2026-05-14 Harshita Chopra , Kshitish Ghate , Aylin Caliskan , Tadayoshi Kohno , Chirag Shah , Natasha Jaques

Recent works have showcased the ability of LLMs to embody diverse personas in their responses, exemplified by prompts like 'You are Yoda. Explain the Theory of Relativity.' While this ability allows personalization of LLMs and enables human…

Computation and Language · Computer Science 2024-01-30 Shashank Gupta , Vaishnavi Shrivastava , Ameet Deshpande , Ashwin Kalyan , Peter Clark , Ashish Sabharwal , Tushar Khot

Creating human-like large language model (LLM) agents is crucial for faithful social simulation. Having LLMs role-play based on demographic information sometimes improves human likeness but often does not. This study assessed whether LLM…

Computation and Language · Computer Science 2024-10-17 Yun-Shiuan Chuang , Krirk Nirunwiroj , Zach Studdiford , Agam Goyal , Vincent V. Frigo , Sijia Yang , Dhavan Shah , Junjie Hu , Timothy T. Rogers

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

As large language models (LLMs) become increasingly capable of generating persuasive content, understanding their effectiveness across different advertising strategies becomes critical. This paper presents a two-part investigation examining…

Computers and Society · Computer Science 2025-12-04 Elyas Meguellati , Stefano Civelli , Lei Han , Abraham Bernstein , Shazia Sadiq , Gianluca Demartini

We present Persona-L, a novel approach for creating personas using Large Language Models (LLMs) and an ability-based framework, specifically designed to improve the representation of users with complex needs. Traditional methods of persona…

Human-Computer Interaction · Computer Science 2024-09-25 Lipeipei Sun , Tianzi Qin , Anran Hu , Jiale Zhang , Shuojia Lin , Jianyan Chen , Mona Ali , Mirjana Prpa

Subjective well-being is a key metric in economic, medical, and policy decision-making. As artificial intelligence provides scalable tools for modelling human outcomes, it is crucial to evaluate whether large language models (LLMs) can…

Human-Computer Interaction · Computer Science 2025-07-09 Pat Pataranutaporn , Nattavudh Powdthavee , Chayapatr Archiwaranguprok , Pattie Maes

Recent work in large language modeling (LLMs) has used fine-tuning to align outputs with the preferences of a prototypical user. This work assumes that human preferences are static and homogeneous across individuals, so that aligning to a a…

The advancing fluency of LLMs raises important questions about their ability to emulate complex human traits, including emotional expression and personality, across diverse linguistic and cultural contexts. This study investigates whether…

Computation and Language · Computer Science 2026-03-25 Nasser A Alsadhan

This paper examines biases in large language models (LLMs) when generating synthetic populations from responses to personality questionnaires. Using five LLMs, we first assess the representativeness and potential biases in the…

Computers and Society · Computer Science 2026-02-04 Jacopo Amidei , Gregorio Ferreira , Mario Muñoz Serrano , Rubén Nieto , Andreas Kaltenbrunner

There is ongoing debate about whether large language models (LLMs) can serve as substitutes for human participants in survey and experimental research. While recent work in fields such as marketing and psychology has explored the potential…

Computation and Language · Computer Science 2025-12-30 Steven Wang , Kyle Hunt , Shaojie Tang , Kenneth Joseph

Large Language Models (LLMs) offer a promising alternative to traditional survey methods, potentially enhancing efficiency and reducing costs. In this study, we use LLMs to create virtual populations that answer survey questions, enabling…

Human-Computer Interaction · Computer Science 2025-03-24 Enzo Sinacola , Arnault Pachot , Thierry Petit

Large Language Models (LLMs) have revolutionised the capability of AI models in comprehending and generating natural language text. They are increasingly being used to empower and deploy agents in real-world scenarios, which make decisions…

Artificial Intelligence · Computer Science 2024-08-21 Sagar Uprety , Amit Kumar Jaiswal , Haiming Liu , Dawei Song