English
Related papers

Related papers: Identifying Multiple Personalities in Large Langua…

200 papers

This paper introduces an innovative task focused on editing the personality traits of Large Language Models (LLMs). This task seeks to adjust the models' responses to opinion-related questions on specified topics since an individual's…

Computation and Language · Computer Science 2024-09-04 Shengyu Mao , Xiaohan Wang , Mengru Wang , Yong Jiang , Pengjun Xie , Fei Huang , Ningyu Zhang

Human evaluation is indispensable and inevitable for assessing the quality of texts generated by machine learning models or written by humans. However, human evaluation is very difficult to reproduce and its quality is notoriously unstable,…

Computation and Language · Computer Science 2023-05-04 Cheng-Han Chiang , Hung-yi Lee

As Large Language Models (LLMs) continue to gain popularity due to their human-like traits and the intimacy they offer to users, their societal impact inevitably expands. This leads to the rising necessity for comprehensive studies to fully…

Artificial Intelligence · Computer Science 2025-01-07 Bojana Bodroza , Bojana M. Dinic , Ljubisa Bojic

Personality detection aims to measure an individual's corresponding personality traits through their social media posts. The advancements in Large Language Models (LLMs) offer novel perspectives for personality detection tasks. Existing…

Computation and Language · Computer Science 2026-01-27 Yuan Cao , Feixiang Liu , Xinyue Wang , Yihan Zhu , Hui Xu , Zheng Wang , Qiang Qiu

This study explores the idea of AI Personality or AInality suggesting that Large Language Models (LLMs) exhibit patterns similar to human personalities. Assuming that LLMs share these patterns with humans, we investigate using…

Computation and Language · Computer Science 2023-12-25 Yang Lu , Jordan Yu , Shou-Hsuan Stephen Huang

Large language models (LLMs) are increasingly used to simulate human behavior in social settings such as legal mediation, negotiation, and dispute resolution. However, it remains unclear whether these simulations reproduce the…

Artificial Intelligence · Computer Science 2026-02-10 Deuksin Kwon , Kaleen Shrestha , Bin Han , Spencer Lin , James Hale , Jonathan Gratch , Maja Matarić , Gale M. Lucas

The ongoing revolution in language modeling has led to various novel applications, some of which rely on the emerging social abilities of large language models (LLMs). Already, many turn to the new cyber friends for advice during the…

Computers and Society · Computer Science 2025-08-05 Ivan Zakazov , Mikolaj Boronski , Lorenzo Drudi , Robert West

As LLMs become central to interactive applications, ranging from tutoring to mental health, the ability to express personality in culturally appropriate ways is increasingly important. While recent works have explored personality evaluation…

Computation and Language · Computer Science 2025-10-15 Priyanka Dey , Yugal Khanter , Aayush Bothra , Jieyu Zhao , Emilio Ferrara

Questionnaires are a common method for detecting the personality of Large Language Models (LLMs). However, their reliability is often compromised by two main issues: hallucinations (where LLMs produce inaccurate or irrelevant responses) and…

Computation and Language · Computer Science 2024-10-14 Baohua Zhan , Yongyi Huang , Wenyao Cui , Huaping Zhang , Jianyun Shang

As large language models (LLMs) are increasingly used in human-centered tasks, assessing their psychological traits is crucial for understanding their social impact and ensuring trustworthy AI alignment. While existing reviews have covered…

Computers and Society · Computer Science 2025-05-02 Wenhan Dong , Yuemeng Zhao , Zhen Sun , Yule Liu , Zifan Peng , Jingyi Zheng , Zongmin Zhang , Ziyi Zhang , Jun Wu , Ruiming Wang , Shengmin Xu , Xinyi Huang , Xinlei He

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Artificial Intelligence · Computer Science 2024-11-25 Aadesh Salecha , Molly E. Ireland , Shashanka Subrahmanya , João Sedoc , Lyle H. Ungar , Johannes C. Eichstaedt

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

Computation and Language · Computer Science 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog. However, these tasks are highly subjective and dependent on human…

Computation and Language · Computer Science 2024-10-18 Salvatore Giorgi , Tingting Liu , Ankit Aich , Kelsey Isman , Garrick Sherman , Zachary Fried , João Sedoc , Lyle H. Ungar , Brenda Curtis

Large language models (LLMs) increasingly reach real-world applications, necessitating a better understanding of their behaviour. Their size and complexity complicate traditional assessment methods, causing the emergence of alternative…

Artificial Intelligence · Computer Science 2025-05-13 Sanne Peereboom , Inga Schwabe , Bennett Kleinberg

Assessing personality traits using large language models (LLMs) has emerged as an interesting and challenging area of research. While previous methods employ explicit questionnaires, often derived from the Big Five model of personality, we…

Computation and Language · Computer Science 2024-09-17 Joseph Suh , Suhong Moon , Minwoo Kang , David M. Chan

With the advancement of large language models (LLMs), the focus in Conversational AI has shifted from merely generating coherent and relevant responses to tackling more complex challenges, such as personalizing dialogue systems. In an…

Computation and Language · Computer Science 2025-02-13 Maria Molchanova , Anna Mikhailova , Anna Korzanova , Lidiia Ostyakova , Alexandra Dolidze

Large language models (LLMs) are now increasingly utilized for role-playing tasks, especially in impersonating domain-specific experts, primarily through role-playing prompts. When interacting in real-world scenarios, the decision-making…

Computation and Language · Computer Science 2024-03-01 Chenglei Shen , Guofu Xie , Xiao Zhang , Jun Xu

The emergence of unveiling human-like behaviors in Large Language Models (LLMs) has led to a closer connection between NLP and human psychology. Scholars have been studying the inherent personalities exhibited by LLMs and attempting to…

Artificial Intelligence · Computer Science 2025-03-25 Lucio La Cava , Andrea Tagarelli

The advancement of large language models (LLMs) has outpaced traditional evaluation methodologies. This progress presents novel challenges, such as measuring human-like psychological constructs, moving beyond static and task-specific…

Computation and Language · Computer Science 2026-03-12 Haoran Ye , Jing Jin , Yuhang Xie , Xin Zhang , Guojie Song

While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents. Such an…

Computation and Language · Computer Science 2024-02-06 Ivar Frisch , Mario Giulianelli