中文
相关论文

相关论文: Personality as a Probe for LLM Evaluation: Method …

200 篇论文

Have Large Language Models (LLMs) developed a personality? The short answer is a resounding "We Don't Know!". In this paper, we show that we do not yet have the right tools to measure personality in language models. Personality is an…

计算与语言 · 计算机科学 2023-05-25 Xiaoyang Song , Akshat Gupta , Kiyan Mohebbizadeh , Shujie Hu , Anant Singh

This study explores the idea of AI Personality or AInality suggesting that Large Language Models (LLMs) exhibit patterns similar to human personalities. Assuming that LLMs share these patterns with humans, we investigate using…

计算与语言 · 计算机科学 2023-12-25 Yang Lu , Jordan Yu , Shou-Hsuan Stephen Huang

This study investigates the capacity of Large Language Models (LLMs) to infer the Big Five personality traits from free-form user interactions. The results demonstrate that a chatbot powered by GPT-4 can infer personality with moderate…

人机交互 · 计算机科学 2024-05-24 Heinrich Peters , Moran Cerf , Sandra C. Matz

Large Language Models (LLMs) are increasingly deployed in roles requiring nuanced psychological understanding, such as emotional support agents, counselors, and decision-making assistants. However, their ability to interpret human…

计算与语言 · 计算机科学 2025-09-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

Accurate assessment of personality traits is crucial for effective psycho-counseling, yet traditional methods like self-report questionnaires are time-consuming and biased. This study exams whether Large Language Models (LLMs) can predict…

计算与语言 · 计算机科学 2024-06-26 Yang Yan , Lizhi Ma , Anqi Li , Jingsong Ma , Zhenzhong Lan

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

计算与语言 · 计算机科学 2026-01-21 Md Talha Mohsin

Regulation is increasingly cited as the most important and pressing concern in machine learning. However, it is currently unknown how to implement this, and perhaps more importantly, how it would effect model performance alongside human…

机器学习 · 计算机科学 2024-12-18 Eoin M. Kenny , Julie A. Shah

Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains, including psychological assessment. This study evaluates whether LLMs, specifically GPT-4o and GPT-4o mini, can infer Big Five…

计算与语言 · 计算机科学 2025-01-14 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Aligning Large Language Models (LLMs) with specific personas typically relies on expensive and monolithic Supervised Fine-Tuning (SFT) or RLHF. While effective, these methods require training distinct models for every target personality…

计算与语言 · 计算机科学 2026-03-05 Florian Hoppe , David Khachaturov , Robert Mullins , Mark Huasong Meng

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Large Language Models (LLMs) have demonstrated promising capabilities to generate responses that simulate consistent personality traits. Despite the major attempts to analyze personality expression through output-based evaluations, little…

计算与语言 · 计算机科学 2025-07-30 Tianjie Ju , Zhenyu Shao , Bowen Wang , Yujia Chen , Zhuosheng Zhang , Hao Fei , Mong-Li Lee , Wynne Hsu , Sufeng Duan , Gongshen Liu

As Large Language Models (LLMs) become integral to human-centered applications, understanding their personality-like behaviors is increasingly important for responsible development and deployment. This paper systematically evaluates six…

计算与语言 · 计算机科学 2025-11-07 Christos-Nikolaos Zacharopoulos , Revekka Kyriakoglou

Personality detection aims to detect one's personality traits underlying in social media posts. One challenge of this task is the scarcity of ground-truth personality traits which are collected from self-report questionnaires. Most existing…

计算与语言 · 计算机科学 2024-03-13 Linmei Hu , Hongyu He , Duokang Wang , Ziwang Zhao , Yingxia Shao , Liqiang Nie

With the different roles that AI is expected to play in human life, imbuing large language models (LLMs) with different personalities has attracted increasing research interests. While the "personification" enhances human experiences of…

人工智能 · 计算机科学 2025-09-22 Shuo Wang , Renhao Li , Xi Chen , Yulin Yuan , Derek F. Wong , Min Yang

Driven by the demand for personalized AI systems, there is growing interest in aligning the behavior of large language models (LLMs) with human traits such as personality. Previous attempts to induce personality in LLMs have shown promising…

计算与语言 · 计算机科学 2025-09-25 Seungjong Sun , Seo Yeon Baek , Jang Hyun Kim

This study proposes a novel methodology for generating personalized fake news debunking messages by prompting Large Language Models (LLMs) with persona-based inputs aligned to the Big Five personality traits: Extraversion, Agreeableness,…

人工智能 · 计算机科学 2026-03-11 Pietro Dell'Oglio , Alessandro Bondielli , Francesco Marcelloni , Lucia C. Passaro

Large language models (LLMs) hold the potential to absorb and reflect personality traits and attitudes specified by users. In our study, we investigated this potential using robust psychometric measures. We adapted the most studied test in…

计算与语言 · 计算机科学 2025-12-19 Anton Vasiliuk , Irina Abdullaeva , Polina Druzhinina , Anton Razzhigaev , Andrey Kuznetsov

Digital behaviour change systems increasingly rely on repeated, system-initiated messages to support users in everyday contexts. LLMs enable these messages to be personalised consistently across interactions, yet it remains unclear whether…

人机交互 · 计算机科学 2026-03-02 Dominik P. Hofer , David Haag , Rania Islambouli , Jan D. Smeddinck

Recent research has explored using very large language models (LLMs) as proxies for humans in tasks such as simulation, surveys, and studies. While LLMs do not possess a human psychology, they often can emulate human behaviors with…

人工智能 · 计算机科学 2025-12-24 Eric Yeh , John Cadigan , Ran Chen , Dick Crouch , Melinda Gervasio , Dayne Freitag

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

计算机科学与博弈论 · 计算机科学 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino