中文
相关论文

相关论文: Can LLMs Assess Personality? Validating Conversati…

200 篇论文

As Large Language Models (LLMs) become widely used to model and simulate human behavior, understanding their biases becomes critical. We developed an experimental framework using Big Five personality surveys and uncovered a previously…

Questionnaires are a common method for detecting the personality of Large Language Models (LLMs). However, their reliability is often compromised by two main issues: hallucinations (where LLMs produce inaccurate or irrelevant responses) and…

计算与语言 · 计算机科学 2024-10-14 Baohua Zhan , Yongyi Huang , Wenyao Cui , Huaping Zhang , Jianyun Shang

Automatic evaluation is an integral aspect of dialogue system research. The traditional reference-based NLG metrics are generally found to be unsuitable for dialogue assessment. Consequently, recent studies have suggested various unique,…

计算与语言 · 计算机科学 2024-01-23 Chen Zhang , Luis Fernando D'Haro , Yiming Chen , Malu Zhang , Haizhou Li

Large language models (LLMs) make it possible to generate synthetic behavioural data at scale, offering an ethical and low-cost alternative to human experiments. Whether such data can faithfully capture psychological differences driven by…

计算与语言 · 计算机科学 2025-11-27 Manuel Pratelli , Marinella Petrocchi

Generative AI models garnered a large amount of public attention and speculation with the release of OpenAIs chatbot, ChatGPT. At least two opinion camps exist: one excited about possibilities these models offer for fundamental changes to…

人工智能 · 计算机科学 2024-06-28 Ann Speed

Recent studies have shown that prompting can enable large language models (LLMs) to simulate specific personality traits and produce behaviors that align with those traits. However, there is limited understanding of how these simulated…

计算与语言 · 计算机科学 2026-01-06 Nuo Chen , Hanpei Fang , Piaohong Wang , Jiqun Liu , Tetsuya Sakai , Xiao-Ming Wu

Generative large language models (LLMs) have become central to everyday life, producing human-like text across diverse domains. A growing body of research investigates whether these models also exhibit personality- and demographic-like…

计算与语言 · 计算机科学 2025-10-14 Dana Sotto Porat , Ella Rabinovich

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

人工智能 · 计算机科学 2025-12-12 Akash Kundu , Rishika Goswami

Large Language Models (LLMs) are demonstrating remarkable human like capabilities across diverse domains, including psychological assessment. This study evaluates whether LLMs, specifically GPT-4o and GPT-4o mini, can infer Big Five…

计算与语言 · 计算机科学 2025-01-14 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Accurate and verifiable large language model (LLM) simulations of human research subjects promise an accessible data source for understanding human behavior and training new AI systems. However, results to date have been limited, and few…

This paper explores the advancements in making large language models (LLMs) more human-like. We focus on techniques that enhance natural language understanding, conversational coherence, and emotional intelligence in AI systems. The study…

计算与语言 · 计算机科学 2026-02-03 Ethem Yağız Çalık , Talha Rüzgar Akkuş

As Large Language Models (LLMs) become integral to human-centered applications, understanding their personality-like behaviors is increasingly important for responsible development and deployment. This paper systematically evaluates six…

计算与语言 · 计算机科学 2025-11-07 Christos-Nikolaos Zacharopoulos , Revekka Kyriakoglou

Large Language Models (LLMs) such as ChatGPT have shown remarkable abilities in producing human-like text. However, it is unclear how accurately these models internalize concepts that shape human thought and behavior. Here, we developed a…

机器学习 · 计算机科学 2025-07-01 Hiro Taiyo Hamada , Ippei Fujisawa , Genji Kawakita , Yuki Yamada

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

计算与语言 · 计算机科学 2026-01-21 Md Talha Mohsin

Large language models (LLMs) increasingly reach real-world applications, necessitating a better understanding of their behaviour. Their size and complexity complicate traditional assessment methods, causing the emergence of alternative…

人工智能 · 计算机科学 2025-05-13 Sanne Peereboom , Inga Schwabe , Bennett Kleinberg

Large Language Models (LLMs) have achieved remarkable results on a range of standardized tests originally designed to assess human cognitive and psychological traits, such as intelligence and personality. While these results are often…

机器学习 · 计算机科学 2026-05-12 Tom Sühr , Florian E. Dorner , Olawale Salaudeen , Augustin Kelava , Samira Samadi

In this work, we tackle the challenge of embedding realistic human personality traits into LLMs. Previous approaches have primarily focused on prompt-based methods that describe the behavior associated with the desired personality traits,…

计算与语言 · 计算机科学 2025-07-30 Wenkai Li , Jiarui Liu , Andy Liu , Xuhui Zhou , Mona Diab , Maarten Sap

Personality manipulation in large language models (LLMs) is increasingly applied in customer service and agentic scenarios, yet its mechanisms and trade-offs remain unclear. We present a systematic study of personality control using the Big…

计算与语言 · 计算机科学 2025-09-08 Gunmay Handa , Zekun Wu , Adriano Koshiyama , Philip Treleaven

Large Language Models (LLMs) have demonstrated the ability to adopt a personality and behave in a human-like manner. There is a large body of research that investigates the behavioural impacts of personality in less obvious areas such as…

统计金融 · 定量金融 2024-11-12 Harris Borman , Anna Leontjeva , Luiz Pizzato , Max Kun Jiang , Dan Jermyn

Large language models (LLMs) are used as "digital twins" to replace human respondents, yet their psychometric comparability to humans is uncertain. We propose a construct-validity framework spanning construct representation and the…

计算机与社会 · 计算机科学 2026-01-23 Yufei Zhang , Zhihao Ma