中文
相关论文

相关论文: Personality as a Probe for LLM Evaluation: Method …

200 篇论文

Using psychological constructs such as the Big Five, large language models (LLMs) can imitate specific personality profiles and predict a user's personality. While LLMs can exhibit behaviors consistent with these constructs, it remains…

计算与语言 · 计算机科学 2026-04-14 Yuto Harada , Hiro Taiyo Hamada

As large language models (LLMs) are increasingly integrated into daily life, in roles ranging from high-stakes decision support to companionship, understanding their behavioral dispositions becomes critical. A growing literature uses…

人工智能 · 计算机科学 2026-04-22 Valentin Kriegmair , Dirk U. Wulff

Large language models (LLMs) often exhibit tendencies that diverge from human preferences, such as favoring certain writing styles or producing overly verbose outputs. While crucial for improvement, identifying the factors driving these…

计算与语言 · 计算机科学 2025-11-18 Juhyun Oh , Eunsu Kim , Jiseon Kim , Wenda Xu , Inha Cha , William Yang Wang , Alice Oh

We present a novel approach for enhancing diversity and control in data annotation tasks by personalizing large language models (LLMs). We investigate the impact of injecting diverse persona descriptions into LLM prompts across two studies,…

计算与语言 · 计算机科学 2024-10-16 Leon Fröhling , Gianluca Demartini , Dennis Assenmacher

The advancement of Large Language Models (LLMs) for domain applications in fields such as materials science and engineering depends on the development of fine-tuning strategies that adapt models for specialized, technical capabilities. In…

计算与语言 · 计算机科学 2024-09-06 Wei Lu , Rachel K. Luu , Markus J. Buehler

Recent advances in large language models (LLMs) have significantly improved the alignment of models with general human preferences. However, a major challenge remains in adapting LLMs to individual preferences, which are not only diverse…

计算与语言 · 计算机科学 2026-04-15 Shanyong Wang , Shuhang Lin , Yining Zhao , Xi Zhu , Yongfeng Zhang

Large language models (LLMs) are increasingly deployed in politically sensitive settings, raising concerns about their potential to encode, amplify, or be steered toward specific ideologies. We investigate how adopting synthetic personas…

计算与语言 · 计算机科学 2025-08-25 Pietro Bernardelle , Stefano Civelli , Leon Fröhling , Riccardo Lunardi , Kevin Roitero , Gianluca Demartini

Large Language Models (LLMs) have made significant strides in the field of artificial intelligence, showcasing their ability to interact with humans and influence human cognition through information dissemination. However, recent studies…

计算与语言 · 计算机科学 2024-11-25 Qingquan Zhang , Qiqi Duan , Bo Yuan , Yuhui Shi , Jialin Liu

Large language models (LLMs) like GPT-4 show potential for scaling motivational interviewing (MI) in addiction care, but require systematic evaluation of therapeutic capabilities. We present a computational framework assessing…

计算与语言 · 计算机科学 2025-05-26 Yinghui Huang , Yuxuan Jiang , Hui Liu , Yixin Cai , Weiqing Li , Xiangen Hu

Finding an agreement among diverse opinions is a challenging topic in multiagent systems. Recently, large language models (LLMs) have shown great potential in addressing this challenge due to their remarkable capabilities in comprehending…

计算与语言 · 计算机科学 2023-05-22 Shiyao Ding , Takayuki Ito

Ensuring awareness of fairness and privacy in Large Language Models (LLMs) is critical. Interestingly, we discover a counter-intuitive trade-off phenomenon that enhancing an LLM's privacy awareness through Supervised Fine-Tuning (SFT)…

人工智能 · 计算机科学 2025-06-04 Chen Qian , Dongrui Liu , Jie Zhang , Yong Liu , Jing Shao

Large Language Models (LLMs) exhibit social biases, which can lead to harmful stereotypes and unfair outcomes. We propose \textbf{Multi-Persona Thinking (MPT)}, a simple inference-time framework that reduces social bias by encouraging…

计算与语言 · 计算机科学 2026-04-22 Yuxing Chen , Guoqing Luo , Zijun Wu , Lili Mou

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI)…

人工智能 · 计算机科学 2024-08-06 Thuy Ngoc Nguyen , Kasturi Jamale , Cleotilde Gonzalez

Large Language Models (LLMs) are becoming increasingly persuasive, demonstrating the ability to personalize arguments in conversation with humans by leveraging their personal data. This may have serious impacts on the scale and…

计算与语言 · 计算机科学 2025-01-30 Jasper Timm , Chetan Talele , Jacob Haimes

This paper examines biases in large language models (LLMs) when generating synthetic populations from responses to personality questionnaires. Using five LLMs, we first assess the representativeness and potential biases in the…

计算机与社会 · 计算机科学 2026-02-04 Jacopo Amidei , Gregorio Ferreira , Mario Muñoz Serrano , Rubén Nieto , Andreas Kaltenbrunner

Ensuring persona fidelity in large language models (LLMs) is essential for maintaining coherent and engaging human-AI interactions. However, LLMs often exhibit Out-of-Character (OOC) behavior, where generated responses deviate from an…

计算与语言 · 计算机科学 2025-06-25 Jisu Shin , Juhyun Oh , Eunsu Kim , Hoyun Song , Alice Oh

Multimodal Large Language Models (MLLMs) are increasingly deployed in human-facing roles where personality perception is critical, yet existing benchmarks evaluate this capability solely on numerical Big Five score prediction, leaving open…

Decision-making agents based on pre-trained Large Language Models (LLMs) are increasingly being deployed across various domains of human activity. While their applications are currently rather specialized, several research efforts are…

机器学习 · 计算机科学 2025-05-13 Elizaveta Tennant , Stephen Hailes , Mirco Musolesi

Large language models (LLMs) are increasingly used in human-AI interaction research and practice, yet existing capability and safety benchmarks reveal little about the value priorities these systems express or how those priorities…

人工智能 · 计算机科学 2026-05-19 Gabriel Rongyang Lau , Wei Yan Low , Seow Min Koh , Fiona Fui-Hoon Nah , Andree Hartanto

Psychology research has long explored aspects of human personality such as extroversion, agreeableness and emotional stability. Categorizations like the `Big Five' personality traits are commonly used to assess and diagnose personality…

人工智能 · 计算机科学 2022-12-21 Graham Caron , Shashank Srivastava