中文
相关论文

相关论文: Can LLMs Assess Personality? Validating Conversati…

200 篇论文

Large language models (LLMs) have advanced conversational AI assistants. However, systematically evaluating how well these assistants apply personalization--adapting to individual user preferences while completing tasks--remains…

计算与语言 · 计算机科学 2025-06-12 Zheng Zhao , Clara Vania , Subhradeep Kayal , Naila Khan , Shay B. Cohen , Emine Yilmaz

The advent of large language models marks a revolutionary breakthrough in artificial intelligence. With the unprecedented scale of training and model parameters, the capability of large language models has been dramatically improved,…

Large language models (LLMs) have demonstrated their potential in social science research by emulating human perceptions and behaviors, a concept referred to as algorithmic fidelity. This study assesses the algorithmic fidelity and bias of…

人工智能 · 计算机科学 2024-08-09 S. Lee , T. Q. Peng , M. H. Goldberg , S. A. Rosenthal , J. E. Kotcher , E. W. Maibach , A. Leiserowitz

Large language models (LLMs) learn statistical associations from massive training corpora and user interactions, and deployed systems can surface or infer information about individuals. Yet people lack practical ways to inspect what a model…

人机交互 · 计算机科学 2026-03-13 Dimitri Staufer , Kirsten Morehouse , David Hartmann , Bettina Berendt

As AI becomes fundamental in sectors like healthcare, explainable AI (XAI) tools are essential for trust and transparency. However, traditional user studies used to evaluate these tools are often costly, time consuming, and difficult to…

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

计算与语言 · 计算机科学 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

Large language models (LLMs) excel at generating empathic responses in text-based conversations. But, how reliably do they judge the nuances of empathic communication? We investigate this question by comparing how experts, crowdworkers, and…

计算与语言 · 计算机科学 2025-10-06 Aakriti Kumar , Nalin Poungpeth , Diyi Yang , Erina Farrell , Bruce Lambert , Matthew Groh

Standardized and quantified evaluation of machine behaviors is a crux of understanding LLMs. In this study, we draw inspiration from psychometric studies by leveraging human personality theory as a tool for studying machine behaviors.…

计算与语言 · 计算机科学 2023-10-31 Guangyuan Jiang , Manjie Xu , Song-Chun Zhu , Wenjuan Han , Chi Zhang , Yixin Zhu

In this article, we explore the transformative potential of integrating generative AI, particularly Large Language Models (LLMs), into behavioral and experimental economics to enhance internal validity. By leveraging AI tools, researchers…

人机交互 · 计算机科学 2024-07-18 Brian Jabarian

The recent success of large language models (LLMs) has shown great potential to develop more powerful conversational recommender systems (CRSs), which rely on natural language conversations to satisfy user needs. In this paper, we embark on…

计算与语言 · 计算机科学 2024-06-21 Xiaolei Wang , Xinyu Tang , Wayne Xin Zhao , Jingyuan Wang , Ji-Rong Wen

Large Language Models (LLMs) show impressive conversational abilities but sometimes show identity drift problems, where their interaction patterns or styles change over time. As the problem has not been thoroughly examined yet, this study…

计算机与社会 · 计算机科学 2025-02-18 Junhyuk Choi , Yeseon Hong , Minju Kim , Bugeun Kim

This study proposes augmenting dialog data with think-aloud utterances (TAUs) for modeling individual personalities in text chat by LLM. TAU is a verbalization of a speaker's thought before articulating the utterance. We expect "persona…

计算与语言 · 计算机科学 2025-10-30 Seiya Ishikura , Hiroaki Yamada , Tatsuya Hiraoka , Hiroaki Yamada , Takenobu Tokunaga

Large Language Models (LLMs) are often misleadingly recognized as having a personality or a set of values. We argue that an LLM can be seen as a superposition of perspectives with different values and personality traits. LLMs exhibit…

计算与语言 · 计算机科学 2023-11-08 Grgur Kovač , Masataka Sawayama , Rémy Portelas , Cédric Colas , Peter Ford Dominey , Pierre-Yves Oudeyer

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

软件工程 · 计算机科学 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

Large language models (LLMs) are advanced artificial intelligence (AI) systems that can perform a variety of tasks commonly found in human intelligence tests, such as defining words, performing calculations, and engaging in verbal…

计算与语言 · 计算机科学 2024-09-12 David Ilić , Gilles E. Gignac

Large Language Models (LLMs) with hundreds of billions of parameters have exhibited human-like intelligence by learning from vast amounts of internet-scale data. However, the uninterpretability of large-scale neural networks raises concerns…

计算与语言 · 计算机科学 2025-09-23 Wei Xie , Shuoyoucheng Ma , Zhenhua Wang , Enze Wang , Kai Chen , Xiaobing Sun , Baosheng Wang

Large Language Models (LLMs) are increasingly being used to provide support and advice in personal domains such as romantic relationships, yet little is known about user perceptions of this type of advice. This study investigated how people…

人机交互 · 计算机科学 2026-03-06 Niva Manchanda , Akshata Kishore Moharir , Ratna Kandala

While Large Language Model (LLM)-based agents can be used to create highly engaging interactive applications through prompting personality traits and contextual data, effectively assessing their personalities has proven challenging. This…

人机交互 · 计算机科学 2025-10-29 Eswari Jayakumar , Niladri Sekhar Dash , Debasmita Mukherjee

As large language models (LLMs) are increasingly integrated into daily life, in roles ranging from high-stakes decision support to companionship, understanding their behavioral dispositions becomes critical. A growing literature uses…

人工智能 · 计算机科学 2026-04-22 Valentin Kriegmair , Dirk U. Wulff

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

计算与语言 · 计算机科学 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN