English
Related papers

Related papers: Human Psychometric Questionnaires Mischaracterize …

200 papers

We investigate whether Large Language Models (LLMs) exhibit human-like cognitive patterns under four established frameworks from psychology: Thematic Apperception Test (TAT), Framing Bias, Moral Foundations Theory (MFT), and Cognitive…

Artificial Intelligence · Computer Science 2025-12-12 Akash Kundu , Rishika Goswami

Large Language Models (LLMs) have emerged as potent tools for advancing the United Nations' Sustainable Development Goals (SDGs). However, the attitudinal disparities between LLMs and humans towards these goals can pose significant…

Computers and Society · Computer Science 2025-01-17 Qingyang Wu , Ying Xu , Tingsong Xiao , Yunze Xiao , Yitong Li , Tianyang Wang , Yichi Zhang , Shanghai Zhong , Yuwei Zhang , Wei Lu , Yifan Yang

Many applications of Large Language Models (LLMs) require them to either simulate people or offer personalized functionality, making the demographic representativeness of LLMs crucial for equitable utility. At the same time, we know little…

Computers and Society · Computer Science 2025-11-05 Indira Sen , Marlene Lutz , Elisa Rogers , David Garcia , Markus Strohmaier

Large Language Models (LLMs) such as ChatGPT have shown remarkable abilities in producing human-like text. However, it is unclear how accurately these models internalize concepts that shape human thought and behavior. Here, we developed a…

Machine Learning · Computer Science 2025-07-01 Hiro Taiyo Hamada , Ippei Fujisawa , Genji Kawakita , Yuki Yamada

This research explores the potential of Large Language Models (LLMs) to utilize psychometric values, specifically personality information, within the context of video game character development. Affective Computing (AC) systems quantify a…

Computation and Language · Computer Science 2024-02-26 Lawrence J. Klinkert , Stephanie Buongiorno , Corey Clark

Large Language Models (LLMs) are increasingly used as proxies for human subjects in social science surveys, but their reliability and susceptibility to known human-like response biases, such as central tendency, opinion floating and primacy…

Computation and Language · Computer Science 2025-10-17 Jens Rupprecht , Georg Ahnert , Markus Strohmaier

Recent studies apply psychometric questionnaires to Large Language Models (LLMs) to assess high-level psychological constructs such as values, personality, moral foundations, and dark traits. Although prior work has raised concerns about…

Computation and Language · Computer Science 2026-02-02 Jongwook Han , Woojung Song , Jonggeun Lee , Yohan Jo

Large language models (LLMs) are increasingly used to simulate human opinions and survey responses, but their ability to reproduce population responses across cultures remains limited. Existing persona-based prompting methods typically rely…

Computation and Language · Computer Science 2026-05-18 Axel Abels , Elias Fernandez Domingos , Apurva Shah , Tom Lenaerts

Large Language Models increasingly mediate high-stakes interactions, intensifying research on their capabilities and safety. While recent work has shown that LLMs exhibit consistent and measurable synthetic personality traits, little is…

Artificial Intelligence · Computer Science 2025-09-23 Stephen Fitz , Peter Romero , Steven Basart , Sipeng Chen , Jose Hernandez-Orallo

Generative AI (GenAI) is increasingly used in survey contexts to simulate human preferences. While many research endeavors evaluate the quality of synthetic GenAI data by comparing model-generated responses to gold-standard survey results,…

Machine Learning · Computer Science 2025-02-25 Sarah Ball , Simeon Allmendinger , Frauke Kreuter , Niklas Kühl

Large language models (LLMs) exhibit distinct and consistent personalities that greatly impact trust and engagement. While this means that personality frameworks would be highly valuable tools to characterize and control LLMs' behavior,…

Computation and Language · Computer Science 2026-01-19 Michel Frising , Daniel Balcells

The recent surge of versatile large language models (LLMs) largely depends on aligning increasingly capable foundation models with human intentions by preference learning, enhancing LLMs with excellent applicability and effectiveness in a…

Computation and Language · Computer Science 2024-06-19 Ruili Jiang , Kehai Chen , Xuefeng Bai , Zhixuan He , Juntao Li , Muyun Yang , Tiejun Zhao , Liqiang Nie , Min Zhang

Are AI systems truly representing human values, or merely averaging across them? Our study suggests a concerning reality: Large Language Models (LLMs) fail to represent diverse cultural moral frameworks despite their linguistic…

Computation and Language · Computer Science 2025-08-01 Simon Münker

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

As LLMs become central to interactive applications, ranging from tutoring to mental health, the ability to express personality in culturally appropriate ways is increasingly important. While recent works have explored personality evaluation…

Computation and Language · Computer Science 2025-10-15 Priyanka Dey , Yugal Khanter , Aayush Bothra , Jieyu Zhao , Emilio Ferrara

Data search for scientific research is more complex than a simple web search. The emergence of large language models (LLMs) and their applicability for scientific tasks offers new opportunities for researchers who are looking for data,…

Digital Libraries · Computer Science 2025-10-29 Christin Katharina Kreutz , Anja Perry , Tanja Friedrich

Large language models (LLMs) show increasingly advanced emergent capabilities and are being incorporated across various societal domains. Understanding their behavior and reasoning abilities therefore holds significant importance. We argue…

Computation and Language · Computer Science 2024-08-09 Thilo Hagendorff , Ishita Dasgupta , Marcel Binz , Stephanie C. Y. Chan , Andrew Lampinen , Jane X. Wang , Zeynep Akata , Eric Schulz

Standardized, validated questionnaires are vital tools in research and healthcare, offering dependable self-report data. Prior work has revealed that virtual agent-administered questionnaires are almost equivalent to self-administered ones…

Human-Computer Interaction · Computer Science 2024-07-09 Hye Sun Yun , Mehdi Arjmand , Phillip Sherlock , Michael K. Paasche-Orlow , James W. Griffith , Timothy Bickmore

An essential problem in artificial intelligence is whether LLMs can simulate human cognition or merely imitate surface-level behaviors, while existing datasets suffer from either synthetic reasoning traces or population-level aggregation,…

Computation and Language · Computer Science 2026-03-31 Yuxuan Gu , Lunjun Liu , Xiaocheng Feng , Kun Zhu , Weihong Zhong , Lei Huang , Bing Qin

As Large Language Models (LLMs) advance in their capabilities, researchers have increasingly employed them for social simulation. In this paper, we investigate whether interactions among LLM agents resemble those of humans. Specifically, we…

Computation and Language · Computer Science 2025-01-28 Naihao Deng , Rada Mihalcea