English
Related papers

Related papers: Psychometric Comparability of LLM-Based Digital Tw…

200 papers

With the advancement of large language models (LLMs), the focus in Conversational AI has shifted from merely generating coherent and relevant responses to tackling more complex challenges, such as personalizing dialogue systems. In an…

Computation and Language · Computer Science 2025-02-13 Maria Molchanova , Anna Mikhailova , Anna Korzanova , Lidiia Ostyakova , Alexandra Dolidze

This study evaluates the potential of a large language model for aiding in generation of semantic feature norms - a critical tool for evaluating conceptual structure in cognitive science. Building from an existing human-generated dataset,…

Computation and Language · Computer Science 2023-04-13 Siddharth Suresh , Kushin Mukherjee , Timothy T. Rogers

This paper presents a novel design of a multi-agent system framework that applies large language models (LLMs) to automate the parametrization of simulation models in digital twins. This framework features specialized LLM agents tasked with…

Artificial Intelligence · Computer Science 2024-07-23 Yuchen Xia , Daniel Dittler , Nasser Jazdi , Haonan Chen , Michael Weyrich

As Large Language Models (LLMs) continue to gain popularity due to their human-like traits and the intimacy they offer to users, their societal impact inevitably expands. This leads to the rising necessity for comprehensive studies to fully…

Artificial Intelligence · Computer Science 2025-01-07 Bojana Bodroza , Bojana M. Dinic , Ljubisa Bojic

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

Large language models (LLMs) have shown promise in representing individuals and communities, offering new ways to study complex social dynamics. However, effectively aligning LLMs with specific human groups and systematically assessing the…

Computation and Language · Computer Science 2025-02-12 Minh Duc Chu , Zihao He , Rebecca Dorn , Kristina Lerman

Large language models (LLMs) are increasingly used to model human social behavior, with recent research exploring their ability to simulate social dynamics. Here, we test whether LLMs mirror human behavior in social dilemmas, where…

Social and Information Networks · Computer Science 2024-11-18 Jin Han , Balaraju Battu , Ivan Romić , Talal Rahwan , Petter Holme

Psychological assessment tools have long helped humans understand behavioural patterns. While Large Language Models (LLMs) can generate content comparable to that of humans, we explore whether they exhibit personality traits. To this end,…

Computation and Language · Computer Science 2025-02-11 Pranav Bhandari , Usman Naseem , Amitava Datta , Nicolas Fay , Mehwish Nasim

Large language models (LLMs) are increasingly used in the social sciences to simulate human behavior, based on the assumption that they can generate realistic, human-like text. Yet this assumption remains largely untested. Existing…

Computation and Language · Computer Science 2025-11-26 Nicolò Pagan , Petter Törnberg , Christopher A. Bail , Anikó Hannák , Christopher Barrie

Psychological profiling of large language models (LLMs) using psychometric questionnaires designed for humans has become widespread. However, it remains unclear whether the resulting profiles mirror the models' psychological characteristics…

Computation and Language · Computer Science 2026-04-06 Woojung Song , Dongmin Choi , Yoonah Park , Jongwook Han , Yohan Jo

Large Language Models (LLMs) are exhibiting emergent human-like abilities and are increasingly envisioned as the foundation for simulating an individual's communication style, behavioral tendencies, and personality traits. However, current…

Computation and Language · Computer Science 2025-10-31 Bangde Du , Minghao Guo , Songming He , Ziyi Ye , Xi Zhu , Weihang Su , Shuqi Zhu , Yujia Zhou , Yongfeng Zhang , Qingyao Ai , Yiqun Liu

Large language models (LLMs) make it possible to generate synthetic behavioural data at scale, offering an ethical and low-cost alternative to human experiments. Whether such data can faithfully capture psychological differences driven by…

Computation and Language · Computer Science 2025-11-27 Manuel Pratelli , Marinella Petrocchi

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

Large language models (LLMs) are revolutionizing every aspect of society. They are increasingly used in problem-solving tasks to substitute human assessment and reasoning. LLMs are trained on what humans write and are thus exposed to human…

Software Engineering · Computer Science 2025-10-14 Fengfei Sun , Ningke Li , Kailong Wang , Lorenz Goette

Transformer-based language models (LMs) continue to achieve state-of-the-art performance on natural language processing (NLP) benchmarks, including tasks designed to mimic human-inspired "commonsense" competencies. To better understand the…

Computation and Language · Computer Science 2022-05-13 Antonio Laverghetta , Animesh Nighojkar , Jamshidbek Mirzakhalov , John Licato

Human decision-making belongs to the foundation of our society and civilization, but we are on the verge of a future where much of it will be delegated to artificial intelligence. The arrival of Large Language Models (LLMs) has transformed…

Artificial Intelligence · Computer Science 2025-06-23 Hao Li , Gengrui Zhang , Petter Holme , Shuyue Hu , Zhen Wang

Recent research has focused on examining Large Language Models' (LLMs) characteristics from a psychological standpoint, acknowledging the necessity of understanding their behavioral characteristics. The administration of personality tests…

Computation and Language · Computer Science 2024-10-07 Jen-tse Huang , Wenxiang Jiao , Man Ho Lam , Eric John Li , Wenxuan Wang , Michael R. Lyu

The recent surge of Large Language Models (LLMs) has led to claims that they are approaching a level of creativity akin to human capabilities. This idea has sparked a blend of excitement and apprehension. However, a critical piece that has…

Computation and Language · Computer Science 2025-07-03 Antoine Bellemare-Pepin , François Lespinasse , Philipp Thölke , Yann Harel , Kory Mathewson , Jay A. Olson , Yoshua Bengio , Karim Jerbi

Large language models (LLMs) are increasingly used to simulate human behavior in social settings such as legal mediation, negotiation, and dispute resolution. However, it remains unclear whether these simulations reproduce the…

Artificial Intelligence · Computer Science 2026-02-10 Deuksin Kwon , Kaleen Shrestha , Bin Han , Spencer Lin , James Hale , Jonathan Gratch , Maja Matarić , Gale M. Lucas

As Large Language Models (LLMs) become increasingly integrated into our everyday lives, understanding their ability to comprehend human mental states becomes critical for ensuring effective interactions. However, despite the recent attempts…

Computation and Language · Computer Science 2023-12-06 Kanishk Gandhi , Jan-Philipp Fränken , Tobias Gerstenberg , Noah D. Goodman