English
Related papers

Related papers: Psychometric Comparability of LLM-Based Digital Tw…

200 papers

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Large language models (LLMs) are increasingly involved in shaping public understanding on contested issues. This has led to substantial discussion about the potential of LLMs to reinforce or correct misperceptions. While existing literature…

Social and Information Networks · Computer Science 2025-06-09 Adiba Mahbub Proma , Neeley Pate , Sean Kelty , Gourab Ghoshal , James N. Druckman , Ehsan Hoque

Recent advances in large language models (LLMs) have enabled human-like social simulations at unprecedented scale and fidelity, offering new opportunities for computational social science. A key challenge, however, is the construction of…

Computation and Language · Computer Science 2025-10-07 Zhengyu Hu , Jianxun Lian , Zheyuan Xiao , Max Xiong , Yuxuan Lei , Tianfu Wang , Kaize Ding , Ziang Xiao , Nicholas Jing Yuan , Xing Xie

Subjective well-being is a key metric in economic, medical, and policy decision-making. As artificial intelligence provides scalable tools for modelling human outcomes, it is crucial to evaluate whether large language models (LLMs) can…

Human-Computer Interaction · Computer Science 2025-07-09 Pat Pataranutaporn , Nattavudh Powdthavee , Chayapatr Archiwaranguprok , Pattie Maes

Large Language Models (LLMs) demonstrate increasingly human-like abilities across a wide variety of tasks. In this paper, we investigate whether LLMs like ChatGPT can accurately infer the psychological dispositions of social media users and…

Computation and Language · Computer Science 2024-06-06 Heinrich Peters , Sandra Matz

Artificial intelligence has, so far, largely automated routine tasks, but what does it mean for the future of work if Large Language Models (LLMs) show creativity comparable to humans? To measure the creativity of LLMs holistically, the…

Artificial Intelligence · Computer Science 2025-05-22 Luning Sun , Yuzhuo Yuan , Yuan Yao , Yanyan Li , Hao Zhang , Xing Xie , Xiting Wang , Fang Luo , David Stillwell

Recent advancements in Large Language Models (LLMs) have led to their adaptation in various domains as conversational agents. We wonder: can personality tests be applied to these agents to analyze their behavior, similar to humans? We…

Recent studies have shown that prompting can enable large language models (LLMs) to simulate specific personality traits and produce behaviors that align with those traits. However, there is limited understanding of how these simulated…

Computation and Language · Computer Science 2026-01-06 Nuo Chen , Hanpei Fang , Piaohong Wang , Jiqun Liu , Tetsuya Sakai , Xiao-Ming Wu

This paper delves into the dynamic landscape of artificial intelligence, specifically focusing on the burgeoning prominence of large language models (LLMs). We underscore the pivotal role of Reinforcement Learning from Human Feedback (RLHF)…

Computers and Society · Computer Science 2024-03-18 Dana Alsagheer , Rabimba Karanjai , Nour Diallo , Weidong Shi , Yang Lu , Suha Beydoun , Qiaoning Zhang

As large language models (LLMs) are increasingly used to model and augment collective decision-making, it is critical to examine their alignment with human social reasoning. We present an empirical framework for assessing collective…

Artificial Intelligence · Computer Science 2025-10-03 Crystal Qian , Aaron Parisi , Clémentine Bouleau , Vivian Tsai , Maël Lebreton , Lucas Dixon

Large Language Models (LLMs) offer a promising alternative to traditional survey methods, potentially enhancing efficiency and reducing costs. In this study, we use LLMs to create virtual populations that answer survey questions, enabling…

Human-Computer Interaction · Computer Science 2025-03-24 Enzo Sinacola , Arnault Pachot , Thierry Petit

Neural network models of language have long been used as a tool for developing hypotheses about conceptual representation in the mind and brain. For many years, such use involved extracting vector-space representations of words and using…

Artificial Intelligence · Computer Science 2023-11-13 Siddharth Suresh , Kushin Mukherjee , Xizheng Yu , Wei-Chun Huang , Lisa Padua , Timothy T Rogers

The development of large language models (LLM) has revolutionized various fields and is anticipated to drive the advancement of autonomous systems. In the context of autonomous optical networks, creating a high-level cognitive agent in the…

Networking and Internet Architecture · Computer Science 2024-11-04 Yuchen Song , Yao Zhang , Anni Zhou , Yan Shi , Shikui Shen , Xiongyan Tang , Jin Li , Min Zhang , Danshi Wang

Transformer-based language models (LMs) continue to advance state-of-the-art performance on NLP benchmark tasks, including tasks designed to mimic human-inspired "commonsense" competencies. To better understand the degree to which LMs can…

Computation and Language · Computer Science 2021-06-15 Antonio Laverghetta , Animesh Nighojkar , Jamshidbek Mirzakhalov , John Licato

Large Language Models (LLMs) such as OpenAI's GPT-4 and Meta's LLaMA offer a promising approach for scalable personality assessment from open-ended language. However, inferring personality traits remains challenging, and earlier work often…

Computation and Language · Computer Science 2025-07-22 Jianfeng Zhu , Ruoming Jin , Karin G. Coifman

Large Language Models (LLMs) do not differentially represent numbers, which are pervasive in text. In contrast, neuroscience research has identified distinct neural representations for numbers and words. In this work, we investigate how…

Artificial Intelligence · Computer Science 2024-01-10 Raj Sanjay Shah , Vijay Marupudi , Reba Koenen , Khushi Bhardwaj , Sashank Varma

Large language models (LLMs) are increasingly used as substitutes for human subjects in behavioral simulations, including synthetic social network generation. Yet it remains unclear how their relational outputs depend on prompt design,…

Social and Information Networks · Computer Science 2026-05-14 Sai Hemanth Kilaru , Sriram Theerdh Manikyala , Raghav Upadhyay , Sri Sai Kumar Ramavath , Srivika Nunavathu , Dalal Alharthi

Researchers in social science and psychology have recently proposed using large language models (LLMs) as replacements for humans in behavioral research. In addition to arguments about whether LLMs accurately capture population-level…

Computation and Language · Computer Science 2025-07-09 Sonia K. Murthy , Tomer Ullman , Jennifer Hu

AI-based persona simulation -- often referred to as digital twin simulation -- is increasingly used for market research, recommender systems, and social sciences. Despite their flexibility, large language models (LLMs) often exhibit…

Machine Learning · Computer Science 2026-04-10 Grace Jiarui Fan , Chengpiao Huang , Tianyi Peng , Kaizheng Wang , Yuhang Wu

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela