English
Related papers

Related papers: Are Large Language Models Chameleons? An Attempt t…

200 papers

Persona prompting is increasingly used in large language models (LLMs) to simulate views of various sociodemographic groups. However, how a persona prompt is formulated can significantly affect outcomes, raising concerns about the fidelity…

Computation and Language · Computer Science 2025-10-06 Marlene Lutz , Indira Sen , Georg Ahnert , Elisa Rogers , Markus Strohmaier

Modern language models are trained on large amounts of data. These data inevitably include controversial and stereotypical content, which contains all sorts of biases related to gender, origin, age, etc. As a result, the models express…

Computation and Language · Computer Science 2025-09-03 Aleksandra Sorokovikova , Pavel Chizhov , Iuliia Eremenko , Ivan P. Yamshchikov

Large language models (LLMs) hold the potential to absorb and reflect personality traits and attitudes specified by users. In our study, we investigated this potential using robust psychometric measures. We adapted the most studied test in…

Computation and Language · Computer Science 2025-12-19 Anton Vasiliuk , Irina Abdullaeva , Polina Druzhinina , Anton Razzhigaev , Andrey Kuznetsov

Large language models (LLMs) are increasingly used to simulate human responses in behavioral research, yet it remains unclear when LLM-generated data support the same experimental inferences as human data. We evaluate this by directly…

Human-Computer Interaction · Computer Science 2026-04-20 Adnan Hoq , Tim Weninger

The capabilities of large language models (LLMs) have raised concerns about their potential to create and propagate convincing narratives. Here, we study their performance in detecting convincing arguments to gain insights into LLMs'…

Computation and Language · Computer Science 2024-10-07 Paula Rescala , Manoel Horta Ribeiro , Tiancheng Hu , Robert West

Reliable simulation of human behavior is essential for explaining, predicting, and intervening in our society. Recent advances in large language models (LLMs) have shown promise in emulating human behaviors, interactions, and…

Computation and Language · Computer Science 2025-10-27 Ning Bian , Xianpei Han , Hongyu Lin , Baolei Wu , Jun Wang

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov

Large Language Models (LLMs) excel in text generation and understanding, especially in simulating socio-political and economic patterns, serving as an alternative to traditional surveys. However, their global applicability remains…

Computers and Society · Computer Science 2025-01-28 Andrés Abeliuk , Vanessa Gaete , Naim Bro

Most large language models (LLMs) are sensitive to prompts, and another synonymous expression or a typo may lead to unexpected results for the model. Composing an optimal prompt for a specific demand lacks theoretical support and relies…

Computation and Language · Computer Science 2024-06-18 Zhenyu Zhang , Bingguang Hao , Jinpeng Li , Zekai Zhang , Dongyan Zhao

The rise of Large Language Models (LLMs) has affected various disciplines that got beyond mere text generation. Going beyond their textual nature, this project proposal aims to investigate the interaction between LLMs and non-verbal…

Computation and Language · Computer Science 2024-02-01 Philipp Wicke

Large Language Models (LLMs) are a transformational technology, fundamentally changing how people obtain information and interact with the world. As people become increasingly reliant on them for an enormous variety of tasks, a body of…

Computers and Society · Computer Science 2025-05-08 Nouar Aldahoul , Hazem Ibrahim , Matteo Varvello , Aaron Kaufman , Talal Rahwan , Yasir Zaki

Large language models (LLMs) are transforming research on machine learning while galvanizing public debates. Understanding not only when these models work well and succeed but also why they fail and misbehave is of great societal relevance.…

Computation and Language · Computer Science 2024-10-16 Julian Coda-Forno , Kristin Witte , Akshay K. Jagadish , Marcel Binz , Zeynep Akata , Eric Schulz

This paper explores the potential of large language models (LLMs) as reliable analytical tools in linguistic research, focusing on the emergence of affective meanings in temporal expressions involving manner-of-motion verbs. While LLMs like…

Computation and Language · Computer Science 2025-07-15 Rosa Illan Castillo , Javier Valenzuela

This paper investigates the influence of cognitive biases on Large Language Models (LLMs) outputs. Cognitive biases, such as confirmation and availability biases, can distort user inputs through prompts, potentially leading to unfaithful…

Computation and Language · Computer Science 2025-06-17 Yan Sun , Stanley Kok

Large language models (LLMs) offer emerging opportunities for psychological and behavioral research, but methodological guidance is lacking. This article provides a framework for using LLMs as psychological simulators across two primary…

Computers and Society · Computer Science 2026-04-07 Zhicheng Lin

As Large Language Models (LLMs) increasingly appear in social science research (e.g., economics and marketing), it becomes crucial to assess how well these models replicate human behavior. In this work, using hypothesis testing, we present…

Computers and Society · Computer Science 2025-06-19 Harbin Hong , Sebastian Caldas , Liu Leqi

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

Large Language Models (LLMs) do not differentially represent numbers, which are pervasive in text. In contrast, neuroscience research has identified distinct neural representations for numbers and words. In this work, we investigate how…

Artificial Intelligence · Computer Science 2024-01-10 Raj Sanjay Shah , Vijay Marupudi , Reba Koenen , Khushi Bhardwaj , Sashank Varma

Social bias is shaped by the accumulation of social perceptions towards targets across various demographic identities. To fully understand such social bias in large language models (LLMs), it is essential to consider the composite of social…

Computation and Language · Computer Science 2024-06-07 Jisu Shin , Hoyun Song , Huije Lee , Soyeong Jeong , Jong C. Park

Large language models (LLMs) have transformed natural language processing, yet face challenges in specialized tasks such as simulating opinions on environmental policies. This paper introduces a novel fine-tuning approach that integrates…

Computation and Language · Computer Science 2024-12-10 Haocheng Lin