English
Related papers

Related papers: Whose Opinions Do Language Models Reflect?

200 papers

Large language models (LLMs) are increasingly used to support the analysis of complex financial disclosures, yet their reliability, behavioral consistency, and transparency remain insufficiently understood in high-stakes settings. This…

Computation and Language · Computer Science 2026-01-21 Md Talha Mohsin

State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human…

Computation and Language · Computer Science 2024-06-14 Michael Franke , Polina Tsvilodub , Fausto Carcassi

Large language models (LLMs) are becoming pervasive in everyday life, yet their propensity to reproduce biases inherited from training data remains a pressing concern. Prior investigations into bias in LLMs have focused on the association…

Computation and Language · Computer Science 2024-04-29 Messi H. J. Lee , Jacob M. Montgomery , Calvin K. Lai

Increasingly, studies are exploring using Large Language Models (LLMs) for accelerated or scaled qualitative analysis of text data. While we can compare LLM accuracy against human labels directly for deductive coding, or labeling text, it…

Computation and Language · Computer Science 2026-04-23 Melanie Subbiah , Haaris Mian , Nicholas Deas , Ananya Mayukha , Dan P. McAdams , Kathleen McKeown

With the increasing prevalence of artificial intelligence, careful evaluation of inherent biases needs to be conducted to form the basis for alleviating the effects these predispositions can have on users. Large language models (LLMs) are…

Computation and Language · Computer Science 2025-05-08 David Exler , Mark Schutera , Markus Reischl , Luca Rettenberger

Human feedback is increasingly used to steer the behaviours of Large Language Models (LLMs). However, it is unclear how to collect and incorporate feedback in a way that is efficient, effective and unbiased, especially for highly subjective…

Computation and Language · Computer Science 2023-10-12 Hannah Rose Kirk , Andrew M. Bean , Bertie Vidgen , Paul Röttger , Scott A. Hale

While large language models (LLMs) are proficient at question-answering (QA), it is not always clear how (or even if) an answer follows from their latent "beliefs". This lack of interpretability is a growing impediment to widespread use of…

Computation and Language · Computer Science 2023-10-31 Nora Kassner , Oyvind Tafjord , Ashish Sabharwal , Kyle Richardson , Hinrich Schuetze , Peter Clark

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but the quality bar for medical and clinical applications is high. Today, attempts to assess models' clinical knowledge…

In subjective decision-making, where decisions are based on contextual interpretation, Large Language Models (LLMs) can be integrated to present users with additional rationales to consider. The diversity of these rationales is mediated by…

Human-Computer Interaction · Computer Science 2025-02-21 Paula Akemi Aoyagui , Kelsey Stemmler , Sharon Ferguson , Young-ho Kim , Anastasia Kuzminykh

Modern AI technology like Large language models (LLMs) has the potential to pollute the public information sphere with made-up content, which poses a significant threat to the cohesion of societies at large. A wide range of research has…

Computation and Language · Computer Science 2024-07-19 Steffen Herbold , Alexander Trautsch , Zlata Kikteva , Annette Hautli-Janisz

As large language models (LLMs) advance to produce human-like arguments in some contexts, the number of settings applicable for human-AI collaboration broadens. Specifically, we focus on subjective decision-making, where a decision is…

Human-Computer Interaction · Computer Science 2024-04-22 Sharon Ferguson , Paula Akemi Aoyagui , Young-Ho Kim , Anastasia Kuzminykh

Creating human-like large language model (LLM) agents is crucial for faithful social simulation. Having LLMs role-play based on demographic information sometimes improves human likeness but often does not. This study assessed whether LLM…

Computation and Language · Computer Science 2024-10-17 Yun-Shiuan Chuang , Krirk Nirunwiroj , Zach Studdiford , Agam Goyal , Vincent V. Frigo , Sijia Yang , Dhavan Shah , Junjie Hu , Timothy T. Rogers

In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language…

Computation and Language · Computer Science 2025-03-11 Ryan Liu , Jiayi Geng , Joshua C. Peterson , Ilia Sucholutsky , Thomas L. Griffiths

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

Warning: This research studies AI persuasion and bias amplification that could be misused; all experiments are for safety evaluation. Large Language Models (LLMs) now generate convincing, human-like text and are widely used in content…

Computation and Language · Computer Science 2025-08-25 Saumya Roy

Large Language Models (LLMs) have emerged as potent tools for advancing the United Nations' Sustainable Development Goals (SDGs). However, the attitudinal disparities between LLMs and humans towards these goals can pose significant…

Computers and Society · Computer Science 2025-01-17 Qingyang Wu , Ying Xu , Tingsong Xiao , Yunze Xiao , Yitong Li , Tianyang Wang , Yichi Zhang , Shanghai Zhong , Yuwei Zhang , Wei Lu , Yifan Yang

Cognitive diversity, reflected in variations of language, perspective, and reasoning, is essential to creativity and collective intelligence. This diversity is rich and grounded in culture, history, and individual experience. Yet as large…

Computation and Language · Computer Science 2026-01-07 Zhivar Sourati , Alireza S. Ziabari , Morteza Dehghani

Psychological profiling of large language models (LLMs) using psychometric questionnaires designed for humans has become widespread. However, it remains unclear whether the resulting profiles mirror the models' psychological characteristics…

Computation and Language · Computer Science 2026-04-06 Woojung Song , Dongmin Choi , Yoonah Park , Jongwook Han , Yohan Jo

Social cognitive theory explains how people learn and acquire knowledge through observing others. Recent years have witnessed the rapid development of large language models (LLMs), which suggests their potential significance as agents in…

Computation and Language · Computer Science 2023-10-23 Ning Bian , Hongyu Lin , Peilin Liu , Yaojie Lu , Chunkang Zhang , Ben He , Xianpei Han , Le Sun

Large Language Models (LLMs) are increasingly used in everyday life and research. One of the most common use cases is conversational interactions, enabled by the language generation capabilities of LLMs. Just as between two humans, a…

Computation and Language · Computer Science 2024-11-12 Jingyao Zheng , Xian Wang , Simo Hosio , Xiaoxian Xu , Lik-Hang Lee