English
Related papers

Related papers: On the attribution of confidence to large language…

200 papers

Large Language Models (LLMs) have become increasingly powerful and ubiquitous, but their stochastic nature poses challenges to the reliability of their outputs. While deterministic settings can improve consistency, they do not guarantee…

Computation and Language · Computer Science 2025-02-19 Kayla Schroeder , Zach Wood-Doughty

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of tasks in various domains. Despite their impressive performance, they can be unreliable due to factual errors in their generations. Assessing their…

Computation and Language · Computer Science 2024-03-26 Jiahui Geng , Fengyu Cai , Yuxia Wang , Heinz Koeppl , Preslav Nakov , Iryna Gurevych

Anthropomorphism, or the attribution of human traits to technology, is an automatic and unconscious response that occurs even in those with advanced technical expertise. In this position paper, we analyze hundreds of thousands of research…

Computation and Language · Computer Science 2025-05-28 Lujain Ibrahim , Myra Cheng

Large Language Models (LLMs) increasingly show reasoning rationales alongside their answers, turning "reasoning" into a user-interface element. While step-by-step rationales are typically associated with model performance, how they…

Human-Computer Interaction · Computer Science 2026-03-10 Xin Sun , Shu Wei , Jos A Bosch , Isao Echizen , Saku Sugawara , Abdallah El Ali

The remarkable performance of large language models (LLMs) in content generation, coding, and common-sense reasoning has spurred widespread integration into many facets of society. However, integration of LLMs raises valid questions on…

Computation and Language · Computer Science 2025-07-03 Ola Shorinwa , Zhiting Mei , Justin Lidard , Allen Z. Ren , Anirudha Majumdar

Humans can attribute beliefs to others. However, it is unknown to what extent this ability results from an innate biological endowment or from experience accrued through child development, particularly exposure to language describing…

Computation and Language · Computer Science 2023-06-02 Sean Trott , Cameron Jones , Tyler Chang , James Michaelov , Benjamin Bergen

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

Computation and Language · Computer Science 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

The study explores whether current Large Language Models (LLMs) exhibit Theory of Mind (ToM) capabilities -- specifically, the ability to infer others' beliefs, intentions, and emotions from text. Given that LLMs are trained on language…

Computation and Language · Computer Science 2026-03-20 Anna Babarczy , Andras Lukacs , Peter Vedres , Zeteny Bujka

Large language models (LLMs) are known to generate plausible but false information across a wide range of contexts, yet the real-world magnitude and consequences of this hallucination problem remain poorly understood. Here we leverage a…

Digital Libraries · Computer Science 2026-05-11 Zhenyue Zhao , Yihe Wang , Toby Stuart , Mathijs De Vaan , Paul Ginsparg , Yian Yin

We posit that large language models (LLMs) should be capable of expressing their intrinsic uncertainty in natural language. For example, if the LLM is equally likely to output two contradicting answers to the same question, then its…

Computation and Language · Computer Science 2024-09-27 Gal Yona , Roee Aharoni , Mor Geva

The capabilities of large language models (LLMs) have raised concerns about their potential to create and propagate convincing narratives. Here, we study their performance in detecting convincing arguments to gain insights into LLMs'…

Computation and Language · Computer Science 2024-10-07 Paula Rescala , Manoel Horta Ribeiro , Tiancheng Hu , Robert West

The widespread success of large language models (LLMs) has been met with skepticism that they possess anything like human concepts or meanings. Contrary to claims that LLMs possess no meaning whatsoever, we argue that they likely capture…

Computation and Language · Computer Science 2022-08-15 Steven T. Piantadosi , Felix Hill

Large Language Models (LLMs) have transformed natural language processing and hold growing promise for advancing science, healthcare, and decision-making. Yet their training paradigms remain dominated by affirmation-based inference, akin to…

Artificial Intelligence · Computer Science 2025-12-05 Peter B. Walker , Hannah Davidson , Aiden Foster , Matthew Lienert , Thomas Pardue , Dale Russell

In this paper we argue that key, often sensational and misleading, claims regarding linguistic capabilities of Large Language Models (LLMs) are based on at least two unfounded assumptions; the assumption of language completeness and the…

Computation and Language · Computer Science 2024-07-15 Abeba Birhane , Marek McGann

Large Language Models often generate factually incorrect but plausible outputs, known as hallucinations. We identify a more insidious phenomenon, LLM delusion, defined as high belief hallucinations, incorrect outputs with abnormally high…

Computation and Language · Computer Science 2025-03-11 Hongshen Xu , Zixv yang , Zichen Zhu , Kunyao Lan , Zihan Wang , Mengyue Wu , Ziwei Ji , Lu Chen , Pascale Fung , Kai Yu

Generative large language models (LLMs) are incredibly useful, versatile, and promising tools. However, they will be of most use to political and social science researchers when they are used in a way that advances understanding about real…

Computers and Society · Computer Science 2025-04-08 Lisa P. Argyle , Ethan C. Busby , Joshua R. Gubler , Bryce Hepner , Alex Lyman , David Wingate

The rapid integration of large language models (LLMs) into everyday workflows has transformed how individuals perform cognitive tasks such as writing, programming, analysis, and multilingual communication. While prior research has focused…

Artificial Intelligence · Computer Science 2026-04-29 Hyunwoo Kim , Harin Yu , Hanau Yi

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. However, concerns have arisen regarding the trustworthiness of LLMs outputs, particularly in…

Computation and Language · Computer Science 2024-05-08 Danna Zheng , Danyang Liu , Mirella Lapata , Jeff Z. Pan

Millions of users turn to AI models for their information needs. It is conceivable that a large number of user queries contain assumptions that may be factually inaccurate. Prior work notes that large language models (LLMs) often fail to…

Computation and Language · Computer Science 2026-05-06 Rose Sathyanathan , Kinshuk Vasisht , Danish Pruthi

The rise of misinformation underscores the need for scalable and reliable fact-checking solutions. Large language models (LLMs) hold promise in automating fact verification, yet their effectiveness across global contexts remains uncertain.…

Social and Information Networks · Computer Science 2025-09-11 Ihsan A. Qazi , Zohaib Khan , Abdullah Ghani , Agha A. Raza , Zafar A. Qazi , Wassay Sajjad , Ayesha Ali , Asher Javaid , Muhammad Abdullah Sohail , Abdul H. Azeemi