English
Related papers

Related papers: BAS: A Decision-Theoretic Approach to Evaluating L…

200 papers

Large language models (LLMs) are increasingly deployed in decision-making tasks, where not only accuracy but also reliable confidence estimates are essential. Well-calibrated confidence enables downstream systems to decide when to trust a…

Machine Learning · Computer Science 2026-01-21 Duygu Nur Yaldiz , Evangelia Spiliopoulou , Zheng Qi , Siddharth Varia , Srikanth Doss , Nikolaos Pappas

Language Models (LMs) have shown promising performance in natural language generation. However, as LMs often generate incorrect or hallucinated responses, it is crucial to correctly quantify their uncertainty in responding to given inputs.…

Computation and Language · Computer Science 2024-09-17 Xinmeng Huang , Shuo Li , Mengxin Yu , Matteo Sesia , Hamed Hassani , Insup Lee , Osbert Bastani , Edgar Dobriban

Large Language Models (LLMs) reproduce social biases, yet prevailing evaluations score models in isolation, obscuring how biases persist across families and releases. We introduce Bias Similarity Measurement (BSM), which treats fairness as…

Machine Learning · Computer Science 2025-09-26 Hyejun Jeong , Shiqing Ma , Amir Houmansadr

Large Language Model (LLM)-powered multi-agent systems (MAS) have rapidly advanced collaborative reasoning, tool use, and role-specialized coordination in complex tasks. However, reliability-critical deployment remains hindered by a…

Acquiescence bias, i.e. the tendency of humans to agree with statements in surveys, independent of their actual beliefs, is well researched and documented. Since Large Language Models (LLMs) have been shown to be very influenceable by…

Computation and Language · Computer Science 2025-09-11 Daniel Braun

Large Language Models (LLMs), including ChatGPT and LLaMA, are susceptible to generating hallucinated answers in a confident tone. While efforts to elicit and calibrate confidence scores have proven useful, recent findings show that…

Computation and Language · Computer Science 2024-10-24 Lihu Chen , Alexandre Perez-Lebel , Fabian M. Suchanek , Gaël Varoquaux

Confidence calibration is essential for making large language models (LLMs) reliable, yet existing training-free methods have been primarily studied under single-answer question answering. In this paper, we show that these methods break…

Computation and Language · Computer Science 2026-02-10 Yuhan Wang , Shiyu Ni , Zhikai Ding , Zihang Zhan , Yuanzi Li , Keping Bi

Despite their impressive performance, large language models (LLMs) such as ChatGPT are known to pose important risks. One such set of risks arises from misplaced confidence, whether over-confidence or under-confidence, that the models have…

Computation and Language · Computer Science 2024-08-06 Ke Shen , Mayank Kejriwal

Real-world settings where language models (LMs) are deployed -- in domains spanning healthcare, finance, and other forms of knowledge work -- require models to grapple with incomplete information and reason under uncertainty. Yet most LM…

Artificial Intelligence · Computer Science 2026-04-24 Alana Renda , Jillian Ross , Michael Cafarella , Jacob Andreas

Large language models (LLMs) often present answers with high apparent confidence despite lacking an explicit mechanism for reasoning about certainty or truth. While existing benchmarks primarily evaluate single-turn accuracy, truthfulness…

Computation and Language · Computer Science 2026-03-05 Mohammadreza Saadat , Steve Nemzer

As large language models (LLMs) continue to advance in capabilities, ensuring their safety against jailbreak attacks remains a critical challenge. In this paper, we introduce a novel safety alignment approach called Answer-Then-Check, which…

Machine Learning · Computer Science 2026-03-09 Chentao Cao , Xiaojun Xu , Bo Han , Hang Li

We establish empirical bounds on behavioral inference through controlled experiments at scale: LLM-based agents assigned one of 36 behavioral profiles (9 belief systems x 4 motivations) generate over 1.5 million behavioral sequences across…

Multiagent Systems · Computer Science 2026-03-10 Jason Starace , Terence Soule

A binary decision task, like yes-no questions or answer verification, reflects a significant real-world scenario such as where users look for confirmation about the correctness of their decisions on specific issues. In this work, we observe…

Computation and Language · Computer Science 2025-04-30 Sangwon Yu , Jongyoon Song , Bongkyu Hwang , Hoyoung Kang , Sooah Cho , Junhwa Choi , Seongho Joe , Taehee Lee , Youngjune L. Gwon , Sungroh Yoon

There is a growing literature on reasoning by large language models (LLMs), but the discussion on the uncertainty in their responses is still lacking. Our aim is to assess the extent of confidence that LLMs have in their answers and how it…

Computation and Language · Computer Science 2024-12-23 Yudi Pawitan , Chris Holmes

When answering questions, LLMs can convey not only an answer, but a level of confidence about the answer being correct. This includes explicit confidence markers (e.g. giving a numeric score) as well as implicit markers, like an…

Computation and Language · Computer Science 2024-07-04 Elias Stengel-Eskin , Peter Hase , Mohit Bansal

As Large Language Models (LLMs) expand in capability and application scope, their trustworthiness becomes critical. A vital risk is intrinsic deception, wherein models strategically mislead users to achieve their own objectives. Existing…

Machine Learning · Computer Science 2026-03-31 Guoxi Zhang , Jiawei Chen , Tianzhuo Yang , Lang Qin , Juntao Dai , Yaodong Yang , Jingwei Yi

Large language models (LLMs) excel on static benchmarks, but their performance across multi-turn conversations, which better reflect real-world usage, remains understudied. Addressing this gap is critical in high-stakes settings like…

Computation and Language · Computer Science 2026-05-27 Kevin H. Guo , Chao Yan , Avinash Baidya , Katherine Brown , Xiang Gao , Juming Xiong , Zhijun Yin , Bradley A. Malin

Large Language Models (LLMs) show remarkable proficiency in natural language tasks, yet their frequent overconfidence-misalignment between predicted confidence and true correctness-poses significant risks in critical decision-making…

Computation and Language · Computer Science 2025-12-15 Prateek Chhikara

As large language models (LLMs) are increasingly used in high-stakes domains, accurately assessing their confidence is crucial. Humans typically express confidence through epistemic markers (e.g., "fairly confident") instead of numerical…

Computation and Language · Computer Science 2026-04-14 Jiayu Liu , Qing Zong , Weiqi Wang , Yangqiu Song

The increase in computing power and the necessity of AI-assisted decision-making boost the growing application of large language models (LLMs). Along with this, the potential retention of sensitive data of LLMs has spurred increasing…

Computation and Language · Computer Science 2026-04-20 Chenchen Tan , Youyang Qu , Xinghao Li , Hui Zhang , Shujie Cui , Cunjian Chen , Longxiang Gao