English
Related papers

Related papers: Testing Uncertainty of Large Language Models for P…

200 papers

Large language models (LLMs) are increasingly used in high-stakes settings, where overconfident responses can mislead users. Reliable confidence estimation has been shown to enhance trust and task accuracy. Yet existing methods face…

Computation and Language · Computer Science 2025-09-30 Linwei Tao , Yi-Fan Yeh , Bo Kai , Minjing Dong , Tao Huang , Tom A. Lamb , Jialin Yu , Philip H. S. Torr , Chang Xu

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

Large language models (LLMs) are a promising venue for natural language understanding and generation tasks. However, current LLMs are far from reliable: they are prone to generate non-factual information and, more crucially, to contradict…

Machine Learning · Computer Science 2024-04-22 Diego Calanzone , Stefano Teso , Antonio Vergari

In day-to-day communication, people often approximate the truth - for example, rounding the time or omitting details - in order to be maximally helpful to the listener. How do large language models (LLMs) handle such nuanced trade-offs? To…

Computation and Language · Computer Science 2024-02-14 Ryan Liu , Theodore R. Sumers , Ishita Dasgupta , Thomas L. Griffiths

While large pretrained language models (PLMs) demonstrate incredible fluency and performance on many natural language tasks, recent work has shown that well-performing PLMs are very sensitive to what prompts are feed into them. Even when…

Computation and Language · Computer Science 2023-04-13 Harsh Raj , Domenic Rosati , Subhabrata Majumdar

Our work demonstrates that large language model (LLM) pre-trained on texts can not only solve pure math word problems, but also physics word problems, whose solution requires calculation and inference based on prior physical knowledge. We…

Computation and Language · Computer Science 2023-09-21 Jingzhe Ding , Yan Cen , Xinyuan Wei

Large language models (LLMs) could be valuable personal AI agents across various domains, provided they can precisely follow user instructions. However, recent studies have shown significant limitations in LLMs' instruction-following…

Artificial Intelligence · Computer Science 2025-03-31 Juyeon Heo , Miao Xiong , Christina Heinze-Deml , Jaya Narain

Large-language models (LLMs) and chatbot agents are known to provide wrong outputs at times, and it was recently found that this can never be fully prevented. Hence, uncertainty quantification plays a crucial role, aiming to quantify the…

Machine Learning · Computer Science 2025-05-29 Michael Kirchhof , Gjergji Kasneci , Enkelejda Kasneci

Large language models (LLMs) can produce erroneous responses that sound fluent and convincing, raising the risk that users will rely on these responses as if they were correct. Mitigating such overreliance is a key challenge. Through a…

Human-Computer Interaction · Computer Science 2025-02-13 Sunnie S. Y. Kim , Jennifer Wortman Vaughan , Q. Vera Liao , Tania Lombrozo , Olga Russakovsky

Large language models (LLMs) have been shown to possess impressive capabilities, while also raising crucial concerns about the faithfulness of their responses. A primary issue arising in this context is the management of (un)answerable…

Computation and Language · Computer Science 2023-11-14 Aviv Slobodkin , Omer Goldman , Avi Caciularu , Ido Dagan , Shauli Ravfogel

As large language models continue to be widely developed, robust uncertainty quantification techniques will become crucial for their safe deployment in high-stakes scenarios. In this work, we explore how conformal prediction can be used to…

Computation and Language · Computer Science 2023-07-11 Bhawesh Kumar , Charlie Lu , Gauri Gupta , Anil Palepu , David Bellamy , Ramesh Raskar , Andrew Beam

This study examines the use of Large Language Models (LLMs) for retrieving factual information, addressing concerns over their propensity to produce factually incorrect "hallucinated" responses or to altogether decline to even answer prompt…

Computation and Language · Computer Science 2024-03-15 Lauren Rhue , Sofie Goethals , Arun Sundararajan

There has been much recent interest in evaluating large language models for uncertainty calibration to facilitate model control and modulate user trust. Inference time uncertainty, which may provide a real-time signal to the model or…

Computation and Language · Computer Science 2025-08-12 Kyle Moore , Jesse Roberts , Daryl Watson

Multimodal large language models (MLLMs) combine visual and textual data for tasks such as image captioning and visual question answering. Proper uncertainty calibration is crucial, yet challenging, for reliable use in areas like healthcare…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zijun Chen , Wenbo Hu , Guande He , Zhijie Deng , Zheng Zhang , Richang Hong

Large language models (LLMs) have a wealth of knowledge that allows them to excel in various Natural Language Processing (NLP) tasks. Current research focuses on enhancing their performance within their existing knowledge. Despite their…

Computation and Language · Computer Science 2023-05-31 Zhangyue Yin , Qiushi Sun , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Xuanjing Huang

Large Language Models (LLMs) have shown remarkable success on a wide range of math and reasoning benchmarks. However, we observe that they often struggle when faced with unreasonable math problems. Instead of recognizing these issues,…

Computation and Language · Computer Science 2025-06-03 Jingyuan Ma , Damai Dai , Zihang Yuan , Rui li , Weilin Luo , Bin Wang , Qun Liu , Lei Sha , Zhifang Sui

If a Large Language Model (LLM) answers "yes" to the question "Are mountains tall?" then does it know what a mountain is? Can you rely on it responding correctly or incorrectly to other questions about mountains? The success of Large…

Computation and Language · Computer Science 2022-10-03 Pritish Sahu , Michael Cogswell , Yunye Gong , Ajay Divakaran

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

This paper evaluates whether large language models (LLMs) exhibit cognitive fan effects, similar to those discovered by Anderson in humans, after being pre-trained on human textual data. We conduct two sets of in-context recall experiments…

Computation and Language · Computer Science 2024-10-01 Jesse Roberts , Kyle Moore , Thao Pham , Oseremhen Ewaleifoh , Doug Fisher

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

Computation and Language · Computer Science 2024-04-16 Spencer M. Seals , Valerie L. Shalin