English
Related papers

Related papers: FESTA: Functionally Equivalent Sampling for Trust …

200 papers

The tendency of Large Language Models (LLMs) to generate hallucinations raises concerns regarding their reliability. Therefore, confidence estimations indicating the extent of trustworthiness of the generations become essential. However,…

Computation and Language · Computer Science 2024-10-21 Boyang Xue , Hongru Wang , Rui Wang , Sheng Wang , Zezhong Wang , Yiming Du , Bin Liang , Kam-Fai Wong

The tendency of Large Language Models (LLMs) to generate hallucinations raises concerns regarding their reliability. Therefore, confidence estimations indicating the extent of trustworthiness of the generations become essential. However,…

Computation and Language · Computer Science 2025-05-27 Boyang Xue , Hongru Wang , Rui Wang , Sheng Wang , Zezhong Wang , Yiming Du , Bin Liang , Wenxuan Zhang , Kam-Fai Wong

Multimodal large language models (MLLMs) have recently achieved state-of-the-art performance on tasks ranging from visual question answering to video understanding. However, existing studies have concentrated mainly on visual-textual…

Machine Learning · Computer Science 2025-09-04 Yunkai Dang , Mengxi Gao , Yibo Yan , Xin Zou , Yanggan Gu , Jungang Li , Jingyu Wang , Peijie Jiang , Aiwei Liu , Jia Liu , Xuming Hu

To facilitate robust and trustworthy deployment of large language models (LLMs), it is essential to quantify the reliability of their generations through uncertainty estimation. While recent efforts have made significant advancements by…

Computation and Language · Computer Science 2025-07-22 Rui Li , Jing Long , Muge Qi , Heming Xia , Lei Sha , Peiyi Wang , Zhifang Sui

Large language models (LLMs) often behave inconsistently across inputs, indicating uncertainty and motivating the need for its quantification in high-stakes settings. Prior work on calibration and uncertainty quantification often focuses on…

Machine Learning · Computer Science 2025-09-08 Maya Kruse , Majid Afshar , Saksham Khatwani , Anoop Mayampurath , Guanhua Chen , Yanjun Gao

Large Language Models (LLMs) exhibit impressive performance across diverse domains but often suffer from overconfidence, limiting their reliability in critical applications. We propose SteerConf, a novel framework that systematically steers…

Computation and Language · Computer Science 2025-05-27 Ziang Zhou , Tianyuan Jin , Jieming Shi , Qing Li

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty…

Computation and Language · Computer Science 2025-05-30 Zhiqiu Xia , Jinxuan Xu , Yuqian Zhang , Hang Liu

This paper proposes the use of "multicalibration" to yield interpretable and reliable confidence scores for outputs generated by large language models (LLMs). Multicalibration asks for calibration not just marginally, but simultaneously…

Machine Learning · Statistics 2024-04-09 Gianluca Detommaso , Martin Bertran , Riccardo Fogliato , Aaron Roth

Large Language Models (LLMs) tend to be unreliable in the factuality of their answers. To address this problem, NLP researchers have proposed a range of techniques to estimate LLM's confidence over facts. However, due to the lack of a…

Computation and Language · Computer Science 2024-11-28 Matéo Mahaut , Laura Aina , Paula Czarnowska , Momchil Hardalov , Thomas Müller , Lluís Màrquez

Multi-modal Large Language Models (MLLMs) have recently exhibited impressive general-purpose capabilities by leveraging vision foundation models to encode the core concepts of images into representations. These are then combined with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Sara Ghazanfari , Alexandre Araujo , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Large Language Models (LLMs) exhibit remarkable fluency and competence across various natural language tasks. However, recent research has highlighted their sensitivity to variations in input prompts. To deploy LLMs in a safe and reliable…

Computation and Language · Computer Science 2025-04-30 Harsh Raj , Vipul Gupta , Domenic Rosati , Subhabrata Majumdar

Vision-Language Models (VLMs) have achieved remarkable progress in complex visual understanding across scientific and reasoning tasks. While performance benchmarking has advanced our understanding of these capabilities, the critical…

Artificial Intelligence · Computer Science 2026-01-27 Asif Azad , Mohammad Sadat Hossain , MD Sadik Hossain Shanto , M Saifur Rahman , Md Rizwan Parvez

Large Language Models (LLMs) have shown remarkable progress in multiple-choice question answering (MCQA), but their inherent unreliability, such as hallucination and overconfidence, limits their application in high-risk domains. To address…

Computation and Language · Computer Science 2025-08-08 Guang Yang , Xinyang Liu

Large language models (LLMs) have demonstrated remarkable performance across various real-world tasks. However, they often struggle to fully comprehend and effectively utilize their input contexts, resulting in responses that are unfaithful…

Computation and Language · Computer Science 2024-09-18 Qingru Zhang , Xiaodong Yu , Chandan Singh , Xiaodong Liu , Liyuan Liu , Jianfeng Gao , Tuo Zhao , Dan Roth , Hao Cheng

Large Language Models (LLMs) have become increasingly pervasive, finding applications across many industries and disciplines. Ensuring the trustworthiness of LLM outputs is paramount, where Uncertainty Estimation (UE) plays a key role. In…

Computation and Language · Computer Science 2025-11-06 Kevin Wang , Subre Abdoul Moktar , Jia Li , Kangshuo Li , Feng Chen

Despite their capabilities, Multimodal Large Language Models (MLLMs) may produce plausible but erroneous outputs, hindering reliable deployment. Accurate uncertainty metrics could enable escalation of unreliable queries to human experts or…

Artificial Intelligence · Computer Science 2026-03-02 Gregory Kang Ruey Lau , Hieu Dao , Nicole Kan Hui Lin , Bryan Kian Hsiang Low

Despite the superior capabilities of Multimodal Large Language Models (MLLMs) across diverse tasks, they still face significant trustworthiness challenges. Yet, current literature on the assessment of trustworthy MLLMs remains limited,…

Computation and Language · Computer Science 2024-12-09 Yichi Zhang , Yao Huang , Yitong Sun , Chang Liu , Zhe Zhao , Zhengwei Fang , Yifan Wang , Huanran Chen , Xiao Yang , Xingxing Wei , Hang Su , Yinpeng Dong , Jun Zhu

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

Computation and Language · Computer Science 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

The growing use of large language models (LLMs) has increased the need for automatic evaluation systems, particularly to address the challenge of information hallucination. Although existing faithfulness evaluation approaches have shown…

Computation and Language · Computer Science 2025-07-29 Carlo Alfano , Aymen Al Marjani , Zeno Jonke , Amin Mantrach , Saab Mansour , Marcello Federico

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

Computation and Language · Computer Science 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur