English
Related papers

Related papers: Contextualized Sequence Likelihood: Enhanced Confi…

200 papers

Large language models (LLMs) often produce answers with high certainty even when they are incorrect, making reliable confidence estimation essential for deployment in real-world scenarios. Verbalized confidence, where models explicitly…

Machine Learning · Computer Science 2026-05-13 Chen Li , Xiaoling Hu , Songzhu Zheng , Jiawei Zhou , Chao Chen

A trustworthy real-world prediction system should produce well-calibrated confidence scores; that is, its confidence in an answer should be indicative of the likelihood that the answer is correct, enabling deferral to an expert in cases of…

Computation and Language · Computer Science 2023-10-25 Katherine Tian , Eric Mitchell , Allan Zhou , Archit Sharma , Rafael Rafailov , Huaxiu Yao , Chelsea Finn , Christopher D. Manning

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

This paper proposes the use of "multicalibration" to yield interpretable and reliable confidence scores for outputs generated by large language models (LLMs). Multicalibration asks for calibration not just marginally, but simultaneously…

Machine Learning · Statistics 2024-04-09 Gianluca Detommaso , Martin Bertran , Riccardo Fogliato , Aaron Roth

Despite the impressive capability of large language models (LLMs), knowing when to trust their generations remains an open challenge. The recent literature on uncertainty quantification of natural language generation (NLG) utilises a…

Computation and Language · Computer Science 2024-06-06 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Large Language Models (LLMs) have recently enabled natural language interfaces that translate user queries into executable SQL, offering a powerful solution for non-technical stakeholders to access structured data. However, one of the…

Applications · Statistics 2025-06-23 Jiekai Ma , Yikai Zhao

Large Language Models (LLMs) show promising results in language generation and instruction following but frequently "hallucinate", making their outputs less reliable. Despite Uncertainty Quantification's (UQ) potential solutions,…

Computation and Language · Computer Science 2024-05-30 Jinhao Duan , Hao Cheng , Shiqi Wang , Alex Zavalny , Chenan Wang , Renjing Xu , Bhavya Kailkhura , Kaidi Xu

Large language model (LLM) is an effective approach to addressing data scarcity in low-resource scenarios. Recent existing research designs hand-crafted prompts to guide LLM for data augmentation. We introduce a data augmentation strategy…

Computation and Language · Computer Science 2025-06-10 Yaping Chai , Haoran Xie , Joe S. Qin

Large Language Models (LLMs) are widely used to evaluate natural language generation tasks as automated metrics. However, the likelihood, a measure of LLM's plausibility for a sentence, can vary due to superficial differences in sentences,…

Computation and Language · Computer Science 2025-11-11 Masanari Oi , Masahiro Kaneko , Ryuto Koike , Mengsay Loem , Naoaki Okazaki

Large Language Models (LLMs) have demonstrated remarkable proficiency in various natural language generation (NLG) tasks. Previous studies suggest that LLMs' generation process involves uncertainty. However, existing approaches to…

Computation and Language · Computer Science 2024-09-06 Yu-Hsiang Wang , Andrew Bai , Che-Ping Tsai , Cho-Jui Hsieh

Large language models (LLMs) have shown high agreement with human raters across a variety of tasks, demonstrating potential to ease the challenges of human data collection. In computational social science (CSS), researchers are increasingly…

Computation and Language · Computer Science 2025-02-11 Kristina Gligorić , Tijana Zrnic , Cinoo Lee , Emmanuel J. Candès , Dan Jurafsky

Large language models (LLMs) are systematically overconfident: they routinely express high certainty on questions they often answer incorrectly. Existing calibration methods either require labeled validation data, degrade under distribution…

Computation and Language · Computer Science 2026-04-14 Mohamed Rissal Hedna , Jan Strich , Martin Semmann , Chris Biemann

Recently, pretrained language models (PLMs) have had exceptional success in language generation. To leverage the rich knowledge encoded by PLMs, a simple yet powerful paradigm is to use prompts in the form of either discrete tokens or…

Computation and Language · Computer Science 2022-10-04 Tianyi Tang , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

Recent work has proposed using Large Language Models (LLMs) to quantify narrative flow through a measure called sequentiality, which combines topic and contextual terms. A recent critique argued that the original results were confounded by…

Computation and Language · Computer Science 2025-11-13 Amal Sunny , Advay Gupta , Vishnu Sreekumar

With the widespread application of Large Language Models (LLMs) to various domains, concerns regarding the trustworthiness of LLMs in safety-critical scenarios have been raised, due to their unpredictable tendency to hallucinate and…

Computation and Language · Computer Science 2024-11-04 Xin Qiu , Risto Miikkulainen

Large language models (LLMs) have been found to produce hallucinations when the question exceeds their internal knowledge boundaries. A reliable model should have a clear perception of its knowledge boundaries, providing correct answers…

Computation and Language · Computer Science 2024-08-20 Shiyu Ni , Keping Bi , Lulu Yu , Jiafeng Guo

As the significance of understanding the cause-and-effect relationships among variables increases in the development of modern systems and algorithms, learning causality from observational data has become a preferred and efficient approach…

Machine Learning · Computer Science 2024-11-28 Xiaoxuan Li , Yao Liu , Ruoyu Wang , Lina Yao

Multi-level sentence simplification generates simplified sentences with varying language proficiency levels. We propose Label Confidence Weighted Learning (LCWL), a novel approach that incorporates a label confidence weighting scheme in the…

Computation and Language · Computer Science 2024-10-10 Xinying Qiu , Jingshen Zhang

Extended sequence generation often leads to degradation in contextual consistency due to the inability of conventional self-attention mechanisms to effectively retain long-range dependencies. Existing approaches, including memory…

Computation and Language · Computer Science 2025-01-30 Jonathan Teel , Jocasta Cumberbatch , Raphael Benington , Quentin Baskerville

As Large Language Models (LLMs) are increasingly deployed in decision-critical domains, it becomes essential to ensure that their confidence estimates faithfully correspond to their actual correctness. Existing calibration methods have…

Computation and Language · Computer Science 2025-08-21 Ke Fang , Tianyi Zhao , Lu Cheng