English
Related papers

Related papers: Benchmarking LLMs via Uncertainty Quantification

200 papers

The rapid proliferation of large language models (LLMs) has stimulated researchers to seek effective and efficient approaches to deal with LLM hallucinations and low-quality outputs. Uncertainty quantification (UQ) is a key element of…

The remarkable performance of large language models (LLMs) in content generation, coding, and common-sense reasoning has spurred widespread integration into many facets of society. However, integration of LLMs raises valid questions on…

Computation and Language · Computer Science 2025-07-03 Ola Shorinwa , Zhiting Mei , Justin Lidard , Allen Z. Ren , Anirudha Majumdar

Large language models (LLMs) have demonstrated remarkable capabilities across various tasks. However, these models could offer biased, hallucinated, or non-factual responses camouflaged by their fluency and realistic appearance. Uncertainty…

Computation and Language · Computer Science 2025-05-30 Zhiqiu Xia , Jinxuan Xu , Yuqian Zhang , Hang Liu

Large Language Models (LLMs) have been transformative across many domains. However, hallucination, i.e., confidently outputting incorrect information, remains one of the leading challenges for LLMs. This raises the question of how to…

Computation and Language · Computer Science 2026-03-19 Toghrul Abbasli , Kentaroh Toyoda , Yuan Wang , Leon Witt , Muhammad Asif Ali , Yukai Miao , Dan Li , Qingsong Wei

In recent years, Large Language Models (LLMs) have become fundamental to a broad spectrum of artificial intelligence applications. As the use of LLMs expands, precisely estimating the uncertainty in their predictions has become crucial.…

Artificial Intelligence · Computer Science 2024-10-29 Mohammad Beigi , Sijia Wang , Ying Shen , Zihao Lin , Adithya Kulkarni , Jianfeng He , Feng Chen , Ming Jin , Jin-Hee Cho , Dawei Zhou , Chang-Tien Lu , Lifu Huang

The recent performance leap of Large Language Models (LLMs) opens up new opportunities across numerous industrial applications and domains. However, erroneous generations, such as false predictions, misinformation, and hallucination made by…

Software Engineering · Computer Science 2025-01-07 Yuheng Huang , Jiayang Song , Zhijie Wang , Shengming Zhao , Huaming Chen , Felix Juefei-Xu , Lei Ma

The rapid rise of large language models (LLMs) is reshaping the landscape of automatic assessment in education. While these systems demonstrate substantial advantages in adaptability to diverse question types and flexibility in output…

Prompt optimization algorithms for Large Language Models (LLMs) excel in multi-step reasoning but still lack effective uncertainty estimation. This paper introduces a benchmark dataset to evaluate uncertainty metrics, focusing on Answer,…

Machine Learning · Computer Science 2024-12-30 Pei-Fu Guo , Yun-Da Tsai , Shou-De Lin

Large Language Models (LLMs) excel in text generation, reasoning, and decision-making, enabling their adoption in high-stakes domains such as healthcare, law, and transportation. However, their reliability is a major concern, as they often…

Computation and Language · Computer Science 2025-06-05 Xiaoou Liu , Tiejin Chen , Longchao Da , Chacha Chen , Zhen Lin , Hua Wei

Large Language Models (LLMs) are increasingly assisting users in the real world, yet their reliability remains a concern. Uncertainty quantification (UQ) has been heralded as a tool to enhance human-LLM collaboration by enabling users to…

Computation and Language · Computer Science 2025-06-10 Siddartha Devic , Tejas Srinivasan , Jesse Thomason , Willie Neiswanger , Vatsal Sharan

Despite recent progress in systematic evaluation frameworks, benchmarking the uncertainty of large language models (LLMs) remains a highly challenging task. Existing methods for benchmarking the uncertainty of LLMs face three key…

Computation and Language · Computer Science 2025-06-05 Xunzhi Wang , Zhuowei Zhang , Gaonan Chen , Qiongyu Li , Bitong Luo , Zhixin Han , Haotian Wang , Zhiyu li , Hang Gao , Mengting Hu

As large language models (LLMs) continue to evolve, understanding and quantifying the uncertainty in their predictions is critical for enhancing application credibility. However, the existing literature relevant to LLM uncertainty…

Computation and Language · Computer Science 2024-10-22 Hsiu-Yuan Huang , Yutong Yang , Zhaoxi Zhang , Sanwoo Lee , Yunfang Wu

Large language models (LLMs) have shown strong capabilities, enabling concise, context-aware answers in question answering (QA) tasks. The lack of transparency in complex LLMs has inspired extensive research aimed at developing methods to…

Computation and Language · Computer Science 2025-09-22 Yangyi Li , Mengdi Huai

Large language models (LLMs) are rapidly being integrated into computational social science research, yet their blackboxed training and designed stochastic elements in inference pose unique challenges for scientific inquiry. This article…

Computers and Society · Computer Science 2025-12-08 Bolun Zhang , Linzhuo Li , Yunqi Chen , Qinlin Zhao , Zihan Zhu , Xiaoyuan Yi , Xing Xie

Modern Large Language Models (LLMs) often require external tools, such as machine learning classifiers or knowledge retrieval systems, to provide accurate answers in domains where their pre-trained knowledge is insufficient. This…

Machine Learning · Computer Science 2025-05-23 Panagiotis Lymperopoulos , Vasanth Sarathy

Vision-Language Models (VLMs) have achieved remarkable progress in complex visual understanding across scientific and reasoning tasks. While performance benchmarking has advanced our understanding of these capabilities, the critical…

Artificial Intelligence · Computer Science 2026-01-27 Asif Azad , Mohammad Sadat Hossain , MD Sadik Hossain Shanto , M Saifur Rahman , Md Rizwan Parvez

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Large language models (LLMs) are stochastic, and not all models give deterministic answers, even when setting temperature to zero with a fixed random seed. However, few benchmark studies attempt to quantify uncertainty, partly due to the…

Computation and Language · Computer Science 2025-06-30 Robert E. Blackwell , Jon Barry , Anthony G. Cohn

Language Models (LMs) have shown promising performance in natural language generation. However, as LMs often generate incorrect or hallucinated responses, it is crucial to correctly quantify their uncertainty in responding to given inputs.…

Computation and Language · Computer Science 2024-09-17 Xinmeng Huang , Shuo Li , Mengxin Yu , Matteo Sesia , Hamed Hassani , Insup Lee , Osbert Bastani , Edgar Dobriban

Large Language Models (LLMs) are increasingly used as powerful tools for several high-stakes natural language processing (NLP) applications. Recent prompting works claim to elicit intermediate reasoning steps and key tokens that serve as…

Computation and Language · Computer Science 2023-11-08 Sree Harsha Tanneru , Chirag Agarwal , Himabindu Lakkaraju
‹ Prev 1 2 3 10 Next ›