中文
相关论文

相关论文: Improving Semantic Uncertainty Quantification in L…

200 篇论文

Large Language Models (LLMs) have become increasingly pervasive, finding applications across many industries and disciplines. Ensuring the trustworthiness of LLM outputs is paramount, where Uncertainty Estimation (UE) plays a key role. In…

计算与语言 · 计算机科学 2025-11-06 Kevin Wang , Subre Abdoul Moktar , Jia Li , Kangshuo Li , Feng Chen

Large Vision-Language Models (LVLMs) frequently hallucinate, limiting their safe deployment in real-world applications. Existing LLM self-evaluation methods rely on a model's ability to estimate the correctness of its own outputs, which can…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Seongheon Park , Changdae Oh , Hyeong Kyu Choi , Sean Du , Sharon Li

Large language models (LLMs) have transformed natural language processing, but their reliable deployment requires effective uncertainty quantification (UQ). Existing UQ methods are often heuristic and lack a probabilistic interpretation.…

计算与语言 · 计算机科学 2025-11-06 Haoyi Song , Ruihan Ji , Naichen Shi , Fan Lai , Raed Al Kontar

Uncertainty estimation is essential for robust decision-making in the presence of ambiguous or out-of-distribution inputs. Gaussian Processes (GPs) are classical kernel-based models that offer principled uncertainty quantification and…

机器学习 · 统计学 2026-04-30 Albert Saiapin , Kim Batselier

We propose semantic entropy probes (SEPs), a cheap and reliable method for uncertainty quantification in Large Language Models (LLMs). Hallucinations, which are plausible-sounding but factually incorrect and arbitrary model generations,…

计算与语言 · 计算机科学 2024-06-25 Jannik Kossen , Jiatong Han , Muhammed Razzak , Lisa Schut , Shreshth Malik , Yarin Gal

Uncertainty estimation is crucial for the reliability of safety-critical human and artificial intelligence (AI) interaction systems, particularly in the domain of healthcare engineering. However, a robust and general uncertainty measure for…

计算与语言 · 计算机科学 2024-11-19 Zhiyuan Wang , Jinhao Duan , Chenxi Yuan , Qingyu Chen , Tianlong Chen , Yue Zhang , Ren Wang , Xiaoshuang Shi , Kaidi Xu

Large language models (LLMs) produce outputs with varying levels of uncertainty, and, just as often, varying levels of correctness; making their practical reliability far from guaranteed. To quantify this uncertainty, we systematically…

计算与语言 · 计算机科学 2025-10-24 Christian Hobelsberger , Theresa Winner , Andreas Nawroth , Oliver Mitevski , Anna-Carolina Haensch

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

人工智能 · 计算机科学 2026-01-13 Pranav Kallem

Large Language Models (LLMs) are increasingly employed in real-world applications, driving the need to evaluate the trustworthiness of their generated text. To this end, reliable uncertainty estimation is essential. Leading uncertainty…

机器学习 · 计算机科学 2026-04-21 Lukas Aichberger , Kajetan Schweighofer , Sepp Hochreiter

Language Models (LMs) have shown promising performance in natural language generation. However, as LMs often generate incorrect or hallucinated responses, it is crucial to correctly quantify their uncertainty in responding to given inputs.…

计算与语言 · 计算机科学 2024-09-17 Xinmeng Huang , Shuo Li , Mengxin Yu , Matteo Sesia , Hamed Hassani , Insup Lee , Osbert Bastani , Edgar Dobriban

In this letter, we present a unified Bayesian inference framework for generalized linear models (GLM) which iteratively reduces the GLM problem to a sequence of standard linear model (SLM) problems. This framework provides new perspectives…

信息论 · 计算机科学 2018-03-14 Xiangming Meng , Sheng Wu , Jiang Zhu

Due to the presence of the natural gap between Knowledge Graph (KG) structures and the natural language, the effective integration of holistic structural information of KGs with Large Language Models (LLMs) has emerged as a significant…

计算与语言 · 计算机科学 2025-01-31 Qika Lin , Tianzhe Zhao , Kai He , Zhen Peng , Fangzhi Xu , Ling Huang , Jingying Ma , Mengling Feng

LiDAR bundle adjustment (BA) is an effective approach to reduce the drifts in pose estimation from the front-end. Existing works on LiDAR BA usually rely on predefined geometric features for landmark representation. This reliance restricts…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Xingyu Ji , Shenghai Yuan , Jianping Li , Pengyu Yin , Haozhi Cao , Lihua Xie

Large Vision-Language Models face growing safety challenges with multimodal inputs. This paper introduces the concept of Implicit Reasoning Safety, a vulnerability in LVLMs. Benign combined inputs trigger unsafe LVLM outputs due to flawed…

人工智能 · 计算机科学 2025-08-13 Wei Cai , Jian Zhao , Yuchu Jiang , Tianle Zhang , Xuelong Li

Large language models (LLMs) store vast amounts of information, making them powerful yet raising privacy and safety concerns when selective knowledge removal is required. Existing unlearning strategies, ranging from gradient-based…

计算与语言 · 计算机科学 2025-06-02 Xu Wang , Zihao Li , Benyou Wang , Yan Hu , Difan Zou

Large language models have been widely applied to sequential recommendation tasks, yet during inference, they continue to rely on decoding strategies developed for natural language processing. This creates a mismatch between text-generation…

信息检索 · 计算机科学 2025-09-01 Chenke Yin , Li Fan , Jia Wang , Dongxiao Hu , Haichao Zhang , Chong Zhang , Yang Xiang

Medical Visual Question Answering (MVQA) systems can interpret medical images in response to natural language queries. However, linguistic variability in question phrasing often undermines the consistency of these systems. To address this…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Yongpei Ma , Pengyu Wang , Adam Dunn , Usman Naseem , Jinman Kim

Understanding why a large language model (LLM) is uncertain about the response is important for their reliable deployment. Current approaches, which either provide a single uncertainty score or rely on the classical aleatoric-epistemic…

人工智能 · 计算机科学 2026-03-27 Aditya Taparia , Ransalu Senanayake , Kowshik Thopalli , Vivek Narayanaswamy

The recent rapid development of Large Vision-Language Models (LVLMs) has indicated their potential for embodied tasks.However, the critical skill of spatial understanding in embodied environments has not been thoroughly evaluated, leaving…

人工智能 · 计算机科学 2024-06-11 Mengfei Du , Binhao Wu , Zejun Li , Xuanjing Huang , Zhongyu Wei

The robustness of Vision Language Models (VLMs) is commonly assessed through output-level invariance, implicitly assuming that stable predictions reflect stable multimodal processing. In this work, we argue that this assumption is…