中文
相关论文

相关论文: A Probabilistic Framework for LLM Hallucination De…

200 篇论文

We develop a principled procedure for determining when a large language model (LLM) should abstain from responding (e.g., by saying "I don't know") in a general domain, instead of resorting to possibly "hallucinating" a non-sensical or…

Large Language Models (LLMs) are being increasingly deployed in real-world applications, but they remain susceptible to hallucinations, which produce fluent yet incorrect responses and lead to erroneous decision-making. Uncertainty…

机器学习 · 计算机科学 2025-12-02 Huan Ma , Jiadong Pan , Jing Liu , Yan Chen , Joey Tianyi Zhou , Guangyu Wang , Qinghua Hu , Hua Wu , Changqing Zhang , Haifeng Wang

Although pretrained language models (PTLMs) have been shown to contain significant amounts of world knowledge, they can still produce inconsistent answers to questions when probed, even after using specialized training techniques to reduce…

计算与语言 · 计算机科学 2021-10-08 Nora Kassner , Oyvind Tafjord , Hinrich Schutze , Peter Clark

Advancements in Large Vision-Language Models (LVLMs) have demonstrated promising performance in a variety of vision-language tasks involving image-conditioned free-form text generation. However, growing concerns about hallucinations in…

机器学习 · 计算机科学 2025-03-03 Zhuohang Li , Chao Yan , Nicholas J. Jackson , Wendi Cui , Bo Li , Jiaxin Zhang , Bradley A. Malin

The development of Large Language Models (LLMs) has significantly advanced various AI applications in commercial and scientific research fields, such as scientific literature summarization, writing assistance, and knowledge graph…

计算与语言 · 计算机科学 2024-10-17 Huiwen Wu , Xiaohan Li , Xiaogang Xu , Jiafei Wu , Deyi Zhang , Zhe Liu

Large Language Models (LLMs) have transformed natural language processing (NLP) tasks, but they suffer from hallucination, generating plausible yet factually incorrect content. This issue extends to Video-Language Models (VideoLLMs), where…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

We explore uncertainty quantification in large language models (LLMs), with the goal to identify when uncertainty in responses given a query is large. We simultaneously consider both epistemic and aleatoric uncertainties, where the former…

机器学习 · 计算机科学 2024-07-18 Yasin Abbasi Yadkori , Ilja Kuzborskij , András György , Csaba Szepesvári

Large Language Models (LLMs) are widely used to generate plausible text on online platforms, without revealing the generation process. As users increasingly encounter such black-box outputs, detecting hallucinations has become a critical…

计算与语言 · 计算机科学 2026-04-08 Joosung Lee , Cheonbok Park , Hwiyeol Jo , Jeonghoon Kim , Joonsuk Park , Kang Min Yoo

Vision Language models (VLMs) often hallucinate non-existent objects. Detecting hallucination is analogous to detecting deception: a single final statement is insufficient, one must examine the underlying reasoning process. Yet existing…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Abin Shoby , Ta Duc Huy , Tuan Dung Nguyen , Minh Khoi Ho , Qi Chen , Anton van den Hengel , Phi Le Nguyen , Johan W. Verjans , Vu Minh Hieu Phan

The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major…

计算与语言 · 计算机科学 2025-12-01 Zhongxin Liu , Zhiwei Wang , Jun Niu , Ying Li , Hongyu Sun , Meng Xu , He Wang , Gaofei Wu , Yuqing Zhang

The rapidly developing Large Vision Language Models (LVLMs) have shown notable capabilities on a range of multi-modal tasks, but still face the hallucination phenomena where the generated texts do not align with the given contexts,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Wenyi Xiao , Ziwei Huang , Leilei Gan , Wanggui He , Haoyuan Li , Zhelun Yu , Fangxun Shu , Hao Jiang , Linchao Zhu

Multimodal hallucination in multimodal large language models (MLLMs) restricts the correctness of MLLMs. However, multimodal hallucinations are multi-sourced and arise from diverse causes. Existing benchmarks fail to adequately distinguish…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Bowen Dong , Minheng Ni , Zitong Huang , Guanglei Yang , Wangmeng Zuo , Lei Zhang

A frequently observed problem with LLMs is their tendency to generate output that is nonsensical, illogical, or factually incorrect, often referred to broadly as hallucination. Building on the recently proposed HalluciGen task for…

计算与语言 · 计算机科学 2025-04-30 Evangelia Gogoulou , Shorouq Zahra , Liane Guillou , Luise Dürlich , Joakim Nivre

Large language models (LLMs) often generate responses that deviate from user input or training data, a phenomenon known as "hallucination." These hallucinations undermine user trust and hinder the adoption of generative AI systems.…

计算与语言 · 计算机科学 2025-04-25 Yejin Bang , Ziwei Ji , Alan Schelten , Anthony Hartshorn , Tara Fowler , Cheng Zhang , Nicola Cancedda , Pascale Fung

Large language models (LLMs) now achieve near-human performance on standard math word problem benchmarks (e.g., GSM8K), yet their true reasoning ability remains disputed. A key concern is that models often produce confident, yet unfounded,…

计算与语言 · 计算机科学 2025-05-21 Jialin Ouyang

LLMs are often claimed to be capable of Natural Language Inference (NLI), which is widely regarded as a cornerstone of more complex forms of reasoning. However, recent works show that LLMs still suffer from hallucinations in NLI due to…

计算与语言 · 计算机科学 2025-03-17 Liang Cheng , Tianyi Li , Zhaowei Wang , Tianyang Liu , Mark Steedman

Large language models (LLMs) excel at various natural language processing tasks, but their tendency to generate hallucinations undermines their reliability. Existing hallucination detection methods leveraging hidden states predominantly…

计算与语言 · 计算机科学 2025-07-23 Zhenliang Zhang , Xinyu Hu , Huixuan Zhang , Junzhe Zhang , Xiaojun Wan

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

计算与语言 · 计算机科学 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao

While Large Language Models (LLM) are able to accumulate and restore knowledge, they are still prone to hallucination. Especially when faced with factual questions, LLM cannot only rely on knowledge stored in parameters to guarantee…

计算与语言 · 计算机科学 2024-01-04 Pierre Erbacher , Louis Falissar , Vincent Guigue , Laure Soulier

Large language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection. To overcome this issue, we propose a novel framework that leverages a small language…

计算与语言 · 计算机科学 2024-08-26 Mengya Hu , Rui Xu , Deren Lei , Yaxi Li , Mingyu Wang , Emily Ching , Eslam Kamal , Alex Deng