中文
相关论文

相关论文: HaluEval: A Large-Scale Hallucination Evaluation B…

200 篇论文

Hallucinations pose a significant obstacle to the reliability and widespread adoption of language models, yet their accurate measurement remains a persistent challenge. While many task- and domain-specific metrics have been proposed to…

Hallucinations in large language models (LLMs) have recently become a significant problem. A recent effort in this direction is a shared task at Semeval 2024 Task 6, SHROOM, a Shared-task on Hallucinations and Related Observable…

计算与语言 · 计算机科学 2024-04-12 Rahul Mehta , Andrew Hoblitzell , Jack O'Keefe , Hyeju Jang , Vasudeva Varma

Large language models (LLMs) are prone to hallucinations, i.e., statements unsupported by the input or training data, hindering reliable deployment. In parallel, numerous uncertainty estimation (UE) methods have been proposed to quantify…

计算与语言 · 计算机科学 2026-05-27 Yedidia Agnimo , Anna Korba , Annabelle Blangero , Nicolas Chesneau , Karteek Alahari

Hallucination remains a persistent challenge in Large Language Models (LLMs), particularly in context-grounded settings such as RAG and agentic AI systems. This study focuses on contextual hallucination detection in summarization tasks. We…

计算与语言 · 计算机科学 2026-05-12 I. F. Atasoy , B. Mutlu , E. A. Sezer , A. Wahdan

Advancements in Large Language Models (LLMs) and their increasing use in medical question-answering necessitate rigorous evaluation of their reliability. A critical challenge lies in hallucination, where models generate plausible yet…

计算与语言 · 计算机科学 2025-02-21 Shrey Pandit , Jiawei Xu , Junyuan Hong , Zhangyang Wang , Tianlong Chen , Kaidi Xu , Ying Ding

Large Language Models (LLMs) are trained on vast and diverse internet corpora that often include inaccurate or misleading content. Consequently, LLMs can generate misinformation, making robust fact-checking essential. This review…

Medical Large Language Models (MLLMs) have demonstrated potential in healthcare applications, yet their propensity for hallucinations -- generating medically implausible or inaccurate information -- presents substantial risks to patient…

计算与语言 · 计算机科学 2025-04-01 Kaiwen Zuo , Yirui Jiang

Large language models (LLMs) are highly capable but face latency challenges in real-time applications, such as conducting online hallucination detection. To overcome this issue, we propose a novel framework that leverages a small language…

计算与语言 · 计算机科学 2024-08-26 Mengya Hu , Rui Xu , Deren Lei , Yaxi Li , Mingyu Wang , Emily Ching , Eslam Kamal , Alex Deng

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an impressive ability to comprehend medical images and text…

Faithfulness hallucinations are claims generated by a Large Language Model (LLM) not supported by contexts provided to the LLM. Lacking assessment standards, existing benchmarks focus on "factual statements" that rephrase source materials…

计算与语言 · 计算机科学 2025-06-26 Xiaqiang Tang , Jian Li , Keyu Hu , Du Nan , Xiaolong Li , Xi Zhang , Weigao Sun , Sihong Xie

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP). Although convenient for research and practical applications, open-source LLMs with fewer parameters often suffer from severe hallucinations compared to…

计算与语言 · 计算机科学 2023-09-15 Mohamed Elaraby , Mengyin Lu , Jacob Dunn , Xueying Zhang , Yu Wang , Shizhu Liu , Pingchuan Tian , Yuping Wang , Yuxuan Wang

Detecting hallucinations in large language models (LLMs) is critical for enhancing their reliability and trustworthiness. Most research focuses on hallucinations as deviations from information seen during training. However, the opaque…

计算与语言 · 计算机科学 2025-03-26 Fabian Ridder , Malte Schilling

Although demonstrating superb performance on various NLP tasks, large language models (LLMs) still suffer from the hallucination problem, which threatens the reliability of LLMs. To measure the level of hallucination of LLMs, previous works…

人工智能 · 计算机科学 2023-09-12 Li Du , Yequan Wang , Xingrun Xing , Yiqun Ya , Xiang Li , Xin Jiang , Xuezhi Fang

Large Language Models (LLMs) like ChatGPT are foundational in various applications due to their extensive knowledge from pre-training and fine-tuning. Despite this, they are prone to generating factual and commonsense errors, raising…

Large language models (LLMs) are prone to three types of hallucination: Input-Conflicting, Context-Conflicting and Fact-Conflicting hallucinations. The purpose of this study is to mitigate the different types of hallucination by exploiting…

人工智能 · 计算机科学 2025-06-17 Ao Jia , Haiming Wu , Guohui Yao , Dawei Song , Songkun Ji , Yazhou Zhang

While hallucinations of large language models (LLMs) prevail as a major challenge, existing evaluation benchmarks on factuality do not cover the diverse domains of knowledge that the real-world users of LLMs seek information about. To…

Ensuring faithfulness to context in large language models (LLMs) and retrieval-augmented generation (RAG) systems is crucial for reliable deployment in real-world applications, as incorrect or unsupported information can erode user trust.…

计算与语言 · 计算机科学 2025-04-28 Yifei Ming , Senthil Purushwalkam , Shrey Pandit , Zixuan Ke , Xuan-Phi Nguyen , Caiming Xiong , Shafiq Joty

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

计算与语言 · 计算机科学 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse applications, from open-domain question answering to scientific writing, medical decision support, and legal analysis. However, their tendency to generate…

计算与语言 · 计算机科学 2025-12-30 Diyana Muhammed , Giusy Giulia Tuccari , Gollam Rabby , Sören Auer , Sahar Vahdati

Large Language Models (LLMs) have demonstrated remarkable proficiency in generating text that closely resemble human writing. However, they often generate factually incorrect statements, a problem typically referred to as 'hallucination'.…