中文
相关论文

相关论文: Halu-J: Critique-Based Hallucination Judge

200 篇论文

Retrieval Augmented Generation (RAG) systems remain vulnerable to hallucinated answers despite incorporating external knowledge sources. We present LettuceDetect a framework that addresses two critical limitations in existing hallucination…

计算与语言 · 计算机科学 2025-02-25 Ádám Kovács , Gábor Recski

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse applications, from open-domain question answering to scientific writing, medical decision support, and legal analysis. However, their tendency to generate…

计算与语言 · 计算机科学 2025-12-30 Diyana Muhammed , Giusy Giulia Tuccari , Gollam Rabby , Sören Auer , Sahar Vahdati

SemEval-2025 Task 3 (Mu-SHROOM) focuses on detecting hallucinations in content generated by various large language models (LLMs) across multiple languages. This task involves not only identifying the presence of hallucinations but also…

计算与语言 · 计算机科学 2025-05-13 Jiaying Hong , Thanet Markchom , Jianfei Xu , Tong Wu , Huizhi Liang

Hallucinations in large language model (LLM) outputs severely limit their reliability in knowledge-intensive tasks such as question answering. To address this challenge, we introduce REFIND (Retrieval-augmented Factuality hallucINation…

计算与语言 · 计算机科学 2025-04-09 DongGeon Lee , Hwanjo Yu

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

机器学习 · 计算机科学 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

Large Language Models (LLMs) are prone to factual hallucinations, risking their reliability in real-world applications. Existing hallucination detectors mainly extract micro-level intrinsic patterns for uncertainty quantification or elicit…

计算与语言 · 计算机科学 2026-05-06 Hao Mi , Qiang Sheng , Shaofei Wang , Beizhe Hu , Yifan Sun , Zhengjia Wang , Hengqi Zeng , Yang Li , Danding Wang , Juan Cao

Single document news summarization has seen substantial progress on faithfulness in recent years, driven by research on the evaluation of factual consistency, or hallucinations. We ask whether these advances carry over to other text…

Hallucination detection in Large Language Models (LLMs) is crucial for ensuring their reliability. This work presents our participation in the CLEF ELOQUENT HalluciGen shared task, where the goal is to develop evaluators for both generating…

Large Language Models (LLMs) have demonstrated effectiveness across a wide variety of tasks involving natural language, however, a fundamental problem of hallucinations still plagues these models, limiting their trustworthiness in…

计算与语言 · 计算机科学 2025-09-09 Jerry Li , Evangelos Papalexakis

Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Nokimul Hasan Arif , Shadman Rabby , Md Hefzul Hossain Papon , Sabbir Ahmed

Recent progress in generative AI, including large language models (LLMs) like ChatGPT, has opened up significant opportunities in fields ranging from natural language processing to knowledge discovery and data mining. However, there is also…

人工智能 · 计算机科学 2024-04-03 Navapat Nananukul , Mayank Kejriwal

Despite the rapid advancement of large language models, they remain highly susceptible to generating hallucinations, which significantly hinders their widespread application. Hallucination research requires dynamic and fine-grained…

计算与语言 · 计算机科学 2025-04-15 Xu Zhang , Zhifei Liu , Jiahao Wang , Huixuan Zhang , Fan Xu , Junzhe Zhang , Xiaojun Wan

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

计算与语言 · 计算机科学 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

In this paper, we present HalluSearch, a multilingual pipeline designed to detect fabricated text spans in Large Language Model (LLM) outputs. Developed as part of Mu-SHROOM, the Multilingual Shared-task on Hallucinations and Related…

计算与语言 · 计算机科学 2025-04-15 Mohamed A. Abdallah , Samhaa R. El-Beltagy

Large language models (LLMs) have revolutionized natural language processing, yet their tendency to hallucinate poses serious challenges for reliable deployment. Despite numerous hallucination detection methods, their evaluations often rely…

计算与语言 · 计算机科学 2025-08-15 Denis Janiak , Jakub Binkowski , Albert Sawczyn , Bogdan Gabrys , Ravid Shwartz-Ziv , Tomasz Kajdanowicz

Summarization is one of the most common tasks performed by large language models (LLMs), especially in applications like Retrieval-Augmented Generation (RAG). However, existing evaluations of hallucinations in LLM-generated summaries, and…

The advent of large language models (LLMs) has facilitated the development of natural language text generation. It also poses unprecedented challenges, with content hallucination emerging as a significant concern. Existing solutions often…

计算与语言 · 计算机科学 2024-06-06 Xiaoxi Sun , Jinpeng Li , Yan Zhong , Dongyan Zhao , Rui Yan

The hallucination of large multimodal models (LMMs), providing responses that appear correct but are actually incorrect, limits their reliability and applicability. This paper aims to study the hallucination problem of LMMs in video…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Hongcheng Gao , Jiashu Qu , Jingyi Tang , Baolong Bi , Yue Liu , Hongyu Chen , Li Liang , Li Su , Qingming Huang

Large Language Models (LLMs) have shown impressive capabilities but also a concerning tendency to hallucinate. This paper presents RefChecker, a framework that introduces claim-triplets to represent claims in LLM responses, aiming to detect…

计算与语言 · 计算机科学 2024-05-24 Xiangkun Hu , Dongyu Ru , Lin Qiu , Qipeng Guo , Tianhang Zhang , Yang Xu , Yun Luo , Pengfei Liu , Yue Zhang , Zheng Zhang

Large Vision-Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, but they remain susceptible to hallucination, particularly object hallucination where non-existent objects or incorrect attributes are…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Cong-Duy Nguyen , Xiaobao Wu , Duc Anh Vu , Shuai Zhao , Thong Nguyen , Anh Tuan Luu