English
Related papers

Related papers: Metric Ensembles For Hallucination Detection

200 papers

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

Computation and Language · Computer Science 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Large Language Models (LLMs) suffer from hallucination problems, which hinder their reliability in sensitive applications. In the black-box setting, several self-consistency-based techniques have been proposed for hallucination detection.…

Computation and Language · Computer Science 2025-02-25 Yihao Xue , Kristjan Greenewald , Youssef Mroueh , Baharan Mirzasoleiman

Existing Large Vision-Language Models (LVLMs) primarily align image features of vision encoder with Large Language Models (LLMs) to leverage their superior text generation capabilities. However, the scale disparity between vision encoder…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Shi Liu , Kecheng Zheng , Wei Chen

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

Artificial Intelligence · Computer Science 2026-01-16 Ahmad Pesaranghader , Erin Li

Despite significant progress in the quality of language generated from abstractive summarization models, these models still exhibit the tendency to hallucinate, i.e., output content not supported by the source document. A number of works…

Computation and Language · Computer Science 2022-11-01 Liam van der Poel , Ryan Cotterell , Clara Meister

Given the higher information load processed by large vision-language models (LVLMs) compared to single-modal LLMs, detecting LVLM hallucinations requires more human and time expense, and thus rise a wider safety concerns. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ruiyang Zhang , Hu Zhang , Zhedong Zheng

Hallucination, a phenomenon where large language models (LLMs) produce output that is factually incorrect or unrelated to the input, is a major challenge for LLM applications that require accuracy and dependability. In this paper, we…

Computation and Language · Computer Science 2025-04-01 Song Wang , Xun Wang , Jie Mei , Yujia Xie , Sean Muarray , Zhang Li , Lingfeng Wu , Si-Qing Chen , Wayne Xiong

Large language models (LLMs) frequently generate hallucinations-content that deviates from factual accuracy or provided context-posing challenges for diagnosis due to the complex interplay of underlying causes. This paper introduces a…

Computation and Language · Computer Science 2025-04-18 Yiyou Sun , Yu Gai , Lijie Chen , Abhilasha Ravichander , Yejin Choi , Dawn Song

While many capabilities of language models (LMs) improve with increased training budget, the influence of scale on hallucinations is not yet fully understood. Hallucinations come in many forms, and there is no universally accepted…

Plan-guided summarization attempts to reduce hallucinations in small language models (SLMs) by grounding generated summaries to the source text, typically by targeting fine-grained details such as dates or named entities. In this work, we…

Computation and Language · Computer Science 2025-08-25 Matt Grenander , Siddharth Varia , Paula Czarnowska , Yogarshi Vyas , Kishaloy Halder , Bonan Min

In this paper, we describe our methodology for the CLEF 2025 SimpleText Task 2, which focuses on detecting and evaluating creative generation and information distortion in scientific text simplification. Our solution integrates multiple…

Computation and Language · Computer Science 2025-08-19 Krishna Chaitanya Marturi , Heba H. Elwazzan

Recently, 3D-LLMs, which combine point-cloud encoders with large models, have been proposed to tackle complex tasks in embodied intelligence and scene understanding. In addition to showing promising results on 3D tasks, we found that they…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Ruiying Peng , Kaiyuan Li , Weichen Zhang , Chen Gao , Xinlei Chen , Yong Li

Large vision-language models (LVLMs) have shown remarkable abilities in understanding visual information with human languages. However, LVLMs still suffer from object hallucination, which is the problem of generating descriptions that…

Machine Learning · Computer Science 2024-03-19 Yiyang Zhou , Chenhang Cui , Jaehong Yoon , Linjun Zhang , Zhun Deng , Chelsea Finn , Mohit Bansal , Huaxiu Yao

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

Artificial Intelligence · Computer Science 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Unsupervised hallucination detection aims to identify hallucinated content generated by large language models (LLMs) without relying on labeled data. While unsupervised methods have gained popularity by eliminating labor-intensive human…

Computation and Language · Computer Science 2025-09-15 Ponhvoan Srey , Xiaobao Wu , Anh Tuan Luu

It is well known that the standard likelihood training and approximate decoding objectives in neural text generation models lead to less human-like responses for open-ended tasks such as language modeling and story generation. In this paper…

Computation and Language · Computer Science 2020-05-05 Joshua Maynez , Shashi Narayan , Bernd Bohnet , Ryan McDonald

As we all know, hallucinations prevail in Large Language Models (LLMs), where the generated content is coherent but factually incorrect, which inflicts a heavy blow on the widespread application of LLMs. Previous studies have shown that…

Computation and Language · Computer Science 2024-10-15 Xinping Zhao , Jindi Yu , Zhenyu Liu , Jifang Wang , Dongfang Li , Yibin Chen , Baotian Hu , Min Zhang

Large language models (LLMs) are highly effective in various natural language processing (NLP) tasks. However, they are susceptible to producing unreliable conjectures in ambiguous contexts called hallucination. This paper presents a new…

Computation and Language · Computer Science 2024-03-07 Yuhong Sun , Zhangyue Yin , Qipeng Guo , Jiawen Wu , Xipeng Qiu , Hui Zhao

Hallucinations pose a significant challenge to the reliability and alignment of Large Language Models (LLMs), limiting their widespread acceptance beyond chatbot applications. Despite ongoing efforts, hallucinations remain a prevalent…

Computation and Language · Computer Science 2024-02-27 Cem Uluoglakci , Tugba Taskaya Temizel

Despite the outstanding performance of large language models (LLMs) across various NLP tasks, hallucinations in LLMs--where LLMs generate inaccurate responses--remains as a critical problem as it can be directly connected to a crisis of…

Computation and Language · Computer Science 2025-07-22 Minsuh Joo , Hyunsoo Cho
‹ Prev 1 3 4 5 6 7 10 Next ›