English
Related papers

Related papers: Language Models Hallucinate, but May Excel at Fact…

200 papers

As language models (LMs) become integral to fields like healthcare, law, and journalism, their ability to differentiate between fact, belief, and knowledge is essential for reliable decision-making. Failure to grasp these distinctions can…

Computation and Language · Computer Science 2024-10-29 Mirac Suzgun , Tayfun Gur , Federico Bianchi , Daniel E. Ho , Thomas Icard , Dan Jurafsky , James Zou

The remarkable performance of Multimodal Large Language Models (MLLMs) has unequivocally demonstrated their proficient understanding capabilities in handling a wide array of visual tasks. Nevertheless, the opaque nature of their black-box…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Minghe Gao , Shuang Chen , Liang Pang , Yuan Yao , Jisheng Dang , Wenqiao Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang , Tat-Seng Chua

Like students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty. Such "hallucinations" persist even in state-of-the-art systems…

Computation and Language · Computer Science 2025-09-08 Adam Tauman Kalai , Ofir Nachum , Santosh S. Vempala , Edwin Zhang

Large Language Models (LLMs) have demonstrated remarkable capabilities, revolutionizing the integration of AI in daily life applications. However, they are prone to hallucinations, generating claims that contradict established facts,…

Computation and Language · Computer Science 2024-06-14 A B M Ashikur Rahman , Saeed Anwar , Muhammad Usman , Ajmal Mian

The hallucination issue is recognized as a fundamental deficiency of large language models (LLMs), especially when applied to fields such as finance, education, and law. Despite the growing concerns, there has been a lack of empirical…

Computation and Language · Computer Science 2023-11-28 Haoqiang Kang , Xiao-Yang Liu

Large language models (LLMs), such as ChatGPT, are prone to generate hallucinations, i.e., content that conflicts with the source or cannot be verified by the factual knowledge. To understand what types of content and to which extent LLMs…

Computation and Language · Computer Science 2023-10-24 Junyi Li , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Despite the great advancement of Language modeling in recent days, Large Language Models (LLMs) such as GPT3 are notorious for generating non-factual responses, so-called "hallucination" problems. Existing methods for detecting and…

Computation and Language · Computer Science 2025-09-29 Seongho Joo , Kyungmin Min , Jahyun Koo , Kyomin Jung

Large Language Models (LLMs) are increasingly applied to medical imaging tasks, including image interpretation and synthetic image generation. However, these models often produce hallucinations, which are confident but incorrect outputs…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Anindya Bijoy Das , Shahnewaz Karim Sakib , Shibbir Ahmed

Large language models (LLMs) have exhibited impressive capabilities across a myriad of tasks, yet they occasionally yield undesirable outputs. We posit that these limitations are rooted in the foundational autoregressive architecture of…

Computation and Language · Computer Science 2025-03-03 Cheng Yang , Chufan Shi , Siheng Li , Bo Shui , Yujiu Yang , Wai Lam

We evaluate the ability of Large Language Models (LLMs) to discern and express their internal knowledge state, a key factor in countering factual hallucination and ensuring reliable application of LLMs. We observe a robust self-awareness of…

Computation and Language · Computer Science 2024-01-30 Yuxin Liang , Zhuoyang Song , Hao Wang , Jiaxing Zhang

Recently developed large language models have achieved remarkable success in generating fluent and coherent text. However, these models often tend to 'hallucinate' which critically hampers their reliability. In this work, we address this…

Computation and Language · Computer Science 2023-08-15 Neeraj Varshney , Wenlin Yao , Hongming Zhang , Jianshu Chen , Dong Yu

Large Language Models (LLMs) have revolutionised natural language processing, exhibiting impressive human-like capabilities. In particular, LLMs are capable of "lying", knowingly outputting false statements. Hence, it is of interest and…

Computation and Language · Computer Science 2024-10-22 Lennart Bürger , Fred A. Hamprecht , Boaz Nadler

Hallucinations, the generation of apparently convincing yet false statements, remain a major barrier to the safe deployment of LLMs. Building on the strong performance of self-detection methods, we examine the use of structured knowledge…

Computation and Language · Computer Science 2025-12-30 Sahil Kale , Antonio Luca Alfeo

Hallucination in Large Language Models (LLMs) refers to the generation of content that is not faithful to the input or the real-world facts. This paper provides a rigorous treatment of hallucination in LLMs, including formal definitions and…

Computation and Language · Computer Science 2025-08-01 Esmail Gumaan

Despite advancements in large language models (LLMs), non-factual responses still persist in fact-seeking question answering. Unlike extensive studies on post-hoc detection of these responses, this work studies non-factuality prediction…

Computation and Language · Computer Science 2025-08-19 Yanling Wang , Haoyang Li , Hao Zou , Jing Zhang , Xinlei He , Qi Li , Ke Xu

Recent studies on hallucination in large language models (LLMs) have been actively progressing in natural language processing. However, the impact of negated text on hallucination with LLMs remains largely unexplored. In this paper, we set…

Computation and Language · Computer Science 2025-10-24 Jaehyung Seo , Hyeonseok Moon , Heuiseok Lim

Large language models (LLMs) have shown significant potential in scientific disciplines such as biomedicine, particularly in hypothesis generation, where they can analyze vast literature, identify patterns, and suggest research directions.…

Computation and Language · Computer Science 2025-06-10 Guangzhi Xiong , Eric Xie , Corey Williams , Myles Kim , Amir Hassan Shariatmadari , Sikun Guo , Stefan Bekiranov , Aidong Zhang

Hallucinations, a phenomenon where a language model (LM) generates nonfactual content, pose a significant challenge to the practical deployment of LMs. While many empirical methods have been proposed to mitigate hallucinations, recent…

Computation and Language · Computer Science 2026-05-18 Atsushi Suzuki , Yulan He , Feng Tian , Zhongyuan Wang

Context-grounded hallucinations are cases where model outputs contain information not verifiable against the source text. We study the applicability of LLMs for localizing such hallucinations, as a more practical alternative to existing…

Computation and Language · Computer Science 2025-09-30 Yehonatan Peisakhovsky , Zorik Gekhman , Yosi Mass , Liat Ein-Dor , Roi Reichart

Multimodal large language models (MLLMs) carry the potential to support humans in processing vast amounts of information. While MLLMs are already being used as a fact-checking tool, their abilities and limitations in this regard are…

Computation and Language · Computer Science 2024-04-29 Jiahui Geng , Yova Kementchedjhieva , Preslav Nakov , Iryna Gurevych