English
Related papers

Related papers: Hallucination Reduction in Long Input Text Summari…

200 papers

One of the challenges of developing a summarization model arises from the difficulty in measuring the factual inconsistency of the generated text. In this study, we reinterpret the decoder overconfidence-regularizing objective suggested in…

Computation and Language · Computer Science 2022-11-28 Seonil Son , Junsoo Park , Jeong-in Hwang , Junghwa Lee , Hyungjong Noh , Yeonsoo Lee

Large Vision-Language Models (LVLMs) have achieved impressive progress in multimodal reasoning, yet they remain prone to object hallucinations, generating descriptions of objects that are not present in the input image. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sohyeon Kim , Sang Yeon Yoon , Kyeongbo Kong

Large Language Models (LLMs) excel in various language tasks but they often generate incorrect information, a phenomenon known as "hallucinations". Retrieval-Augmented Generation (RAG) aims to mitigate this by using document retrieval for…

Information Retrieval · Computer Science 2024-07-18 Hamin Koo , Minseon Kim , Sung Ju Hwang

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

Artificial Intelligence · Computer Science 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

Hallucination, a persistent challenge plaguing language models, undermines their efficacy and trustworthiness in various natural language processing endeavors by generating responses that deviate from factual accuracy or coherence. This…

Computation and Language · Computer Science 2024-12-30 Ratnesh Kumar Joshi , Sagnik Sengupta , Asif Ekbal

This paper primarily focuses on the hallucinations caused due to AI language models(LLMs).LLMs have shown extraordinary Language understanding and generation capabilities .Still it has major a disadvantage hallucinations which give outputs…

Computation and Language · Computer Science 2026-04-07 Sailesh kiran kurra , Shiek Ruksana , Vishal Borusu

Recently, multimodal large language models have made significant advancements in video understanding tasks. However, their ability to understand unprocessed long videos is very limited, primarily due to the difficulty in supporting the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yiwei Sun , Zhihang Liu , Chuanbin Liu , Bowei Pu , Zhihan Zhang , Hongtao Xie

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

Computation and Language · Computer Science 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

Large Language Models (LLMs) have shown impressive capabilities but still suffer from the issue of hallucinations. A significant type of this issue is the false premise hallucination, which we define as the phenomenon when LLMs generate…

Computation and Language · Computer Science 2024-03-01 Hongbang Yuan , Pengfei Cao , Zhuoran Jin , Yubo Chen , Daojian Zeng , Kang Liu , Jun Zhao

The rapid advancement of foundation models (FMs) across language, image, audio, and video domains has shown remarkable capabilities in diverse tasks. However, the proliferation of FMs brings forth a critical challenge: the potential to…

Machine Learning · Computer Science 2024-10-04 Pranab Sahoo , Prabhash Meharia , Akash Ghosh , Sriparna Saha , Vinija Jain , Aman Chadha

Recent advancements in text summarization, particularly with the advent of Large Language Models (LLMs), have shown remarkable performance. However, a notable challenge persists as a substantial number of automatically-generated summaries…

Computation and Language · Computer Science 2024-09-04 Alessandro Scirè , Karim Ghonim , Roberto Navigli

Existing large language models (LLMs) are known for generating "hallucinated" content, namely a fabricated text of plausibly looking, yet unfounded, facts. To identify when these hallucination scenarios occur, we examine the properties of…

Computation and Language · Computer Science 2023-09-06 Mohamed Akrout

In the realm of medical report generation (MRG), the integration of natural language processing has emerged as a vital tool to alleviate the workload of radiologists. Despite the impressive capabilities demonstrated by large vision language…

Computation and Language · Computer Science 2026-01-23 Ruoqing Zhao , Runze Xia , Piji Li

Large Language Models (LLMs) often exhibit positional bias in long-context settings, under-attending to information in the middle of inputs. We investigate the presence of this bias in long-form summarization, its impact on faithfulness,…

Computation and Language · Computer Science 2025-07-08 David Wan , Jesse Vig , Mohit Bansal , Shafiq Joty

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Generative models are prone to hallucinations: plausible but incorrect structures absent in the ground truth. This issue is problematic in image restoration for safety-critical domains such as medical imaging, industrial inspection, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Seunghoi Kim , Henry F. J. Tregidgo , Chen Jin , Matteo Figini , Daniel C. Alexander

Artificial Intelligence (AI), particularly Large Language Models (LLMs), is transforming scientific discovery, enabling rapid knowledge generation and hypothesis formulation. However, a critical challenge is hallucination, where LLMs…

Artificial Intelligence · Computer Science 2025-12-30 Bhanu Prakash Vangala , Sajid Mahmud , Pawan Neupane , Joel Selvaraj , Jianlin Cheng

Evaluating the factual consistency of abstractive text summarization remains a significant challenge, particularly for long documents, where conventional metrics struggle with input length limitations and long-range dependencies. In this…

Computation and Language · Computer Science 2026-04-30 Zain Muhammad Mujahid , Dustin Wright , Isabelle Augenstein

The hallucination issue is recognized as a fundamental deficiency of large language models (LLMs), especially when applied to fields such as finance, education, and law. Despite the growing concerns, there has been a lack of empirical…

Computation and Language · Computer Science 2023-11-28 Haoqiang Kang , Xiao-Yang Liu

Large language models (LLMs) demonstrate exceptional capabilities, yet still face the hallucination issue. Typical text generation approaches adopt an auto-regressive generation without deliberate reasoning, which often results in…

Computation and Language · Computer Science 2025-01-06 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen