English
Related papers

Related papers: Collu-Bench: A Benchmark for Predicting Language M…

200 papers

Large Language Models (LLMs) have transformed the Natural Language Processing (NLP) landscape with their remarkable ability to understand and generate human-like text. However, these models are prone to ``hallucinations'' -- outputs that do…

While Large Language Models (LLMs) have emerged as powerful foundational models to solve a variety of tasks, they have also been shown to be prone to hallucinations, i.e., generating responses that sound confident but are actually incorrect…

Computation and Language · Computer Science 2026-04-29 Jiawei Li , Akshayaa Magesh , Venugopal V. Veeravalli

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Despite the many advances of Large Language Models (LLMs) and their unprecedented rapid evolution, their impact and integration into every facet of our daily lives is limited due to various reasons. One critical factor hindering their…

Computation and Language · Computer Science 2024-08-20 Yakir Yehuda , Itzik Malkiel , Oren Barkan , Jonathan Weill , Royi Ronen , Noam Koenigstein

Concerns regarding the propensity of Large Language Models (LLMs) to produce inaccurate outputs, also known as hallucinations, have escalated. Detecting them is vital for ensuring the reliability of applications relying on LLM-generated…

Computation and Language · Computer Science 2024-05-31 Ernesto Quevedo , Jorge Yero , Rachel Koerner , Pablo Rivas , Tomas Cerny

Generative models such as large language models are extensively used as code copilots and for whole program generation. However, the programs they generate often have questionable correctness, authenticity and reliability in terms of…

Artificial Intelligence · Computer Science 2024-08-09 Mirza Masfiqur Rahman , Ashish Kundu

Large language models (LLMs) can be prone to hallucinations - generating unreliable outputs that are unfaithful to their inputs, external facts or internally inconsistent. In this work, we address several challenges for post-hoc…

Computation and Language · Computer Science 2024-08-12 Simon Valentin , Jinmiao Fu , Gianluca Detommaso , Shaoyuan Xu , Giovanni Zappella , Bryan Wang

Is automated hallucination detection possible? In this work, we introduce a theoretical framework to analyze the feasibility of automatically detecting hallucinations produced by large language models (LLMs). Inspired by the classical…

Machine Learning · Computer Science 2025-06-03 Amin Karbasi , Omar Montasser , John Sous , Grigoris Velegkas

We introduce HallusionBench, a comprehensive benchmark designed for the evaluation of image-context reasoning. This benchmark presents significant challenges to advanced large visual-language models (LVLMs), such as GPT-4V(Vision), Gemini…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Tianrui Guan , Fuxiao Liu , Xiyang Wu , Ruiqi Xian , Zongxia Li , Xiaoyu Liu , Xijun Wang , Lichang Chen , Furong Huang , Yaser Yacoob , Dinesh Manocha , Tianyi Zhou

Large Language Models (LLMs) are powerful computational models trained on extensive corpora of human-readable text, enabling them to perform general-purpose language understanding and generation. LLMs have garnered significant attention in…

Computation and Language · Computer Science 2024-10-28 Liam Barkley , Brink van der Merwe

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou

Advancements in Large Language Models (LLMs) and their increasing use in medical question-answering necessitate rigorous evaluation of their reliability. A critical challenge lies in hallucination, where models generate plausible yet…

Computation and Language · Computer Science 2025-02-21 Shrey Pandit , Jiawei Xu , Junyuan Hong , Zhangyang Wang , Tianlong Chen , Kaidi Xu , Ying Ding

Hallucinations pose a significant challenge to the reliability of large vision-language models, making their detection essential for ensuring accuracy in critical applications. Current detection methods often rely on computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Eunkyu Park , Minyeong Kim , Gunhee Kim

Despite the outstanding performance in multimodal tasks, Large Vision-Language Models (LVLMs) have been plagued by the issue of hallucination, i.e., generating content that is inconsistent with the corresponding visual inputs. While…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Bei Yan , Jie Zhang , Zheng Yuan , Shiguang Shan , Xilin Chen

Large language models (LLMs) have transformed natural language processing, achieving remarkable performance across diverse tasks. However, their impressive fluency often comes at the cost of producing false or fabricated information, a…

Computation and Language · Computer Science 2026-03-20 Aisha Alansari , Hamzah Luqman

Large Language Models (LLMs) and Large Reasoning Models (LRMs) offer transformative potential for high-stakes domains like finance and law, but their tendency to hallucinate, generating factually incorrect or unsupported content, poses a…

Artificial Intelligence · Computer Science 2026-01-16 Ahmad Pesaranghader , Erin Li

Large Language Models (LLMs) have gained significant popularity for their impressive performance across diverse fields. However, LLMs are prone to hallucinate untruthful or nonsensical outputs that fail to meet user expectations in many…

Computation and Language · Computer Science 2023-11-23 Tianhang Zhang , Lin Qiu , Qipeng Guo , Cheng Deng , Yue Zhang , Zheng Zhang , Chenghu Zhou , Xinbing Wang , Luoyi Fu

Large language models (LLMs), such as ChatGPT, are prone to generate hallucinations, i.e., content that conflicts with the source or cannot be verified by the factual knowledge. To understand what types of content and to which extent LLMs…

Computation and Language · Computer Science 2023-10-24 Junyi Li , Xiaoxue Cheng , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Large vision-language models (LVLMs) are prone to hallucinations, where certain contextual cues in an image can trigger the language module to produce overconfident and incorrect reasoning about abnormal or hypothetical objects. While some…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xiyang Wu , Tianrui Guan , Dianqi Li , Shuaiyi Huang , Xiaoyu Liu , Xijun Wang , Ruiqi Xian , Abhinav Shrivastava , Furong Huang , Jordan Lee Boyd-Graber , Tianyi Zhou , Dinesh Manocha

Recent advances in multimodal large language models (MLLMs) mark a shift from non-thinking models to post-trained reasoning models capable of solving complex problems through thinking. However, whether such thinking mitigates hallucinations…

Computation and Language · Computer Science 2026-02-02 Zhidian Huang , Zijun Yao , Ji Qi , Shangqing Tu , Junxian Ma , Jinxin Liu , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li