English
Related papers

Related papers: FINER: MLLMs Hallucinate under Fine-grained Negati…

200 papers

Recent advances in multimodal large language models (MLLMs) mark a shift from non-thinking models to post-trained reasoning models capable of solving complex problems through thinking. However, whether such thinking mitigates hallucinations…

Computation and Language · Computer Science 2026-02-02 Zhidian Huang , Zijun Yao , Ji Qi , Shangqing Tu , Junxian Ma , Jinxin Liu , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li

The hallucination issue is recognized as a fundamental deficiency of large language models (LLMs), especially when applied to fields such as finance, education, and law. Despite the growing concerns, there has been a lack of empirical…

Computation and Language · Computer Science 2023-11-28 Haoqiang Kang , Xiao-Yang Liu

Recently, multimodal large language models (MLLMs) have demonstrated remarkable performance in visual-language tasks. However, the authenticity of the responses generated by MLLMs is often compromised by object hallucinations. We identify…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Shuo Li , Jiajun Sun , Guodong Zheng , Xiaoran Fan , Yujiong Shen , Yi Lu , Zhiheng Xi , Yuming Yang , Wenming Tan , Tao Ji , Tao Gui , Qi Zhang , Xuanjing Huang

The increasing use of vision-language models (VLMs) in healthcare applications presents great challenges related to hallucinations, in which the models may generate seemingly plausible results that are in fact incorrect. Such hallucinations…

Artificial Intelligence · Computer Science 2025-03-03 Qiao Yan , Yuchen Yuan , Xiaowei Hu , Yihan Wang , Jiaqi Xu , Jinpeng Li , Chi-Wing Fu , Pheng-Ann Heng

Hallucination, or the generation of incorrect or fabricated information, remains a critical challenge in large language models (LLMs), particularly in high-stake domains such as legal question answering (QA). In order to mitigate the…

Computation and Language · Computer Science 2025-01-14 Yinghao Hu , Leilei Gan , Wenyi Xiao , Kun Kuang , Fei Wu

Multimodal Large Language Models (MLLMs) frequently suffer from hallucination issues, generating information about objects that are not present in input images during vision-language tasks. These hallucinations particularly undermine model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Dokyoon Yoon , Youngsook Song , Woomyong Park

Recent advances in natural language processing (NLP), particularly large language models (LLMs), have motivated the automatic translation of natural language statements into formal logic without human intervention. This enables automated…

Computation and Language · Computer Science 2025-12-03 Muyu Pan , Dheeraj Kodakandla , Mahfuza Farooque

Large Vision and Language Models have enabled significant advances in fully supervised and zero-shot visual tasks. These large architectures serve as the baseline to what is currently known as Instruction Tuning Large Vision and Language…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Andrés Villa , Juan Carlos León Alcázar , Alvaro Soto , Bernard Ghanem

Despite their impressive capabilities, multimodal large language models (MLLMs) are prone to hallucinations, i.e., the generated content that is nonsensical or unfaithful to input sources. Unlike in LLMs, hallucinations in MLLMs often stem…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xin Zou , Yizhou Wang , Yibo Yan , Yuanhuiyi Lyu , Kening Zheng , Sirui Huang , Junkai Chen , Peijie Jiang , Jia Liu , Chang Tang , Xuming Hu

Large language models (LLMs) have become pervasive in our everyday life. Yet, a fundamental obstacle prevents their use in many critical applications: their propensity to generate fluent, human-quality content that is not grounded in…

Computation and Language · Computer Science 2025-10-30 Kensuke Mitsuzawa , Damien Garreau

Multimodal large reasoning models (MLRMs) often suffer from hallucinations that stem not only from insufficient visual grounding but also from imbalanced allocation between perception and reasoning processes. Building upon recent…

Artificial Intelligence · Computer Science 2026-03-10 Haolang Lu , Bolun Chu , WeiYe Fu , Guoshun Nan , Junning Liu , Minghui Pan , Qiankun Li , Yi Yu , Hua Wang , Kun Wang

Machine Translation (MT) is undergoing a paradigm shift, with systems based on fine-tuned large language models (LLM) becoming increasingly competitive with traditional encoder-decoder models trained specifically for translation tasks.…

Computation and Language · Computer Science 2025-01-30 Zilu Tang , Rajen Chatterjee , Sarthak Garg

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable performance on various visual-language understanding and generation tasks. However, MLLMs occasionally generate content inconsistent with the given images, which is…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Peng Ding , Jingyu Wu , Jun Kuang , Dan Ma , Xuezhi Cao , Xunliang Cai , Shi Chen , Jiajun Chen , Shujian Huang

Large language models (LLMs) are prone to hallucinations, i.e., nonsensical, unfaithful, and undesirable text. Users tend to overrely on LLMs and corresponding hallucinations which can lead to misinterpretations and errors. To tackle the…

Human-Computer Interaction · Computer Science 2024-05-22 Florian Leiser , Sven Eckhardt , Valentin Leuthe , Merlin Knaeble , Alexander Maedche , Gerhard Schwabe , Ali Sunyaev

Large Language Models (LLMs) are known to hallucinate, whereby they generate plausible but inaccurate text. This phenomenon poses significant risks in critical applications, such as medicine or law, necessitating robust hallucination…

Computation and Language · Computer Science 2024-10-23 Benedict Aaron Tjandra , Muhammed Razzak , Jannik Kossen , Kunal Handa , Yarin Gal

Large language models (LLMs) have demonstrated impressive capabilities across diverse tasks, but they remain susceptible to hallucinations--generating content that appears plausible but contains factual inaccuracies. We present Finch-Zk, a…

Computation and Language · Computer Science 2025-11-04 Aman Goel , Daniel Schwartz , Yanjun Qi

Large language models (LLMs) often produce unsupported or unverifiable content, known as "hallucinations." To mitigate this, retrieval-augmented LLMs incorporate citations, grounding the content in verifiable sources. Despite such…

Information Retrieval · Computer Science 2024-08-26 Weijia Zhang , Mohammad Aliannejadi , Yifei Yuan , Jiahuan Pei , Jia-Hong Huang , Evangelos Kanoulas

Recent advancements in large language models (LLMs) have shown strong performance in natural language understanding and generation tasks. However, LLMs continue to encounter challenges with hallucinations, where models generate plausible…

Computation and Language · Computer Science 2025-10-15 Jung-Woo Shim , Yeong-Joon Ju , Ji-Hoon Park , Seong-Whan Lee

The advancement of Large Vision-Language Models (LVLMs) has increasingly highlighted the critical issue of their tendency to hallucinate non-existing objects in the images. To address this issue, previous works focused on using specially…

Machine Learning · Computer Science 2025-06-13 Linxi Zhao , Yihe Deng , Weitong Zhang , Quanquan Gu

Large Language Models (LLMs) have advanced machine translation but remain vulnerable to hallucinations. Unfortunately, existing MT benchmarks are not capable of exposing failures in multilingual LLMs. To disclose hallucination in…

Computation and Language · Computer Science 2025-10-29 Xinwei Wu , Heng Liu , Jiang Zhou , Xiaohu Zhao , Linlong Xu , Longyue Wang , Weihua Luo , Kaifu Zhang