English
Related papers

Related papers: HalluAudio: A Comprehensive Benchmark for Hallucin…

200 papers

Hallucination detection in captions (HalDec) assesses a vision-language model's ability to correctly align image content with text by identifying errors in captions that misrepresent the image. Beyond evaluation, effective hallucination…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Kuniaki Saito , Risa Shinoda , Shohei Tanaka , Tosho Hirasawa , Fumio Okura , Yoshitaka Ushiku

Large audio-language models (LALMs) extend the large language models with multimodal understanding in speech, audio, etc. While their performances on speech and audio-processing tasks are extensively studied, their reasoning abilities…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-26 Chih-Kai Yang , Neo Ho , Yen-Ting Piao , Hung-yi Lee

Large Language Models (LLMs) are widely used in industry but remain prone to hallucinations, limiting their reliability in critical applications. This work addresses hallucination reduction in consumer grievance chatbots built using LLaMA…

Paralinguistic cues are essential for natural human-computer interaction, yet their evaluation in Large Audio-Language Models (LALMs) remains limited by coarse feature coverage and the inherent subjectivity of assessment. To address these…

Computation and Language · Computer Science 2026-04-23 Ruohan Liu , Shukang Yin , Tao Wang , Dong Zhang , Weiji Zhuang , Shuhuai Ren , Ran He , Caifeng Shan , Chaoyou Fu

We introduce DAHL, a benchmark dataset and automated evaluation system designed to assess hallucination in long-form text generation, specifically within the biomedical domain. Our benchmark dataset, meticulously curated from biomedical…

Computation and Language · Computer Science 2024-11-15 Jean Seo , Jongwon Lim , Dongjun Jang , Hyopil Shin

Hallucination is a persistent issue affecting all large language Models (LLMs), particularly within low-resource languages such as Persian. PerHalluEval (Persian Hallucination Evaluation) is the first dynamic hallucination evaluation…

Computation and Language · Computer Science 2025-09-26 Mohammad Hosseini , Kimia Hosseini , Shayan Bali , Zahra Zanjani , Saeedeh Momtazi

Hallucinations, the tendency for large language models to provide responses with factually incorrect and unsupported claims, is a serious problem within natural language processing for which we do not yet have an effective solution to…

Computation and Language · Computer Science 2026-05-08 Brandon C. Colelough , Davis Bartels , Dina Demner-Fushman

The detection of sophisticated hallucinations in Large Language Models (LLMs) is hampered by a ``Detection Dilemma'': methods probing internal states (Internal State Probing) excel at identifying factual inconsistencies but fail on logical…

Computation and Language · Computer Science 2026-01-09 Yusheng Song , Lirong Qiu , Xi Zhang , Zhihao Tang

Despite significant strides in multimodal tasks, Multimodal Large Language Models (MLLMs) are plagued by the critical issue of hallucination. The reliable detection of such hallucinations in MLLMs has, therefore, become a vital aspect of…

Computation and Language · Computer Science 2024-05-28 Xiang Chen , Chenxi Wang , Yida Xue , Ningyu Zhang , Xiaoyan Yang , Qiang Li , Yue Shen , Lei Liang , Jinjie Gu , Huajun Chen

Large Vision Language Models (LVLMs) are becoming increasingly important in the medical domain, yet Medical LVLMs (Med-LVLMs) frequently generate hallucinations due to limited expertise and the complexity of medical applications. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Aofei Chang , Le Huang , Parminder Bhatia , Taha Kass-Hout , Fenglong Ma , Cao Xiao

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Tool-augmented large language models (LLMs) are rapidly being integrated into real-world applications. Due to the lack of benchmarks, the community has yet to fully understand the hallucination issues within these models. To address this…

Computation and Language · Computer Science 2024-10-07 Yuxiang Zhang , Jing Chen , Junjie Wang , Yaxin Liu , Cheng Yang , Chufan Shi , Xinyu Zhu , Zihao Lin , Hanwen Wan , Yujiu Yang , Tetsuya Sakai , Tian Feng , Hayato Yamana

Hallucinations in generative AI, particularly in Large Language Models (LLMs), pose a significant challenge to the reliability of multilingual applications. Existing benchmarks for hallucination detection focus primarily on English and a…

Computation and Language · Computer Science 2025-03-28 Hanzhi Zhang , Sumera Anjum , Heng Fan , Weijian Zheng , Yan Huang , Yunhe Feng

Large Language Models (LLMs) have succeeded in a variety of natural language processing tasks [Zha+25]. However, they have notable limitations. LLMs tend to generate hallucinations, a seemingly plausible yet factually unsupported output…

Computation and Language · Computer Science 2025-09-19 Martin Preiß

Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance in complex multimodal tasks. While MLLMs excel at visual perception and reasoning in third-person and egocentric videos, they are prone to hallucinations,…

Hallucinations pose a significant challenge to the reliability of large vision-language models, making their detection essential for ensuring accuracy in critical applications. Current detection methods often rely on computationally…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Eunkyu Park , Minyeong Kim , Gunhee Kim

Modern Large audio-language models (LALMs) power intelligent voice interactions by tightly integrating audio and text. This integration, however, expands the attack surface beyond text and introduces vulnerabilities in the continuous,…

Cryptography and Security · Computer Science 2026-04-17 Meng Chen , Kun Wang , Li Lu , Jiaheng Zhang , Tianwei Zhang

Recent advances in large language models (LLMs) have shown promising improvements, often surpassing existing methods across a wide range of downstream tasks in natural language processing. However, these models still face challenges, which…

Computation and Language · Computer Science 2025-02-13 Sujeong Lee , Hayoung Lee , Seongsoo Heo , Wonik Choi

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

Computation and Language · Computer Science 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Large Audio Language Models (LALMs), which couple acoustic perception with large language models (LLMs) to extract and understand diverse information from audio, have attracted intense interest from both academic and industrial communities.…

Sound · Computer Science 2025-10-28 Bohan Li , Wenbin Huang , Yuhang Qiu , Yiwei Guo , Hankun Wang , Zhihan Li , Jing Peng , Ziyang Ma , Xie Chen , Kai Yu