中文
相关论文

相关论文: Detecting Hallucinations in SpeechLLMs at Inferenc…

200 篇论文

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Detecting hallucinations in large language models (LLMs) remains a fundamental challenge for their trustworthy deployment. Going beyond basic uncertainty-driven hallucination detection frameworks, we propose a simple yet powerful method…

人工智能 · 计算机科学 2025-10-10 Rui Wang , Zeming Wei , Guanzhang Yue , Meng Sun

Large Language Models (LLMs) have the tendency to hallucinate, i.e., to sporadically generate false or fabricated information. This presents a major challenge, as hallucinations often appear highly convincing and users generally lack the…

Multimodal large language models can exhibit text dominance, over-relying on linguistic priors instead of grounding predictions in non-text inputs. One example is large audio-language models (LALMs) where decisive audio evidence can be…

声音 · 计算机科学 2026-03-10 Neta Glazer , Lenny Aharon , Ethan Fetaya

Hallucinations in large language models (LLMs) pose significant safety concerns that impede their broader deployment. Recent research in hallucination detection has demonstrated that LLMs' internal representations contain truthfulness…

机器学习 · 计算机科学 2025-11-11 Mengjia Niu , Hamed Haddadi , Guansong Pang

The rapid advancement of large language models (LLMs) has significantly impacted various domains, including healthcare and biomedicine. However, the phenomenon of hallucination, where LLMs generate outputs that deviate from factual accuracy…

计算与语言 · 计算机科学 2024-08-27 Duy Khoa Pham , Bao Quoc Vo

Large Vision-Language Models (LVLMs) have shown remarkable performance on a wide range of vision-language tasks. Despite this progress, they are still prone to hallucination, generating responses that are inconsistent with visual content.…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Yutong Xie , Zhenglin Hua , Ran Wang , Wing W. Y. Ng , Xizhao Wang , Yuheng Jia

Multimodal Large Language Models (MLLMs) achieve strong performance on tasks like image captioning and visual question answering, but remain prone to hallucinations, where generated text conflicts with the visual input. Prior work links…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Tiancheng Yang , Lin Zhang , Jiaye Lin , Guimin Hu , Di Wang , Lijie Hu

Large Vision-Language Models (LVLMs) integrate image encoders with Large Language Models (LLMs) to process multi-modal inputs and perform complex visual tasks. However, they often generate hallucinations by describing non-existent objects…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Yaqi Sun , Kyohei Atarashi , Koh Takeuchi , Hisashi Kashima

Vision Language models (VLMs) often hallucinate non-existent objects. Detecting hallucination is analogous to detecting deception: a single final statement is insufficient, one must examine the underlying reasoning process. Yet existing…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Abin Shoby , Ta Duc Huy , Tuan Dung Nguyen , Minh Khoi Ho , Qi Chen , Anton van den Hengel , Phi Le Nguyen , Johan W. Verjans , Vu Minh Hieu Phan

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Large language model (LLM) systems suffer from the models' unstable ability to generate valid and factual content, resulting in hallucination generation. Current hallucination detection methods heavily rely on out-of-model information…

计算与语言 · 计算机科学 2025-02-20 Peiran Wang , Yang Liu , Yunfei Lu , Jue Hong , Ye Wu

Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Nokimul Hasan Arif , Shadman Rabby , Md Hefzul Hossain Papon , Sabbir Ahmed

Vision-Language Models (VLMs) have demonstrated remarkable progress in multimodal tasks, but remain susceptible to hallucinations, where generated text deviates from the underlying visual content. Existing hallucination detection methods…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Feiran Zhang , Yixin Wu , Zhenghua Wang , Xiaohua Wang , Changze Lv , Xuanjing Huang , Xiaoqing Zheng

This survey presents a comprehensive analysis of the phenomenon of hallucination in multimodal large language models (MLLMs), also known as Large Vision-Language Models (LVLMs), which have demonstrated significant advancements and…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Zechen Bai , Pichao Wang , Tianjun Xiao , Tong He , Zongbo Han , Zheng Zhang , Mike Zheng Shou

This paper focuses on resolving stability hallucinations (e.g., repetitive or omitted speech) in LLM-based Text-to-Speech (TTS) models by improving and leveraging the attention mechanism. First, we analyzed the alignment mechanism between…

声音 · 计算机科学 2026-02-16 ShiMing Wang , ZhiHao Du , Yang Xiang , TianYu Zhao , Han Zhao , Qian Chen , XianGang Li , HanJie Guo , ZhenHua Ling

Hallucinations in Large Language Models (LLMs), defined as the generation of content inconsistent with facts or context, represent a core obstacle to their reliable deployment in critical domains. Current research primarily focuses on…

计算与语言 · 计算机科学 2026-03-20 Yanyi Liu , Qingwen Yang , Tiezheng Guo , Feiyu Qu , Jun Liu , Yingyou Wen

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, yet they remain susceptible to hallucinations -- generating content that is factually incorrect, unfaithful to provided…

计算与语言 · 计算机科学 2026-05-25 Ahmed Cherif

As LLM-powered chatbots are increasingly deployed in mental health services, detecting hallucinations and omissions has become critical for user safety. However, state-of-the-art LLM-as-a-judge methods often fail in high-risk healthcare…

计算与语言 · 计算机科学 2026-04-09 Khizar Hussain , Bradley A. Malin , Zhijun Yin , Susannah Leigh Rose , Murat Kantarcioglu

Although Large Vision-Language Models (LVLMs) have made substantial progress, hallucination, where generated text is not grounded in the visual input, remains a challenge. As LVLMs become stronger, previously reported hallucination…

计算机视觉与模式识别 · 计算机科学 2026-03-03 April Fu