中文
相关论文

相关论文: Counting Hallucinations in Diffusion Models

200 篇论文

While many capabilities of language models (LMs) improve with increased training budget, the influence of scale on hallucinations is not yet fully understood. Hallucinations come in many forms, and there is no universally accepted…

Vision Language Models (VLMs) exhibit persistent hallucinations in counting tasks, with accuracy substantially lower than other visual reasoning tasks (excluding sentiment). This phenomenon persists even in state-of-the-art…

计算机视觉与模式识别 · 计算机科学 2026-03-12 Boyuan Chen , Minghao Shao , Siddharth Garg , Ramesh Karri , Muhammad Shafique

Benchmarks measure whether a model is correct. They do not measure whether a model is reliable. This distinction is largely academic for single-shot inference, but becomes critical for agentic AI systems, where a single rephrased prompt can…

机器学习 · 计算机科学 2026-01-13 Aaron R. Flouro , Shawn P. Chadwick

Recent deep face hallucination methods show stunning performance in super-resolving severely degraded facial images, even surpassing human ability. However, these algorithms are mainly evaluated on non-public synthetic datasets. It is thus…

计算机视觉与模式识别 · 计算机科学 2022-06-09 Kaihao Zhang , Dongxu Li , Wenhan Luo , Jingyu Liu , Jiankang Deng , Wei Liu , Stefanos Zafeiriou

Large language models (LLMs) can suffer from hallucinations when generating text. These hallucinations impede various applications in society and industry by making LLMs untrustworthy. Current LLMs generate text in an autoregressive fashion…

机器学习 · 计算机科学 2025-11-05 Lukas Aichberger , Kajetan Schweighofer , Mykyta Ielanskyi , Sepp Hochreiter

Large Vision-Language Models (LVLMs) have achieved impressive performance, yet research has pointed out a serious issue with object hallucinations within these models. However, there is no clear conclusion as to which part of the model…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Yufang Liu , Tao Ji , Changzhi Sun , Yuanbin Wu , Aimin Zhou

The increasing use of vision-language models (VLMs) in healthcare applications presents great challenges related to hallucinations, in which the models may generate seemingly plausible results that are in fact incorrect. Such hallucinations…

人工智能 · 计算机科学 2025-03-03 Qiao Yan , Yuchen Yuan , Xiaowei Hu , Yihan Wang , Jiaqi Xu , Jinpeng Li , Chi-Wing Fu , Pheng-Ann Heng

As large language models continue to develop in the field of AI, text generation systems are susceptible to a worrisome phenomenon known as hallucination. In this study, we summarize recent compelling insights into hallucinations in LLMs.…

计算与语言 · 计算机科学 2023-09-14 Hongbin Ye , Tong Liu , Aijia Zhang , Wei Hua , Weiqiang Jia

This research paper focuses on the challenges posed by hallucinations in large language models (LLMs), particularly in the context of the medical domain. Hallucination, wherein these models generate plausible yet unverified or incorrect…

计算与语言 · 计算机科学 2023-10-17 Ankit Pal , Logesh Kumar Umapathi , Malaikannan Sankarasubbu

A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data…

计算机视觉与模式识别 · 计算机科学 2023-10-16 Zhengxiong Luo , Dayou Chen , Yingya Zhang , Yan Huang , Liang Wang , Yujun Shen , Deli Zhao , Jingren Zhou , Tieniu Tan

Hallucinations in large language models (LLMs), defined as fluent yet incorrect or incoherent outputs, pose a significant challenge to the automatic generation of educational multiple-choice questions (MCQs). We identified four key…

计算与语言 · 计算机科学 2026-01-22 Nicholas X. Wang , Aggelos K. Katsaggelos

Hallucinations pose a significant challenge to the reliability and alignment of Large Language Models (LLMs), limiting their widespread acceptance beyond chatbot applications. Despite ongoing efforts, hallucinations remain a prevalent…

计算与语言 · 计算机科学 2024-02-27 Cem Uluoglakci , Tugba Taskaya Temizel

We present a novel approach to automatically generate non-trivial task-specific synthetic datasets for hallucination detection. Our approach features a two-step generation-selection pipeline, using hallucination pattern guidance and a…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Yong Xie , Karan Aggarwal , Aitzaz Ahmad , Stephen Lau

Since large language models (LLMs) achieve significant success in recent years, the hallucination issue remains a challenge, numerous benchmarks are proposed to detect the hallucination. Nevertheless, some of these benchmarks are not…

计算与语言 · 计算机科学 2024-10-11 Kedi Chen , Qin Chen , Jie Zhou , Yishen He , Liang He

Diffusion Models are probabilistic models that create realistic samples by simulating the diffusion process, gradually adding and removing noise from data. These models have gained popularity in domains such as image processing, speech…

计算机视觉与模式识别 · 计算机科学 2024-08-21 Md Manjurul Ahsan , Shivakumar Raman , Yingtao Liu , Zahed Siddique

Recent language models generate false but plausible-sounding text with surprising frequency. Such "hallucinations" are an obstacle to the usability of language-based AI systems and can harm people who rely upon their outputs. This work…

计算与语言 · 计算机科学 2024-03-21 Adam Tauman Kalai , Santosh S. Vempala

Large vision-language models (VLMs) are highly capable, yet often hallucinate by favoring textual prompts over visual evidence. We study this failure mode in a controlled object-counting setting, where the prompt overstates the number of…

计算机视觉与模式识别 · 计算机科学 2026-04-20 William Rudman , Michal Golovanevsky , Dana Arad , Yonatan Belinkov , Ritambhara Singh , Carsten Eickhoff , Kyle Mahowald

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

计算与语言 · 计算机科学 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Denoising diffusion probabilistic models (DDPMs) have achieved impressive performance on various image generation tasks, including image super-resolution. By learning to reverse the process of gradually diffusing the data distribution into…

图像与视频处理 · 电气工程与系统科学 2023-07-25 Kai Zhao , Alex Ling Yu Hung , Kaifeng Pang , Haoxin Zheng , Kyunghyun Sung

Diffusion models have achieved state-of-the-art performance in generative modeling, yet their sampling procedures remain vulnerable to hallucinations-often stemming from inaccuracies in score approximation. In this work, we reinterpret…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Yiqi Tian , Pengfei Jin , Mingze Yuan , Na Li , Bo Zeng , Quanzheng Li