中文
相关论文

相关论文: Online Self-Calibration Against Hallucination in V…

200 篇论文

Reasoning has emerged as a key capability of large language models. In linguistic tasks, this capability can be enhanced by self-improving techniques that refine reasoning paths for subsequent finetuning. However, extending these…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Zhiyu Pan , Yizheng Wu , Jiashen Hua , Junyi Feng , Shaotian Yan , Bing Deng , Zhiguo Cao , Jieping Ye

Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where…

计算与语言 · 计算机科学 2023-10-11 Ziwei Ji , Tiezheng Yu , Yan Xu , Nayeon Lee , Etsuko Ishii , Pascale Fung

Large Vision-Language Models (LVLMs) are susceptible to object hallucinations, an issue in which their generated text contains non-existent objects, greatly limiting their reliability and practicality. Current approaches often rely on the…

计算机视觉与模式识别 · 计算机科学 2024-04-24 Ailin Deng , Zhirui Chen , Bryan Hooi

The increasing use of large language models (LLMs) in causal discovery as a substitute for human domain experts highlights the need for optimal model selection. This paper presents the first hallucination survey of popular LLMs for causal…

计算与语言 · 计算机科学 2024-11-21 Grace Sng , Yanming Zhang , Klaus Mueller

The emergence of large Vision Language Models (VLMs) has broadened the scope and capabilities of single-modal Large Language Models (LLMs) by integrating visual modalities, thereby unlocking transformative cross-modal applications in a…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Shuo Xing , Peiran Li , Yuping Wang , Ruizheng Bai , Yueqi Wang , Chan-Wei Hu , Chengxuan Qian , Huaxiu Yao , Zhengzhong Tu

Large Vision-Language Models (LVLMs) are increasingly adept at generating contextually detailed and coherent responses from visual inputs. However, their application in multimodal decision-making and open-ended generation is hindered by a…

计算机视觉与模式识别 · 计算机科学 2024-06-06 Xintong Wang , Jingheng Pan , Liang Ding , Chris Biemann

The emergence of large language models (LLMs) is a milestone in generative artificial intelligence, achieving significant success in text comprehension and generation tasks. Despite the tremendous success of LLMs in many downstream tasks,…

计算与语言 · 计算机科学 2024-07-16 He Li , Haoang Chi , Mingyu Liu , Wenjing Yang

Large Visual Language Models (LVLMs) integrate visual and linguistic modalities, exhibiting exceptional performance across various multimodal tasks. Nevertheless, LVLMs remain vulnerable to the issue of object hallucinations. Previous…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Chao Wang , Xuancheng Zhou , Weiwei Fu , Yang Zhou

Large Vision-Language Models (LVLMs) have achieved remarkable success but continue to struggle with object hallucination (OH), generating outputs inconsistent with visual inputs. While previous work has proposed methods to reduce OH, the…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Boxu Chen , Ziwei Zheng , Le Yang , Zeyu Geng , Zhengyu Zhao , Chenhao Lin , Chao Shen

Large Vision-Language Models (LVLMs) have obtained impressive performance in visual content understanding and multi-modal reasoning. Unfortunately, these large models suffer from serious hallucination problems and tend to generate…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Wei Suo , Lijun Zhang , Mengyang Sun , Lin Yuanbo Wu , Peng Wang , Yanning Zhang

Object hallucination remains a critical challenge in Large Vision-Language Models (LVLMs), where models generate content inconsistent with visual inputs. Existing language-decoder based mitigation approaches often regulate visual or textual…

计算机视觉与模式识别 · 计算机科学 2025-11-13 Liu Yu , Zhonghao Chen , Ping Kuang , Zhikun Feng , Fan Zhou , Lan Wang , Gillian Dobbie

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities in understanding and describing visual content, achieving state-of-the-art performance across various vision-language tasks. However, these models often generate…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Kazi Hasan Ibn Arif , Sajib Acharjee Dip , Khizar Hussain , Lang Zhang , Chris Thomas

Despite the impressive capabilities of Large Vision-Language Models (LVLMs), they remain susceptible to hallucinations-generating content that is inconsistent with the input image. Existing training-free hallucination mitigation methods…

机器学习 · 计算机科学 2025-05-20 Kai Tang , Jinhao You , Xiuqi Ge , Hanze Li , Yichen Guo , Xiande Huang

This work introduces a novel methodology for the automatic detection of hallucinations generated during large language model (LLM) inference. The proposed approach is based on a systematic taxonomy and controlled reproduction of diverse…

计算与语言 · 计算机科学 2025-10-08 Maksym Zavhorodnii , Dmytro Dehtiarov , Anna Konovalenko

Vision Language Models (VLMs) have recently achieved significant progress in bridging visual perception and linguistic reasoning. Recently, OpenAI o3 model introduced a zoom-in search strategy that effectively elicits active perception…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Wanfu Wang , Qipeng Huang , Guangquan Xue , Xiaobo Liang , Juntao Li

Vision-language models (VLMs) have recently shown remarkable capabilities in visual understanding and generation, but remain vulnerable to adversarial manipulations of visual content. Prior object-hiding attacks primarily rely on…

密码学与安全 · 计算机科学 2026-03-18 Amira Guesmi , Muhammad Shafique

Modern large language models (LLMs) represent a paradigm shift in what can plausibly be expected of machine learning models. The fact that LLMs can effectively generate sensible answers to a diverse range of queries suggests that they would…

计算与语言 · 计算机科学 2024-05-27 Dean Wyatte , Fatemeh Tahmasbi , Ming Li , Thomas Markovich

Due to the unidirectional masking mechanism, Decoder-Only models propagate information from left to right. LVLMs (Large Vision-Language Models) follow the same architecture, with visual information gradually integrated into semantic…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Jianfei Zhao , Feng Zhang , Xin Sun , Chong Feng

Multimodal large language models (MLLMs) have achieved strong performance on vision-language tasks but still struggle with fine-grained visual differences, leading to hallucinations or missed semantic shifts. We attribute this to…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Tianyi Bai , Yuxuan Fan , Jiantao Qiu , Fupeng Sun , Jiayi Song , Junlin Han , Zichen Liu , Conghui He , Wentao Zhang , Binhang Yuan

Nowadays, the research on Large Vision-Language Models (LVLMs) has been significantly promoted thanks to the success of Large Language Models (LLM). Nevertheless, these Vision-Language Models (VLMs) are suffering from the drawback of…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Hongyu Hu , Jiyuan Zhang , Minyi Zhao , Zhenbang Sun