English
Related papers

Related papers: Counterfactual Segmentation Reasoning: Diagnosing …

200 papers

Hallucinations pose a significant challenge for large language models when answering knowledge-intensive queries. As LLMs become more widely adopted, it is crucial not only to detect if hallucinations occur but also to pinpoint exactly…

Computation and Language · Computer Science 2025-05-07 Sicong Huang , Jincheng He , Shiyuan Huang , Karthik Raja Anandan , Arkajyoti Chakraborty , Ian Lane

Leveraging large-scale Text-to-Image (TTI) models have become a common technique for generating exemplar or training dataset in the fields of image synthesis, video editing, 3D reconstruction. However, semantic structural visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Bumsoo Kim , Wonseop Shin , Kyuchul Lee , Yonghoon Jung , Sanghyun Seo

Large vision-language models (LVLMs) are prone to hallucinations, where certain contextual cues in an image can trigger the language module to produce overconfident and incorrect reasoning about abnormal or hypothetical objects. While some…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xiyang Wu , Tianrui Guan , Dianqi Li , Shuaiyi Huang , Xiaoyu Liu , Xijun Wang , Ruiqi Xian , Abhinav Shrivastava , Furong Huang , Jordan Lee Boyd-Graber , Tianyi Zhou , Dinesh Manocha

Multi-modal large language models (MLLMs) have been shown to efficiently integrate natural language with visual information to handle multi-modal tasks. However, MLLMs still face a fundamental limitation of hallucinations, where they tend…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Chaoya Jiang , Haiyang Xu , Mengfan Dong , Jiaxing Chen , Wei Ye , Ming Yan , Qinghao Ye , Ji Zhang , Fei Huang , Shikun Zhang

Scaling up the vocabulary of semantic segmentation models is extremely challenging because annotating large-scale mask labels is labour-intensive and time-consuming. Recently, language-guided segmentation models have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Haojun Yu , Di Dai , Ziwei Zhao , Di He , Han Hu , Liwei Wang

The Large Visual Language Models (LVLMs) enhances user interaction and enriches user experience by integrating visual modality on the basis of the Large Language Models (LLMs). It has demonstrated their powerful information processing and…

Artificial Intelligence · Computer Science 2024-10-22 Wei Lan , Wenyi Chen , Qingfeng Chen , Shirui Pan , Huiyu Zhou , Yi Pan

Multimodal Large Language Models (MLLMs) deliver detailed responses on vision-language tasks, yet remain susceptible to object hallucination (introducing objects not present in the image), undermining reliability in practice. Prior efforts…

Machine Learning · Computer Science 2026-02-26 Shiwei Tan , Hengyi Wang , Weiyi Qin , Qi Xu , Zhigang Hua , Hao Wang

Vision-Language Models (VLMs) are becoming increasingly popular in the medical domain, bridging the gap between medical images and clinical language. Existing VLMs demonstrate an impressive ability to comprehend medical images and text…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Bidur Khanal , Sandesh Pokhrel , Sanjay Bhandari , Ramesh Rana , Nikesh Shrestha , Ram Bahadur Gurung , Cristian Linte , Angus Watson , Yash Raj Shrestha , Binod Bhattarai

Large vision-language models (LVLMs) frequently suffer from Object Hallucination (OH), wherein they generate descriptions containing objects that are not actually present in the input image. This phenomenon is particularly problematic in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yanbin Huang , Yisen Li , Guiyao Tie , Xiaoye Qu , Pan Zhou , Hongfei Wang , Zhaofan Zou , Hao Sun , Xuelong Li

Reasoning-centric video object segmentation is an inherently complex task: the query often refers to dynamics, causality, and temporal interactions, rather than static appearances. Yet existing solutions generally collapse these factors…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yifan Li , Yingda Yin , Lingting Zhu , Weikai Chen , Shengju Qian , Xin Wang , Yanwei Fu

Identification of hallucination spans in black-box language model generated text is essential for applications in the real world. A recent attempt at this direction is SemEval-2025 Task 3, Mu-SHROOM-a Multilingual Shared Task on…

Computation and Language · Computer Science 2025-05-26 Saketh Reddy Vemula , Parameswari Krishnamurthy

Large language models (LLMs) have achieved impressive performance across a wide range of natural language processing tasks, yet they often produce hallucinated content that undermines factual reliability. To address this challenge, we…

Computation and Language · Computer Science 2026-03-23 Yaxin Zhao , Yu Zhang

The rapid development of Large Multimodal Models (LMMs) has significantly advanced multimodal understanding by harnessing the language abilities of Large Language Models (LLMs) and integrating modality-specific encoders. However, LMMs are…

Computation and Language · Computer Science 2025-02-20 Anirudh Phukan , Divyansh , Harshit Kumar Morj , Vaishnavi , Apoorv Saxena , Koustava Goswami

Artificial Intelligence (AI), particularly Large Language Models (LLMs), is transforming scientific discovery, enabling rapid knowledge generation and hypothesis formulation. However, a critical challenge is hallucination, where LLMs…

Artificial Intelligence · Computer Science 2025-12-30 Bhanu Prakash Vangala , Sajid Mahmud , Pawan Neupane , Joel Selvaraj , Jianlin Cheng

In semi-supervised semantic segmentation, a model is trained with a limited number of labeled images along with a large corpus of unlabeled images to reduce the high annotation effort. While previous methods are able to learn good…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Lukas Hoyer , David Joseph Tan , Muhammad Ferjad Naeem , Luc Van Gool , Federico Tombari

Large Vision-Language Models (LVLMs) have made substantial progress by integrating pre-trained large language models (LLMs) and vision models through instruction tuning. Despite these advancements, LVLMs often exhibit the hallucination…

Machine Learning · Computer Science 2024-11-05 Yiyang Zhou , Zhiyuan Fan , Dongjie Cheng , Sihan Yang , Zhaorun Chen , Chenhang Cui , Xiyao Wang , Yun Li , Linjun Zhang , Huaxiu Yao

Large Vision-Language Models (LVLMs) are susceptible to object hallucinations, an issue in which their generated text contains non-existent objects, greatly limiting their reliability and practicality. Current approaches often rely on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ailin Deng , Zhirui Chen , Bryan Hooi

The emergence of large language models (LLMs) has significantly advanced the development of natural language processing (NLP), especially in text generation tasks like question answering. However, model hallucinations remain a major…

Computation and Language · Computer Science 2025-12-01 Zhongxin Liu , Zhiwei Wang , Jun Niu , Ying Li , Hongyu Sun , Meng Xu , He Wang , Gaofei Wu , Yuqing Zhang

Large language models (LLMs) exhibit logically inconsistent hallucinations that appear coherent yet violate reasoning principles, with recent research suggesting an inverse relationship between causal reasoning capabilities and such…

Computation and Language · Computer Science 2025-11-13 Yuangang Li , Yiqing Shen , Yi Nian , Jiechao Gao , Ziyi Wang , Chenxiao Yu , Shawn Li , Jie Wang , Xiyang Hu , Yue Zhao

Multimodal Large Language Models (MLLMs) have demonstrated strong performance in visual understanding tasks, yet they often suffer from object hallucinations--generating descriptions of objects that are inconsistent with or entirely absent…

Artificial Intelligence · Computer Science 2025-05-27 Xinmiao Hu , Chun Wang , Ruihe An , ChenYu Shao , Xiaojun Ye , Sheng Zhou , Liangcheng Li