English
Related papers

Related papers: PathGLS: Evaluating Pathology Vision-Language Mode…

200 papers

The advancement of Large Vision-Language Models (LVLMs) requires precise local region-based reasoning that faithfully grounds the model's logic in actual visual evidence. However, existing datasets face limitations in scalability due to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Byeonggeuk Lim , Kyeonghyun Kim , JungMin Yun , YoungBin Kim

Vision-language models (VLMs) achieve strong performance on multimodal benchmarks, but may still lack robust control over basic visual operations. We study \textit{line tracing}, where a model must follow a selected visual path through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Hyesoo Hong , Minsoo Kim , Wonje Jeung , Sangyeon Yoon , Dongjae Jeon , Albert No

The ability to distinguish subtle differences between visually similar images is essential for diverse domains such as industrial anomaly detection, medical imaging, and aerial surveillance. While comparative reasoning benchmarks for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Minkyu Kim , Sangheon Lee , Dongmin Park

Vision-language models (VLMs) have shown impressive zero- and few-shot performance on real-world visual question answering (VQA) benchmarks, alluding to their capabilities as visual reasoning engines. However, the benchmarks being used…

Computation and Language · Computer Science 2024-09-04 Aishik Nagar , Shantanu Jaiswal , Cheston Tan

Vision-Language Models (VLMs) are increasingly used as perceptual modules for visual content reasoning, including through captioning and DeepFake detection. In this work, we expose a critical vulnerability of VLMs when exposed to subtle,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jordan Vice , Naveed Akhtar , Yansong Gao , Richard Hartley , Ajmal Mian

Multimodal Large Language Models (MLLMs) have shown remarkable proficiency on general-purpose vision-language benchmarks, reaching or even exceeding human-level performance. However, these evaluations typically rely on standard…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenjin Hou , Wei Liu , Han Hu , Xiaoxiao Sun , Serena Yeung-Levy , Hehe Fan

Large Vision Language Models exhibit remarkable capabilities but struggle with hallucinations inconsistencies between images and their descriptions. Previous hallucination evaluation studies on LVLMs have identified hallucinations in terms…

Artificial Intelligence · Computer Science 2024-11-11 Chaoya Jiang , Hongrui Jia , Wei Ye , Mengfan Dong , Haiyang Xu , Ming Yan , Ji Zhang , Shikun Zhang

The robust safety of Vision-Language Large Models (VLLMs) against joint multilingual and multimodal threats remains severely underexplored. Current benchmarks typically isolate these dimensions, being either multilingual but text-only, or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Enyi Shi , Pengyang Shao , Yanxin Zhang , Chenhang Cui , Jiayi Lyu , Xiaobo Xia , Fei Shen , Tat-Seng Chua

We introduce VIGIL (Visual Inconsistency & Generative In-context Lucidity), the first benchmark dataset and framework providing a fine-grained categorization of hallucinations in the multimodal image recontextualization task for large…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Joanna Wojciechowicz , Maria Łubniewska , Jakub Antczak , Justyna Baczyńska , Wojciech Gromski , Wojciech Kozłowski , Maciej Zięba

Recent advancements in Vision-Language Models (VLMs) have demonstrated strong capabilities in general visual reasoning, yet their applicability to rigorous biometric tasks remains unexplored. This work presents an exploratory study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Marta Robledo-Moreno , Ruben Vera-Rodriguez , Ruben Tolosana , Javier Ortega-Garcia

Vision-Language Models (VLMs) have advanced rapidly in multimodal perception and language understanding, yet it remains unclear whether they can reliably ground language into spatially coherent, plausibly executable actions in 3D digital…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Niyati Rawal , Sushant Ravva , Shah Alam Abir , Saksham Jain , Aman Chadha , Vinija Jain , Suranjana Trivedy , Amitava Das

Real world deployments often expose modern object recognition models to domain shifts that precipitate a severe drop in accuracy. Such shifts encompass (i) variations in low level image statistics, (ii) changes in object pose and viewpoint,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Junghyun Park , Tuan Anh Nguyen , Dugki Min

Multimodal Large Language Models (MLLMs) have demonstrated robust capabilities in recognizing everyday human activities, yet their potential for analyzing clinically significant involuntary movements in neurological disorders remains…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Lina Zhang , Tonmoy Monsoor , Mehmet Efe Lorasdagi , Prateik Sinha , Chong Han , Peizheng Li , Yuan Wang , Jessica Pasqua , Colin McCrimmon , Rajarshi Mazumder , Vwani Roychowdhury

The deployment of large language models (LLMs) as interactive agents has exposed a category of behavioral failure that prevailing terminology, principally hallucination, fails to adequately characterize. This paper introduces LLM Psychosis…

Computers and Society · Computer Science 2026-04-30 Ashutosh Raj

Hallucination poses a challenge to the deployment of large vision-language models (LVLMs) in applications. Unlike in large language models (LLMs), hallucination in LVLMs often arises from misalignments between visual inputs and textual…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Sheng Liu , Haotian Ye , Lei Xing , James Zou

Large language models (LLMs) excel on general tasks yet still hallucinate in high-barrier domains such as pathology. Prior work often relies on domain fine-tuning, which neither expands the knowledge boundary nor enforces evidence-grounded…

Computation and Language · Computer Science 2025-10-13 Deshui Yu , Yizhi Wang , Saihui Jin , Taojie Zhu , Fanyi Zeng , Wen Qian , Zirui Huang , Jingli Ouyang , Jiameng Li , Zhen Song , Tian Guan , Yonghong He

Vision-Language Models (VLMs) have demonstrated remarkable generalization capabilities across a wide range of tasks. However, their performance often remains suboptimal when directly applied to specific downstream scenarios without…

Machine Learning · Computer Science 2025-08-08 Hao Dong , Lijun Sheng , Jian Liang , Ran He , Eleni Chatzi , Olga Fink

The rapid advancements in Vision Language Models (VLMs) have prompted the development of multi-modal medical assistant systems. Despite this progress, current models still have inherent probabilistic uncertainties, often producing erroneous…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Xiao Liang , Di Wang , Zhicheng Jiao , Ronghan Li , Pengfei Yang , Quan Wang , Tat-Seng Chua

Recent advances in vision language models (VLMs) have enabled broad progress in the general medical field. However, pathology still remains a more challenging subdomain, with current pathology specific VLMs exhibiting limitations in both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Penghao Zhang , Jingru Guo , Tao Cheng , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Hallucinations in vision-language models (VLMs) hinder reliability and real-world applicability, usually stemming from distribution shifts between pretraining data and test samples. Existing solutions, such as retraining or fine-tuning on…

Multimedia · Computer Science 2025-06-10 Fei Zhao , Chengcui Zhang , Runlin Zhang , Tianyang Wang , Xi Li