English
Related papers

Related papers: Pathological Truth Bias in Vision-Language Models

200 papers

Vision-Language Models (VLMs) have shown strong multimodal reasoning capabilities on Visual-Question-Answering (VQA) benchmarks. However, their robustness against textual misinformation remains under-explored. While existing research has…

Computation and Language · Computer Science 2026-01-28 Chi Zhang , Wenxuan Ding , Jiale Liu , Mingrui Wu , Qingyun Wu , Ray Mooney

Large vision-and-language models (VLMs) trained to match images with text on large-scale datasets of image-text pairs have shown impressive generalization ability on several vision and language tasks. Several recent works, however, showed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Navid Rajabi , Jana Kosecka

Vision Language Models (VLMs) perform well on standard video tasks but struggle with physics-related reasoning involving motion dynamics and spatial interactions. We present a novel approach to address this gap by translating physical-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Xiyang Wu , Zongxia Li , Jihui Jin , Guangyao Shi , Gouthaman KV , Vishnu Raj , Nilotpal Sinha , Jingxi Chen , Fan Du , Dinesh Manocha

Large vision-language models (LVLMs) suffer from hallucination a lot, generating responses that apparently contradict to the image content occasionally. The key problem lies in its weak ability to comprehend detailed content in a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Zhiyang Chen , Yousong Zhu , Yufei Zhan , Zhaowen Li , Chaoyang Zhao , Jinqiao Wang , Ming Tang

Vision-language models (VLMs) exhibit affirmation bias: a systematic tendency to select positive captions ("X is present") even when the correct description contains negation ("no X"). While prior work has documented this failure mode in…

Computation and Language · Computer Science 2026-04-22 Charikleia Moraitaki , Sarah Pan , Skyler Pulling , Gwendolyn Flusche , Kumail Alhamoud , Marzyeh Ghassemi

This paper presents a competitive approach to multilingual subjectivity detection using large language models (LLMs) with few-shot prompting. We participated in Task 1: Subjectivity of the CheckThat! 2025 evaluation campaign. We show that…

Computation and Language · Computer Science 2025-07-11 Akram Elbouanani , Evan Dufraisse , Aboubacar Tuo , Adrian Popescu

Recent research suggests that Vision Language Models (VLMs) often rely on inherent biases learned during training when responding to queries about visual properties of images. These biases are exacerbated when VLMs are asked highly specific…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Saurav Sengupta , Nazanin Moradinasab , Jiebei Liu , Donald E. Brown

Vision-Language Models (VLMs) have attained exceptional success across multimodal tasks such as image captioning and visual question answering. However, their robustness under noisy conditions remains unfamiliar. In this study, we present a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Purushoth , Alireza

Recent advances in embodied Vision-Language Agentic Systems (VLAS), powered by large vision-language models (LVLMs), enable AI systems to perceive and reason over real-world scenes. Within this context, environmental signals such as traffic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Jiamin Chang , Minhui Xue , Ruoxi Sun , Shuchao Pang , Salil S. Kanhere , Hammond Pearce

Despite recent concerns about undesirable behaviors generated by large language models (LLMs), including non-factual, biased, and hateful language, we find LLMs are inherent multi-task language checkers based on their latent representations…

Computation and Language · Computer Science 2023-04-10 Tianhua Zhang , Hongyin Luo , Yung-Sung Chuang , Wei Fang , Luc Gaitskell , Thomas Hartvigsen , Xixin Wu , Danny Fox , Helen Meng , James Glass

Vision-Language Models (VLMs), such as CLIP, have already seen widespread applications. Researchers actively engage in further fine-tuning VLMs in safety-critical domains. In these domains, prediction rationality is crucial: the prediction…

Machine Learning · Computer Science 2025-02-26 Qitong Wang , Tang Li , Kien X. Nguyen , Xi Peng

Large Vision Language Models (VLMs) have long struggled with spatial reasoning tasks. Surprisingly, even simple spatial reasoning tasks, such as recognizing "under" or "behind" relationships between only two objects, pose significant…

Computation and Language · Computer Science 2025-10-14 Shiqi Chen , Tongyao Zhu , Ruochen Zhou , Jinghan Zhang , Siyang Gao , Juan Carlos Niebles , Mor Geva , Junxian He , Jiajun Wu , Manling Li

Vision-Language Models (VLMs) and generative image models have achieved remarkable performance across multimodal tasks, yet their robustness and fairness under input transformations remain insufficiently explored. This work investigates…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Tarannum Mithila

Vision-language models (VLMs) achieve strong performance on spatial reasoning benchmarks, yet it remains unclear whether this reflects structured 3D understanding or reliance on statistical shortcuts in natural images. We introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Cheolhong Min , Jaeyun Jung , Daeun Lee , Hyeonseong Jeon , Yu Su , Jonathan Tremblay , Chan Hee Song , Jaesik Park

Visual Language Models (VLMs) have achieved remarkable progress, yet their reliability under small, meaning-preserving input changes remains poorly understood. We present the first large-scale, systematic study of VLM robustness to benign…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Amir Rosenfeld , Neta Glazer , Ethan Fetaya

Vision-Language Models (VLMs) have recently emerged as powerful tools, excelling in tasks that integrate visual and textual comprehension, such as image captioning, visual question answering, and image-text retrieval. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ilias Stogiannidis , Steven McDonagh , Sotirios A. Tsaftaris

Vision-Language Models (VLMs) are increasingly used as perceptual modules for visual content reasoning, including through captioning and DeepFake detection. In this work, we expose a critical vulnerability of VLMs when exposed to subtle,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jordan Vice , Naveed Akhtar , Yansong Gao , Richard Hartley , Ajmal Mian

Vision-Language Models (VLMs) have emerged as general purpose tools for addressing a variety of complex computer vision problems. Such models have been shown to be highly capable, but, at the same time, also lacking some basic visual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Shivam Chandhok , Wan-Cyuan Fan , Leonid Sigal

Vision-Language Models (VLMs) demonstrate impressive capabilities across multimodal tasks, yet exhibit systematic spatial reasoning failures, achieving only 49% (CLIP) to 54% (BLIP-2) accuracy on basic directional relationships. For safe…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Muhammad Imran , Yugyung Lee

Vision Large Language Models (VLLMs) represent a significant advancement in artificial intelligence by integrating image-processing capabilities with textual understanding, thereby enhancing user interactions and expanding application…

Computation and Language · Computer Science 2025-05-09 Madhur Jindal , Saurabh Deshpande