English
Related papers

Related papers: Edge Reliability Gap in Vision-Language Models: Qu…

200 papers

Vision-Language Models (VLMs) have emerged as general purpose tools for addressing a variety of complex computer vision problems. Such models have been shown to be highly capable, but, at the same time, also lacking some basic visual…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Shivam Chandhok , Wan-Cyuan Fan , Leonid Sigal

Vision-Language Models (VLMs) exhibit puzzling failures in multi-object visual tasks, such as hallucinating non-existent elements or failing to identify the most similar objects among distractions. While these errors mirror human cognitive…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Daniele Savietto , Declan Campbell , André Panisson , Marco Nurisso , Giovanni Petri , Jonathan D. Cohen , Alan Perotti

Large Vision-Language Models (VLMs) rely on effective multimodal alignment between pre-trained vision encoders and Large Language Models (LLMs) to integrate visual and textual information. This paper presents a comprehensive analysis of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Shweta Mahajan , Hoang Le , Hyojin Park , Farzad Farhadzadeh , Munawar Hayat , Fatih Porikli

Vision-language Models (VLMs), despite achieving strong performance on multimodal benchmarks, often misinterpret straightforward visual concepts that humans identify effortlessly, such as counting, spatial reasoning, and viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Kanishk Jain , Qian Yang , Shravan Nayak , Parisa Kordjamshidi , Nishanth Anand , Aishwarya Agrawal

Recent advances in Vision-Language Models (VLMs) have improved performance in multi-modal learning, raising the question of whether these models truly understand the content they process. Crucially, can VLMs detect when a reasoning process…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yang Shi , Yifeng Xie , Minzhe Guo , Liangsi Lu , Mingxuan Huang , Jingchao Wang , Zhihong Zhu , Boyan Xu , Zhiqi Huang

The rapid success of Vision Large Language Models (VLLMs) often depends on the high-resolution images with abundant visual tokens, which hinders training and deployment efficiency. Current training-free visual token compression methods…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Jianjian Li , Junquan Fan , Feng Tang , Gang Huang , Shitao Zhu , Songlin Liu , Nian Xie , Wulong Liu , Yong Liao

Large Language Model (LLM)-based Vision-Language Models (VLMs) have substantially extended the boundaries of visual understanding capabilities. However, their high computational demands hinder deployment on resource-constrained edge…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Haotong Qin , Cheng Hu , Michele Magno

Current Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misalignment of their knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Peipeng Yu , Jianwei Fei , Hui Gao , Xuan Feng , Zhihua Xia , Chip Hong Chang

Vision-language models (VLMs) generate fluent causal explanations, but current evaluations cannot distinguish linguistic plausibility from faithful causal reasoning. We introduce a dual-probe methodology that isolates these properties. The…

Computation and Language · Computer Science 2026-05-28 Chinh Hoang , Mohammad Rashedul Hasan

Verbal confidence elicitation is widely used to extract uncertainty estimates from LLMs. We tested whether seven instruction-tuned open-weight models (3-9B parameters, four families) produce verbalised confidence that meets minimal validity…

Computation and Language · Computer Science 2026-04-27 Jon-Paul Cacioli

Trained on a vast amount of data, Large Language models (LLMs) have achieved unprecedented success and generalization in modeling fairly complex textual inputs in the abstract space, making them powerful tools for zero-shot learning. Such…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Shervin Ardeshir

With recent progress in joint modeling of visual and textual representations, Vision-Language Pretraining (VLP) has achieved impressive performance on many multimodal downstream tasks. However, the requirement for expensive annotations…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zirui Wang , Jiahui Yu , Adams Wei Yu , Zihang Dai , Yulia Tsvetkov , Yuan Cao

Accurate and timely identification of construction hazards around workers is essential for preventing workplace accidents. While large vision-language models (VLMs) demonstrate strong contextual reasoning capabilities, their high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Muhammad Adil , Mehmood Ahmed , Muhammad Aqib , Vicente A. Gonzalez , Gaang Lee , Qipei Mei

Vision-language models (VLMs) adapted to the medical domain have shown strong performance on visual question answering benchmarks, yet their robustness against two critical failure modes, hallucination and sycophancy, remains poorly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 OFM Riaz Rahman Aranya , Kevin Desai

Software logs generated by sophisticated network emulators in the telecommunications industry, such as VIAVI TM500, are extremely complex, often comprising tens of thousands of text lines with minimal resemblance to natural language. Only…

Computation and Language · Computer Science 2024-07-08 Achintha Ihalage , Sayed M. Taheri , Faris Muhammad , Hamed Al-Raweshidy

Vision-language models (VLMs) are increasingly deployed in socially sensitive applications, yet their behavior with respect to disability remains underexplored. We study disability aware descriptions for person centric images, where models…

Artificial Intelligence · Computer Science 2026-01-27 Srikant Panda , Sourabh Singh Yadav , Palkesh Malviya

Large language models demonstrate strong performance on mathematical reasoning benchmarks, yet remain surprisingly fragile to meaning-preserving surface perturbations. We systematically evaluate three open-weight LLMs, Mistral-7B,…

Computation and Language · Computer Science 2026-04-03 Shou-Tzu Han , Rodrigue Rizk , KC Santosh

Despite strong performance on vision-language tasks, Multimodal Large Language Models (MLLMs) struggle with mathematical problem-solving, with both open-source and state-of-the-art models falling short of human performance on visual-math…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 William Rudman , Michal Golovanevsky , Amir Bar , Vedant Palit , Yann LeCun , Carsten Eickhoff , Ritambhara Singh

Vision-Language Models show strong zero-shot performance for chest X-ray classification, but standard flat metrics fail to distinguish between clinically minor and severe errors. This work investigates how to quantify and mitigate…

Artificial Intelligence · Computer Science 2026-01-22 Ben Schaper , Maxime Di Folco , Bernhard Kainz , Julia A. Schnabel , Cosmin I. Bercea

Vision Language Models (VLMs) excel at identifying and describing objects but often fail at spatial reasoning. We study why VLMs, such as LLaVA, underutilize spatial cues despite having positional encodings and spatially rich vision encoder…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jianing Qi , Jiawei Liu , Hao Tang , Zhigang Zhu