English
Related papers

Related papers: A VLM-based Method for Visual Anomaly Detection in…

200 papers

Video Anomaly Detection (VAD) has traditionally been framed as binary classification or outlier detection, providing neither interpretable reasoning nor precise spatial localization of anomalous events. While Vision-Language Models (VLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Sakshi Agarwal , Aishik Konwer , Ankit Parag Shah

Detecting visual anomalies in diverse, multi-class real-world images is a significant challenge. We introduce \ours, a novel unsupervised multi-class visual anomaly detection framework. It integrates a Latent Diffusion Model (LDM) with a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Samet Hicsonmez , Abd El Rahman Shabayek , Djamila Aouada

While Vision-Language Models (VLMs) have demonstrated significant potential in chemical visual understanding, current models are predominantly optimized for direct visual question-answering tasks. This paradigm often results in "black-box"…

Computation and Language · Computer Science 2026-04-09 Xuanle Zhao , Xinyuan Cai , Xiang Cheng , Xiuyi Chen , Bo Xu

Pre-trained vision-language models (VLMs) are highly adaptable to various downstream tasks through few-shot learning, making prompt-based anomaly detection a promising approach. Traditional methods depend on human-crafted prompts that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Pi-Wei Chen , Jerry Chun-Wei Lin , Jia Ji , Feng-Hao Yeh , Zih-Ching Chen , Chao-Chun Chen

Vision-language models (VLMs) have recently demonstrated strong efficacy as visual assistants that can parse natural queries about the visual content and generate human-like outputs. In this work, we explore the ability of these models to…

Computation and Language · Computer Science 2024-03-21 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Vision-Language Models (VLMs) frequently "hallucinate" - generate plausible yet factually incorrect statements - posing a critical barrier to their trustworthy deployment. In this work, we propose a new paradigm for diagnosing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lexiang Xiong , Qi Li , Jingwen Ye , Xinchao Wang

Unified vision-language models (VLMs) promise to streamline computer vision pipelines by reframing multiple visual tasks such as classification, detection, and keypoint localization within a single language-driven interface. This…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Conor Wallace , Isaac Corley , Jonathan Lwowski

Visualizations help communicate data insights, but deceptive data representations can distort their interpretation and propagate misinformation. While recent Vision Language Models (VLMs) perform well on many chart understanding tasks,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Harsh Nishant Lalai , Raj Sanjay Shah , Hanspeter Pfister , Sashank Varma , Grace Guo

Active perception enables robots to dynamically gather information by adjusting their viewpoints, a crucial capability for interacting with complex, partially observable environments. In this paper, we present AP-VLM, a novel framework that…

Robotics · Computer Science 2025-06-10 Venkatesh Sripada , Samuel Carter , Frank Guerin , Amir Ghalamzan

We introduce VLM-Lens, a toolkit designed to enable systematic benchmarking, analysis, and interpretation of vision-language models (VLMs) by supporting the extraction of intermediate outputs from any layer during the forward pass of…

Computation and Language · Computer Science 2025-10-03 Hala Sheta , Eric Huang , Shuyu Wu , Ilia Alenabi , Jiajun Hong , Ryker Lin , Ruoxi Ning , Daniel Wei , Jialin Yang , Jiawei Zhou , Ziqiao Ma , Freda Shi

Recent progress in Vision Language Models (VLMs) has raised the question of whether they can reliably perform nonverbal reasoning. To this end, we introduce VRIQ (Visual Reasoning IQ), a novel benchmark designed to assess and analyze the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Tina Khezresmaeilzadeh , Jike Zhong , Konstantinos Psounis

Vision-language models (VLMs) are increasingly proposed as general-purpose tools for scientific data interpretation, yet their reliability on real astronomical observations across diverse modalities remains untested. We present…

Artificial Intelligence · Computer Science 2026-04-28 Wenke Ren , Hengxiao Guo , Wenwen Zuo , Xiaoman Zhang

Semiconductor manufacturing is a complex, multistage process. Automated visual inspection of Scanning Electron Microscope (SEM) images is indispensable for minimizing equipment downtime and containing costs. Most previous research considers…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Manuel Barusco , Francesco Borsatti , Youssef Ben Khalifa , Davide Dalle Pezze , Gian Antonio Susto

Vision-language model (VLM) shows promise for high-level planning in smart manufacturing, yet their deployment in dynamic workcells faces two critical challenges: (1) stateless operation, they cannot persistently track out-of-view states,…

Robotics · Computer Science 2026-02-18 Guoqin Tang , Qingxuan Jia , Gang Chen , Tong Li , Zeyuan Huang , Zihang Lv , Ning Ji

Current vision-language models (VLMs) still exhibit inferior performance on knowledge-intensive tasks, primarily due to the challenge of accurately encoding all the associations between visual objects and scenes to their corresponding…

Computation and Language · Computer Science 2024-10-16 Jingyuan Qi , Zhiyang Xu , Rulin Shao , Yang Chen , Jin Di , Yu Cheng , Qifan Wang , Lifu Huang

Reasoning-augmented vision language models (VLMs) generate explicit chains of thought that promise greater capability and transparency but also introduce new failure modes: models may reach correct answers via visually unfaithful…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Rheeya Uppaal , Phu Mon Htut , Min Bai , Nikolaos Pappas , Zheng Qi , Sandesh Swamy

Vision-language modeling (VLM) aims to bridge the information gap between images and natural language. Under the new paradigm of first pre-training on massive image-text pairs and then fine-tuning on task-specific data, VLM in the remote…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Xingxing Weng , Chao Pang , Gui-Song Xia

Accurate and timely identification of construction hazards around workers is essential for preventing workplace accidents. While large vision-language models (VLMs) demonstrate strong contextual reasoning capabilities, their high…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Muhammad Adil , Mehmood Ahmed , Muhammad Aqib , Vicente A. Gonzalez , Gaang Lee , Qipei Mei

Semantic segmentation networks have achieved significant success under the assumption of independent and identically distributed data. However, these networks often struggle to detect anomalies from unknown semantic classes due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Liangyu Zhong , Joachim Sicking , Fabian Hüger , Hanno Gottschalk

Vision-Language Model (VLM) have gained widespread adoption in Open-Vocabulary (OV) object detection and segmentation tasks. Despite they have shown promise on OV-related tasks, their effectiveness in conventional vision tasks has thus far…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Yongchao Feng , Yajie Liu , Shuai Yang , Wenrui Cai , Jinqing Zhang , Qiqi Zhan , Ziyue Huang , Hongxi Yan , Qiao Wan , Chenguang Liu , Junzhe Wang , Jiahui Lv , Ziqi Liu , Tengyuan Shi , Qingjie Liu , Yunhong Wang