English
Related papers

Related papers: Analyzing VLM-Based Approaches for Anomaly Classif…

200 papers

Anomaly detection (AD) identifies outliers for applications like defect and lesion detection. While CLIP shows promise for zero-shot AD tasks due to its strong generalization capabilities, its inherent Anomaly-Unawareness leads to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wenxin Ma , Xu Zhang , Qingsong Yao , Fenghe Tang , Chenxu Wu , Yingtai Li , Rui Yan , Zihang Jiang , S. Kevin Zhou

Pre-trained vision-language models (VLMs) are highly adaptable to various downstream tasks through few-shot learning, making prompt-based anomaly detection a promising approach. Traditional methods depend on human-crafted prompts that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Pi-Wei Chen , Jerry Chun-Wei Lin , Jia Ji , Feng-Hao Yeh , Zih-Ching Chen , Chao-Chun Chen

Anomaly detection identifies departures from expected behavior in safety-critical settings. When target-domain normal data are unavailable, zero-shot anomaly detection (ZSAD) leverages vision-language models (VLMs). However, CLIP's coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Alireza Salehi , Ehsan Karami , Sepehr Noey , Sahand Noey , Makoto Yamada , Reshad Hosseini , Mohammad Sabokrou

This paper considers zero-shot Anomaly Detection (AD), performing AD without reference images of the test objects. We propose a framework called CLIP-AD to leverage the zero-shot capabilities of the large vision-language model CLIP.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Xuhai Chen , Jiangning Zhang , Guanzhong Tian , Haoyang He , Wuhao Zhang , Yabiao Wang , Chengjie Wang , Yong Liu

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Image Anomaly Detection has been a challenging task in Computer Vision field. The advent of Vision-Language models, particularly the rise of CLIP-based frameworks, has opened new avenues for zero-shot anomaly detection. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Zhaoxiang Zhang , Hanqiu Deng , Jinan Bao , Xingyu Li

The zero-shot performance of existing vision-language models (VLMs) such as CLIP is limited by the availability of large-scale, aligned image and text datasets in specific domains. In this work, we leverage two complementary sources of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Oindrila Saha , Grant Van Horn , Subhransu Maji

In this study, we define and tackle zero shot "real" classification by description, a novel task that evaluates the ability of Vision-Language Models (VLMs) like CLIP to classify objects based solely on descriptive attributes, excluding…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Ethan Baron , Idan Tankel , Peter Tu , Guy Ben-Yosef

Zero-shot anomaly detection (ZSAD) requires detecting and localizing anomalies without access to target-class anomaly samples. Mainstream methods rely on vision-language models (VLMs) such as CLIP: they build hand-crafted or learned prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanning Hou , Peiyuan Li , Zirui Liu , Yitong Wang , Yanran Ruan , Jianfeng Qiu , Ke Xu

Vision-Language models (VLMs) that use contrastive language-image pre-training have shown promising zero-shot classification performance. However, their performance on imbalanced dataset is relatively poor, where the distribution of classes…

Artificial Intelligence · Computer Science 2023-06-22 Yidong Wang , Zhuohao Yu , Jindong Wang , Qiang Heng , Hao Chen , Wei Ye , Rui Xie , Xing Xie , Shikun Zhang

Recently, foundational models such as CLIP and SAM have shown promising performance for the task of Zero-Shot Anomaly Segmentation (ZSAS). However, either CLIP-based or SAM-based ZSAS methods still suffer from non-negligible key drawbacks:…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Shengze Li , Jianjian Cao , Peng Ye , Yuhan Ding , Chongjun Tu , Tao Chen

Zero-shot anomaly detection aims to detect and localise abnormal regions in the image without access to any in-domain training images. While recent approaches leverage vision-language models (VLMs), such as CLIP, to transfer high-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Matic Fučka , Vitjan Zavrtanik , Danijel Skočaj

Vision-language models (VLMs), such as CLIP, have gained popularity for their strong open vocabulary classification performance, but they are prone to assigning high confidence scores to misclassifications, limiting their reliability in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Zhenxiang Lin , Maryam Haghighat , Will Browne , Dimity Miller

Generalized Zero-shot Semantic Segmentation aims to segment both seen and unseen categories only under the supervision of the seen ones. To tackle this, existing methods adopt the large-scale Vision Language Models (VLMs) which obtain…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jialei Chen , Daisuke Deguchi , Chenkai Zhang , Xu Zheng , Hiroshi Murase

Zero-shot anomaly segmentation using pre-trained foundation models is a promising approach that enables effective algorithms without expensive, domain-specific training or fine-tuning. Ensuring that these methods work across various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Kevin Stangl , Marius Arvinte , Weilin Xu , Cory Cornelius

Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot out-of-distribution (OOD) detection capabilities, vital for reliable AI systems. Despite this promising capability, a comprehensive understanding of (1) why…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuxiao Lee , Xiaofeng Cao , Wei Ye , Jiangchao Yao , Jingkuan Song , Heng Tao Shen

Recently, large-scale vision-language models such as CLIP have demonstrated immense potential in zero-shot anomaly segmentation (ZSAS) task, utilizing a unified model to directly detect anomalies on any unseen product with painstakingly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhen Qu , Xian Tao , Mukesh Prasad , Fei Shen , Zhengtao Zhang , Xinyi Gong , Guiguang Ding

Fine-grained image classification, particularly in zero/few-shot scenarios, presents a significant challenge for vision-language models (VLMs), such as CLIP. These models often struggle with the nuanced task of distinguishing between…

Computation and Language · Computer Science 2024-05-21 Canshi Wei

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Detecting anomalies within point clouds is crucial for various industrial applications, but traditional unsupervised methods face challenges due to data acquisition costs, early-stage production constraints, and limited generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Yuqi Cheng , Yunkang Cao , Guoyang Xie , Zhichao Lu , Weiming Shen