English
Related papers

Related papers: Analyzing VLM-Based Approaches for Anomaly Classif…

200 papers

Large-scale vision-language models (VLMs), such as CLIP, have achieved remarkable success in zero-shot learning (ZSL) by leveraging large-scale visual-text pair datasets. However, these methods often lack interpretability, as they compute…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shiming Chen , Bowen Duan , Salman Khan , Fahad Shahbaz Khan

Zero-shot anomaly detection (ZSAD) identifies anomalies without needing training samples from the target dataset, essential for scenarios with privacy concerns or limited data. Vision-language models like CLIP show potential in ZSAD but…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chengyuan Li , Suyang Zhou , Jieping Kong , Lei Qi , Hui Xue

Vision-language models (VLMs) have enabled strong zero-shot classification through image-text alignment. Yet, their purely visual inference capabilities remain under-explored. In this work, we conduct a comprehensive evaluation of both…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Illia Volkov , Nikita Kisel , Klara Janouskova , Jiri Matas

Vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot ability in image classification tasks by aligning text and images but suffer inferior performance compared with task-specific expert models. On the contrary,…

Artificial Intelligence · Computer Science 2025-02-04 Jia Zhang , Zhi Zhou , Lan-Zhe Guo , Yu-Feng Li

Detecting anomaly edges for dynamic graphs aims to identify edges significantly deviating from the normal pattern and can be applied in various domains, such as cybersecurity, financial transactions and AIOps. With the evolving of time, the…

Machine Learning · Computer Science 2024-08-29 Shuo Liu , Di Yao , Lanting Fang , Zhetao Li , Wenbin Li , Kaiyu Feng , XiaoWen Ji , Jingping Bi

Recent vision language models (VLMs) like CLIP have demonstrated impressive anomaly detection performance under significant distribution shift by utilizing high-level semantic information through text prompts. However, these models often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Nadeem Nazer , Hongkuan Zhou , Lavdim Halilaj , Ylli Sadikaj , Steffen Staab

CLIP (Contrastive Language-Image Pre-training) uses contrastive learning from noise image-text pairs to excel at recognizing a wide array of candidates, yet its focus on broad associations hinders the precision in distinguishing subtle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ziyu Liu , Zeyi Sun , Yuhang Zang , Wei Li , Pan Zhang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

While deep learning, including Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), has significantly advanced classification performance, its typical reliance on extensive annotated datasets presents a major obstacle in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Matheus Vinícius Todescato , Joel Luís Carbonera

Zero-shot medical image classification is a critical process in real-world scenarios where we have limited access to all possible diseases or large-scale annotated data. It involves computing similarity scores between a query medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Jiaxiang Liu , Tianxiang Hu , Yan Zhang , Xiaotang Gai , Yang Feng , Zuozhu Liu

Recognizing and disentangling visual attributes from objects is a foundation to many computer vision applications. While large vision language representations like CLIP had largely resolved the task of zero-shot object recognition,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 William Yicheng Zhu , Keren Ye , Junjie Ke , Jiahui Yu , Leonidas Guibas , Peyman Milanfar , Feng Yang

Current Large Vision Language Models (LVLMs) excel at many zero-shot tasks like image captioning, visual question answering and OCR. However, these same models suffer from poor performance at image classification tasks, underperforming…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Adhemar de Senneville , Xavier Bou , Jérémy Anger , Rafael Grompone , Gabriele Facciolo

Zero-shot anomaly detection (ZSAD) aims to detect anomalies without any target domain training samples, relying solely on external auxiliary data. Existing CLIP-based methods attempt to activate the model's ZSAD potential via handcrafted or…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Ziteng Yang , Jingzehua Xu , Yanshu Li , Zepeng Li , Yeqiang Wang , Xinghui Li

Vision-Language Models (VLMs), such as CLIP, exhibit strong image-text comprehension abilities, facilitating advances in several downstream tasks such as zero-shot image classification, image-text retrieval, and text-to-image generation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Le Zhang , Rabiul Awal , Aishwarya Agrawal

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

Detecting visual anomalies in diverse, multi-class real-world images is a significant challenge. We introduce \ours, a novel unsupervised multi-class visual anomaly detection framework. It integrates a Latent Diffusion Model (LDM) with a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Samet Hicsonmez , Abd El Rahman Shabayek , Djamila Aouada

Recent advances in visual-language models have shown remarkable zero-shot text-image matching ability that is transferable to downstream tasks such as object detection and segmentation. Adapting these models for object counting, however,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruixiang Jiang , Lingbo Liu , Changwen Chen

Pre-trained vision-language models (VLMs), such as CLIP, have demonstrated impressive zero-shot recognition capability, but still underperform in dense prediction tasks. Self-distillation recently is emerging as a promising approach for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Yunheng Li , Yuxuan Li , Quansheng Zeng , Wenhai Wang , Qibin Hou , Ming-Ming Cheng

The performance of vision-language models (VLMs), such as CLIP, in visual classification tasks, has been enhanced by leveraging semantic knowledge from large language models (LLMs), including GPT. Recent studies have shown that in zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Hankyeol Lee , Gawon Seo , Wonseok Choi , Geunyoung Jung , Kyungwoo Song , Jiyoung Jung

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

Anomaly Detection involves identifying deviations from normal data distributions and is critical in fields such as medical diagnostics and industrial defect detection. Traditional AD methods typically require the availability of normal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Alireza Salehi , Mohammadreza Salehi , Reshad Hosseini , Cees G. M. Snoek , Makoto Yamada , Mohammad Sabokrou