English
Related papers

Related papers: Bridge Feature Matching and Cross-Modal Alignment …

200 papers

Recently, foundational models such as CLIP and SAM have shown promising performance for the task of Zero-Shot Anomaly Segmentation (ZSAS). However, either CLIP-based or SAM-based ZSAS methods still suffer from non-negligible key drawbacks:…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Shengze Li , Jianjian Cao , Peng Ye , Yuhan Ding , Chongjun Tu , Tao Chen

Fine-grained anomaly detection is crucial in industrial and medical applications, but labeled anomalies are often scarce, making zero-shot detection challenging. While vision-language models like CLIP offer promising solutions, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ming Hu , Yongsheng Huo , Mingyu Dou , Jianfu Yin , Peng Zhao , Yao Wang , Cong Hu , Bingliang Hu , Quan Wang

Contrastive Language-Image Pre-training (CLIP) models have shown promising performance on zero-shot visual recognition tasks by learning visual representations under natural language supervision. Recent studies attempt the use of CLIP to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Hanqiu Deng , Zhaoxiang Zhang , Jinan Bao , Xingyu Li

Automatic image anomaly detection is important for quality inspection in the manufacturing industry. The usual unsupervised anomaly detection approach is to train a model for each object class using a dataset of normal samples. However, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yuanwei Li , Elizaveta Ivanova , Martins Bruveris

Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chaoqin Huang , Aofan Jiang , Jinghao Feng , Ya Zhang , Xinchao Wang , Yanfeng Wang

Few-shot anomaly detection methods can effectively address data collecting difficulty in industrial scenarios. Compared to 2D few-shot anomaly detection (2D-FSAD), 3D few-shot anomaly detection (3D-FSAD) is still an unexplored but essential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Zuo Zuo , Jiahao Dong , Yao Wu , Yanyun Qu , Zongze Wu

Zero-shot anomaly detection (ZSAD) is crucial for detecting anomalous patterns in target datasets without using training samples, specifically in scenarios where there are distributional differences between the target domain and training…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Jiyul Ham , Yonggon Jung , Jun-Geol Baek

Zero-shot learning (ZSL) aims to recognize unseen classes by leveraging semantic information from seen classes, but most existing methods assume accurate class labels for training instances. However, in real-world scenarios, noise and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Jinfu Fan , Jiangnan Li , Xiaowen Yan , Xiaohui Zhong , Wenpeng Lu , Linqing Huang

The recent CLIP-based methods have shown promising zero-shot and few-shot performance on image classification tasks. Existing approaches such as CoOp and Tip-Adapter only focus on high-level visual features that are fully aligned with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiaying Shi , Xuetong Xue , Shenghui Xu

Recently, large-scale vision-language models such as CLIP have demonstrated immense potential in zero-shot anomaly segmentation (ZSAS) task, utilizing a unified model to directly detect anomalies on any unseen product with painstakingly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhen Qu , Xian Tao , Mukesh Prasad , Fei Shen , Zhengtao Zhang , Xinyi Gong , Guiguang Ding

Vision-Language Models (VLMs), particularly CLIP, have revolutionized anomaly detection by enabling zero-shot and few-shot defect identification without extensive labeled datasets. By learning aligned representations of images and text,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Mohit Kakda , Mirudula Shri Muthukumaran , Uttapreksha Patel , Lawrence Swaminathan Xavier Prince

With the increasing adoption of video anomaly detection in intelligent surveillance domains, conventional visual-based detection approaches often struggle with information insufficiency and high false-positive rates in complex environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peng Wu , Wanshun Su , Guansong Pang , Yujia Sun , Qingsen Yan , Peng Wang , Yanning Zhang

Enhancing the alignment between text and image features in the CLIP model is a critical challenge in zero-shot industrial anomaly detection tasks. Recent studies predominantly utilize specific category prompts during pretraining, which can…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Yanning Hou , Yanran Ruan , Junfa Li , Shanshan Wang , Jianfeng Qiu , Ke Xu

Anomaly Detection involves identifying deviations from normal data distributions and is critical in fields such as medical diagnostics and industrial defect detection. Traditional AD methods typically require the availability of normal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Alireza Salehi , Mohammadreza Salehi , Reshad Hosseini , Cees G. M. Snoek , Makoto Yamada , Mohammad Sabokrou

Pre-trained vision-language models, e.g., CLIP, have been successfully applied to zero-shot semantic segmentation. Existing CLIP-based approaches primarily utilize visual features from the last layer to align with text embeddings, while…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yunheng Li , ZhongYu Li , Quansheng Zeng , Qibin Hou , Ming-Ming Cheng

Zero-shot detection (ZSD), i.e., detection on classes not seen during training, is essential for real world detection use-cases, but remains a difficult task. Recent research attempts ZSD with detection models that output embeddings instead…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Katharina Kornmeier , Ulla Scheler , Pascal Herrmann

Large vision-language representation learning models like CLIP have demonstrated impressive performance for zero-shot transfer to downstream tasks while largely benefiting from inter-modal (image-text) alignment via contrastive objectives.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Muhammad Waleed Gondal , Jochen Gast , Inigo Alonso Ruiz , Richard Droste , Tommaso Macri , Suren Kumar , Luitpold Staudigl

Zero-shot anomaly detection (ZSAD) requires detecting and localizing anomalies without access to target-class anomaly samples. Mainstream methods rely on vision-language models (VLMs) such as CLIP: they build hand-crafted or learned prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanning Hou , Peiyuan Li , Zirui Liu , Yitong Wang , Yanran Ruan , Jianfeng Qiu , Ke Xu

Recently, vision-language models (e.g. CLIP) have demonstrated remarkable performance in zero-shot anomaly detection (ZSAD). By leveraging auxiliary data during training, these models can directly perform cross-category anomaly detection on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Zhen Qu , Xian Tao , Xinyi Gong , Shichen Qu , Qiyu Chen , Zhengtao Zhang , Xingang Wang , Guiguang Ding

Vision-language models such as CLIP are capable of mapping the different modality data into a unified feature space, enabling zero/few-shot inference by measuring the similarity of given images and texts. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang