English
Related papers

Related papers: Bridge Feature Matching and Cross-Modal Alignment …

200 papers

Zero-shot anomaly detection (ZSAD) often leverages pretrained vision or vision-language models, but many existing methods use prompt learning or complex modeling to fit the data distribution, resulting in high training or inference cost and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chaoran Xu , Chengkan Lv , Qiyu Chen , Feng Zhang , Zhengtao Zhang

Contrastive Language-Image Pretraining (CLIP) has gained popularity for its remarkable zero-shot capacity. Recent research has focused on developing efficient fine-tuning methods, such as prompt learning and adapter, to enhance CLIP's…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Zhengbo Wang , Jian Liang , Lijun Sheng , Ran He , Zilei Wang , Tieniu Tan

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Few-shot learning (FSL) often requires effective adaptation of models using limited labeled data. However, most existing FSL methods rely on entangled representations, requiring the model to implicitly recover the unmixing process to obtain…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tianjiao Jiang , Zhen Zhang , Yuhang Liu , Javen Qinfeng Shi

Adapting CLIP for anomaly detection on unseen objects has shown strong potential in a zero-shot manner. However, existing methods typically rely on a single textual space to align with visual semantics across diverse objects and domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihang Zhou , Binbin Gao , Guansong Pang , Xin Wang , Jiming Chen , Shibo He

In industrial anomaly detection (IAD), accurately identifying defects amidst diverse anomalies and under varying imaging conditions remains a significant challenge. Traditional approaches often struggle with high false-positive rates,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Yurui Pan , Lidong Wang , Yuchao Chen , Wenbing Zhu , Bo Peng , Mingmin Chi

Contrastive Language-Image Pre-Training (CLIP) has enabled zero-shot classification in radiology, reducing reliance on manual annotations. However, conventional contrastive learning struggles with normal case detection due to its strict…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Junhyun Park , Chanyu Moon , Donghwan Lee , Kyungsu Kim , Minho Hwang

Zero-shot anomaly detection (ZSAD) enables identifying and localizing defects in unseen categories by relying solely on generalizable features rather than requiring any labeled examples of anomalies. However, existing ZSAD methods, whether…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Zihan Wang , Samira Ebrahimi Kahou , Narges Armanfard

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations using large-scale image-text pairs. It shows impressive performance on downstream tasks by zero-shot knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Renrui Zhang , Zhang Wei , Rongyao Fang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

Pre-trained Vision-Language Models (VLMs) struggle with Zero-Shot Anomaly Detection (ZSAD) due to a critical adaptation gap: they lack the local inductive biases required for dense prediction and employ inflexible feature fusion paradigms.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ke Ma , Jun Long , Hongxiao Fei , Liujie Hua , Zhen Dai , Yueyi Luo

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Fawaz Sammani , Nikos Deligiannis

Although open-vocabulary classification models like Contrastive Language Image Pretraining (CLIP) have demonstrated strong zero-shot learning capabilities, their robustness to common image corruptions remains poorly understood. Through…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sarthak Kumar Maharana , Baoming Zhang , Leonid Karlinsky , Rogerio Feris , Yunhui Guo

Zero-shot anomaly segmentation using pre-trained foundation models is a promising approach that enables effective algorithms without expensive, domain-specific training or fine-tuning. Ensuring that these methods work across various…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Kevin Stangl , Marius Arvinte , Weilin Xu , Cory Cornelius

Pretrained vision-language models, such as CLIP, show promising zero-shot performance across a wide variety of datasets. For closed-set classification tasks, however, there is an inherent limitation: CLIP image encoders are typically…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Piyapat Saranrittichai , Mauricio Munoz , Volker Fischer , Chaithanya Kumar Mummadi

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations by using large-scale contrastive image-text pairs. It shows impressive performance on zero-shot knowledge transfer to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Renrui Zhang , Rongyao Fang , Wei Zhang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

Transductive inference has been widely investigated in few-shot image classification, but completely overlooked in the recent, fast growing literature on adapting vision-langage models like CLIP. This paper addresses the transductive…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Ségolène Martin , Yunshi Huang , Fereshteh Shakeri , Jean-Christophe Pesquet , Ismail Ben Ayed

Zero-shot learning has been extensively investigated in the broader field of visual recognition, attracting significant interest recently. However, the current work on zero-shot learning in document image classification remains scarce. The…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Sankalp Sinha , Muhammad Saif Ullah Khan , Talha Uddin Sheikh , Didier Stricker , Muhammad Zeshan Afzal

Multimodal encoders like CLIP excel in tasks such as zero-shot image classification and cross-modal retrieval. However, they require excessive training data. We propose canonical similarity analysis (CSA), which uses two unimodal encoders…

Machine Learning · Computer Science 2025-03-17 Po-han Li , Sandeep P. Chinchali , Ufuk Topcu

The recent contrastive language-image pre-training (CLIP) model has shown great success in a wide range of image-level tasks, revealing remarkable ability for learning powerful visual representations with rich semantics. An open and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Peng Wu , Xuerong Zhou , Guansong Pang , Lingru Zhou , Qingsen Yan , Peng Wang , Yanning Zhang