English
Related papers

Related papers: Bootstrap Fine-Grained Vision-Language Alignment f…

200 papers

Recent advancements in pre-trained vision-language models like CLIP have enabled the task of open-vocabulary segmentation. CLIP demonstrates impressive zero-shot capabilities in various downstream tasks that require holistic image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sule Bai , Yong Liu , Yifei Han , Haoji Zhang , Yansong Tang , Jie Zhou , Jiwen Lu

CLIP achieves strong zero-shot image-text retrieval by aligning global vision and text representations, yet it falls behind on fine-grained tasks even when fine-tuned on long, detailed captions. In this work, we propose $\beta$-CLIP, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Fatimah Zohra , Chen Zhao , Hani Itani , Bernard Ghanem

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

In unsupervised adaptation for vision-language models such as CLIP, pseudo-labels derived from zero-shot predictions often exhibit significant noise, particularly under domain shifts or in visually complex scenarios. Conventional…

Machine Learning · Computer Science 2025-07-31 Eman Ali , Chetan Arora , Muhammad Haris Khan

Zero-shot anomaly detection (ZSAD) targets the identification of anomalies within images from arbitrary novel categories. This study introduces AdaCLIP for the ZSAD task, leveraging a pre-trained vision-language model (VLM), CLIP. AdaCLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Yunkang Cao , Jiangning Zhang , Luca Frittoli , Yuqi Cheng , Weiming Shen , Giacomo Boracchi

Image captioning aims at generating descriptive and meaningful textual descriptions of images, enabling a broad range of vision-language applications. Prior works have demonstrated that harnessing the power of Contrastive Image Language…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Longtian Qiu , Shan Ning , Xuming He

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

CLIP (Contrastive Language-Image Pre-Training) has shown remarkable zero-shot transfer capabilities in cross-modal correlation tasks such as visual classification and image retrieval. However, its performance in cross-modal generation tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Junyang Wang , Yi Zhang , Ming Yan , Ji Zhang , Jitao Sang

Recently, large-scale vision-language models such as CLIP have demonstrated immense potential in zero-shot anomaly segmentation (ZSAS) task, utilizing a unified model to directly detect anomalies on any unseen product with painstakingly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhen Qu , Xian Tao , Mukesh Prasad , Fei Shen , Zhengtao Zhang , Xinyi Gong , Guiguang Ding

Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chaoqin Huang , Aofan Jiang , Jinghao Feng , Ya Zhang , Xinchao Wang , Yanfeng Wang

Unsupervised adaptation of CLIP-based vision-language models (VLMs) for fine-grained image classification requires sensitivity to microscopic local cues. While CLIP exhibits strong zero-shot transfer, its reliance on coarse global features…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Sathira Silva , Eman Ali , Chetan Arora , Muhammad Haris Khan

Capitalizing on vast amount of image-text data, large-scale vision-language pre-training has demonstrated remarkable zero-shot capabilities and has been utilized in several applications. However, models trained on general everyday…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Umair Nawaz , Muhammad Awais , Hanan Gani , Muzammal Naseer , Fahad Khan , Salman Khan , Rao Muhammad Anwer

Universal visual anomaly detection aims to identify anomalies from novel or unseen vision domains without additional fine-tuning, which is critical in open scenarios. Recent studies have demonstrated that pre-trained vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bin-Bin Gao , Yue Zhou , Jiangtao Yan , Yuezhi Cai , Weixi Zhang , Meng Wang , Jun Liu , Yong Liu , Lei Wang , Chengjie Wang

Pre-trained vision-language models such as contrastive language-image pre-training (CLIP) have demonstrated a remarkable generalizability, which has enabled a wide range of applications represented by zero-shot classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Kazuki Adachi , Shin'ya Yamaguchi , Tomoki Hamagami

Deep Learning (DL) is undergoing a paradigm shift with the emergence of foundation models. In this work, we focus on Contrastive Language-Image Pre-training (CLIP), a Vision-Language foundation model that achieves high accuracy across…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Angelos Zavras , Dimitrios Michail , Begüm Demir , Ioannis Papoutsis

Although deep learning models have shown impressive performance on supervised learning tasks, they often struggle to generalize well when the training (source) and test (target) domains differ. Unsupervised domain adaptation (DA) has…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mainak Singha , Harsh Pal , Ankit Jha , Biplab Banerjee

Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP is quite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yangguang Li , Feng Liang , Lichen Zhao , Yufeng Cui , Wanli Ouyang , Jing Shao , Fengwei Yu , Junjie Yan

Large-scale foundation models like CLIP have shown strong zero-shot generalization but struggle with domain shifts, limiting their adaptability. In our work, we introduce \textsc{StyLIP}, a novel domain-agnostic prompt learning strategy for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Ankit Jha

Anomaly Detection involves identifying deviations from normal data distributions and is critical in fields such as medical diagnostics and industrial defect detection. Traditional AD methods typically require the availability of normal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Alireza Salehi , Mohammadreza Salehi , Reshad Hosseini , Cees G. M. Snoek , Makoto Yamada , Mohammad Sabokrou

Recently, zero-shot anomaly detection (ZSAD) has emerged as a pivotal paradigm for industrial inspection and medical diagnostics, detecting defects in novel objects without requiring any target-dataset samples during training. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jingyi Yuan , Chenqiang Gao , Pengyu Jie , Xuan Xia , Shangri Huang , Wanquan Liu