English
Related papers

Related papers: Adapting Visual-Language Models for Generalizable …

200 papers

Pre-trained Vision-Language Models (VLMs), such as CLIP, have shown enhanced performance across a range of tasks that involve the integration of visual and linguistic modalities. When CLIP is used for depth estimation tasks, the patches,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Xueting Hu , Ce Zhang , Yi Zhang , Bowen Hai , Ke Yu , Zhihai He

Vision-language models such as CLIP are pretrained on large volumes of internet sourced image and text pairs, and have been shown to sometimes exhibit impressive zero- and low-shot image classification performance. However, due to their…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Omiros Pantazis , Gabriel Brostow , Kate Jones , Oisin Mac Aodha

Zero-shot anomaly detection aims to detect and localise abnormal regions in the image without access to any in-domain training images. While recent approaches leverage vision-language models (VLMs), such as CLIP, to transfer high-level…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Matic Fučka , Vitjan Zavrtanik , Danijel Skočaj

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

Fine-grained anomaly detection is crucial in industrial and medical applications, but labeled anomalies are often scarce, making zero-shot detection challenging. While vision-language models like CLIP offer promising solutions, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ming Hu , Yongsheng Huo , Mingyu Dou , Jianfu Yin , Peng Zhao , Yao Wang , Cong Hu , Bingliang Hu , Quan Wang

The increasing digitization of medical imaging enables machine learning based improvements in detecting, visualizing and segmenting lesions, easing the workload for medical experts. However, supervised machine learning requires reliable…

Image and Video Processing · Electrical Eng. & Systems 2024-12-03 Maximilian E. Tschuchnig , Michael Gadermayr

Medical image classification plays a crucial role in clinical decision-making, yet most models are constrained to a fixed set of predefined classes, limiting their adaptability to new conditions. Contrastive Language-Image Pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Stefan Denner , Markus Bujotzek , Dimitrios Bounias , David Zimmerer , Raphael Stock , Klaus Maier-Hein

With the advent of vision-language models (e.g., CLIP) in zero- and few-shot settings, CLIP has been widely applied to zero-shot anomaly detection (ZSAD) in recent research, where the rare classes are essential and expected in many…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Yuhu Bai , Jiangning Zhang , Yunkang Cao , Guangyuan Lu , Qingdong He , Xiangtai Li , Guanzhong Tian

Recent adaptations can boost the low-shot capability of Contrastive Vision-Language Pre-training (CLIP) by effectively facilitating knowledge transfer. However, these adaptation methods are usually operated on the global view of an input…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jinda Lu , Shuo Wang , Yanbin Hao , Haifeng Liu , Xiang Wang , Meng Wang

Large vision-language representation learning models like CLIP have demonstrated impressive performance for zero-shot transfer to downstream tasks while largely benefiting from inter-modal (image-text) alignment via contrastive objectives.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Muhammad Waleed Gondal , Jochen Gast , Inigo Alonso Ruiz , Richard Droste , Tommaso Macri , Suren Kumar , Luitpold Staudigl

Deep neural networks are increasingly used in medical imaging for tasks such as pathological classification, but they face challenges due to the scarcity of high-quality, expert-labeled training data. Recent efforts have utilized…

Machine Learning · Computer Science 2024-10-14 Jongseong Jang , Daeun Kyung , Seung Hwan Kim , Honglak Lee , Kyunghoon Bae , Edward Choi

Recent work has shown that label-efficient few-shot learning through self-supervision can achieve promising medical image segmentation results. However, few-shot segmentation models typically rely on prototype representations of the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Stine Hansen , Srishti Gautam , Robert Jenssen , Michael Kampffmeyer

Pre-trained Vision-Language Models (VLMs), like CLIP, exhibit strong generalization ability to downstream tasks but struggle in few-shot scenarios. Existing prompting techniques primarily focus on global text and image representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xin Liu , Jiamin Wu , and Wenfei Yang , Xu Zhou , Tianzhu Zhang

Anomaly Detection involves identifying deviations from normal data distributions and is critical in fields such as medical diagnostics and industrial defect detection. Traditional AD methods typically require the availability of normal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Alireza Salehi , Mohammadreza Salehi , Reshad Hosseini , Cees G. M. Snoek , Makoto Yamada , Mohammad Sabokrou

Recent vision language models (VLMs) like CLIP have demonstrated impressive anomaly detection performance under significant distribution shift by utilizing high-level semantic information through text prompts. However, these models often…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Nadeem Nazer , Hongkuan Zhou , Lavdim Halilaj , Ylli Sadikaj , Steffen Staab

Contrastive Language-Image Pre-training (CLIP) models have shown promising performance on zero-shot visual recognition tasks by learning visual representations under natural language supervision. Recent studies attempt the use of CLIP to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Hanqiu Deng , Zhaoxiang Zhang , Jinan Bao , Xingyu Li

Zero-shot anomaly detection aims to identify defects in unseen categories without target-specific training. Existing methods usually apply the same feature transformation to all samples, treating normal and anomalous data uniformly despite…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Muhammad Aqeel , Maham Nazir , Uzair Khan , Marco Cristani , Francesco Setti

Anomaly detection has many important applications, such as monitoring industrial equipment. Despite recent advances in anomaly detection with deep-learning methods, it is unclear how existing solutions would perform under…

Sound · Computer Science 2022-04-06 Bingqing Chen , Luca Bondi , Samarjit Das

A pre-trained visual-language model, contrastive language-image pre-training (CLIP), successfully accomplishes various downstream tasks with text prompts, such as finding images or localizing regions within the image. Despite CLIP's strong…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 YeongHyeon Park , Myung Jin Kim , Hyeong Seok Kim

The success of CLIP-like vision-language models (VLMs) on natural images has inspired medical counterparts, yet existing approaches largely fall into two extremes: specialist models trained on single-domain data, which capture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 M. Arda Aydın , Melih B. Yilmaz , Aykut Koç , Tolga Çukur