English
Related papers

Related papers: Adapting Visual-Language Models for Generalizable …

200 papers

Benefiting from generalizability of vision-language models (VLMs) such as CLIP, many zero-/few-shot anomaly detection (AD) approaches have achieved impressive detection performance across various datasets. Nevertheless, they require…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yi Zhang , Jiawen Zhu , Lele Fu , Guansong Pang

The zero-shot performance of existing vision-language models (VLMs) such as CLIP is limited by the availability of large-scale, aligned image and text datasets in specific domains. In this work, we leverage two complementary sources of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Oindrila Saha , Grant Van Horn , Subhransu Maji

Few-shot anomaly detection methods can effectively address data collecting difficulty in industrial scenarios. Compared to 2D few-shot anomaly detection (2D-FSAD), 3D few-shot anomaly detection (3D-FSAD) is still an unexplored but essential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Zuo Zuo , Jiahao Dong , Yao Wu , Yanyun Qu , Zongze Wu

Medical anomaly detection (AD) is crucial for early clinical intervention, yet it faces challenges due to limited access to high-quality medical imaging data, caused by privacy concerns and data silos. Few-shot learning has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Kaiyu Guo , Tan Pan , Chen Jiang , Zijian Wang , Brian C. Lovell , Limei Han , Yuan Cheng , Mahsa Baktashmotlagh

Pretrained vision-language models (VLMs), e.g., CLIP, demonstrate impressive zero-shot capabilities on downstream tasks. Prior research highlights the crucial role of visual augmentation techniques, like random cropping, in alignment with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Lincan Cai , Jingxuan Kang , Shuang Li , Wenxuan Ma , Binhui Xie , Zhida Qin , Jian Liang

Contrastive Language-Image Pre-Training (CLIP) has enabled zero-shot classification in radiology, reducing reliance on manual annotations. However, conventional contrastive learning struggles with normal case detection due to its strict…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Junhyun Park , Chanyu Moon , Donghwan Lee , Kyungsu Kim , Minho Hwang

Zero-shot anomaly detection (ZSAD) offers potential for identifying anomalies in medical imaging without task-specific training. In this paper, we evaluate CLIP-based models, originally developed for industrial tasks, on brain tumor…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Aldo Marzullo , Marta Bianca Maria Ranzini

The recent CLIP-based methods have shown promising zero-shot and few-shot performance on image classification tasks. Existing approaches such as CoOp and Tip-Adapter only focus on high-level visual features that are fully aligned with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiaying Shi , Xuetong Xue , Shenghui Xu

Zero-shot medical image classification is a critical process in real-world scenarios where we have limited access to all possible diseases or large-scale annotated data. It involves computing similarity scores between a query medical image…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Jiaxiang Liu , Tianxiang Hu , Yan Zhang , Xiaotang Gai , Yang Feng , Zuozhu Liu

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Foundation models trained via vision-language pretraining have demonstrated strong zero-shot capabilities across diverse image domains, yet their application to volumetric medical imaging remains limited. We introduce MedCT-VLM: Medical CT…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Thuraya Alzubaidi , Farhad R. Nezami , Muzammil Behzad

Recently, zero-shot anomaly detection (ZSAD) has emerged as a pivotal paradigm for industrial inspection and medical diagnostics, detecting defects in novel objects without requiring any target-dataset samples during training. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jingyi Yuan , Chenqiang Gao , Pengyu Jie , Xuan Xia , Shangri Huang , Wanquan Liu

This paper considers zero-shot Anomaly Detection (AD), performing AD without reference images of the test objects. We propose a framework called CLIP-AD to leverage the zero-shot capabilities of the large vision-language model CLIP.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Xuhai Chen , Jiangning Zhang , Guanzhong Tian , Haoyang He , Wuhao Zhang , Yabiao Wang , Chengjie Wang , Yong Liu

Large-scale Pre-Training Vision-Language Model such as CLIP has demonstrated outstanding performance in zero-shot classification, e.g. achieving 76.3% top-1 accuracy on ImageNet without seeing any example, which leads to potential benefits…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Xuefeng Hu , Ke Zhang , Lu Xia , Albert Chen , Jiajia Luo , Yuyin Sun , Ken Wang , Nan Qiao , Xiao Zeng , Min Sun , Cheng-Hao Kuo , Ram Nevatia

Large pre-trained vision-language models, such as CLIP, have demonstrated state-of-the-art performance across a wide range of image classification tasks, without requiring retraining. Few-shot CLIP is competitive with existing specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Dominykas Seputis , Serghei Mihailov , Soham Chatterjee , Zehao Xiao

Adapting CLIP for anomaly detection on unseen objects has shown strong potential in a zero-shot manner. However, existing methods typically rely on a single textual space to align with visual semantics across diverse objects and domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Qihang Zhou , Binbin Gao , Guansong Pang , Xin Wang , Jiming Chen , Shibo He

Medical vision-language alignment through cross-modal contrastive learning shows promising performance in image-text matching tasks, such as retrieval and zero-shot classification. However, conventional cross-modal contrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Chenyu Lian , Hong-Yu Zhou , Dongyun Liang , Jing Qin , Liansheng Wang

Self-supervised vision-language models trained with contrastive objectives form the basis of current state-of-the-art methods in AI vision tasks. The success of these models is a direct consequence of the huge web-scale datasets used to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Victor Akinwande , Mohammad Sadegh Norouzzadeh , Devin Willmott , Anna Bair , Madan Ravi Ganesh , J. Zico Kolter

Ultrasound foundation models have achieved strong performance on structured prediction tasks but remain exclusively vision-based, limiting zero-shot and few-shot transfer to novel tasks where task-specific annotation is scarce. We address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zhuoyang Lyu , Yiyang Zhang , Tongxin Wang , Ruirui Lan

Zero-shot anomaly detection (ZSAD) identifies anomalies without needing training samples from the target dataset, essential for scenarios with privacy concerns or limited data. Vision-language models like CLIP show potential in ZSAD but…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chengyuan Li , Suyang Zhou , Jieping Kong , Lei Qi , Hui Xue