English
Related papers

Related papers: Anchor-based Robust Finetuning of Vision-Language …

200 papers

We present a novel vision-language prompt learning approach for few-shot out-of-distribution (OOD) detection. Few-shot OOD detection aims to detect OOD images from classes that are unseen during training using only a few labeled…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Contrastive pre-trained vision-language models, such as CLIP, demonstrate strong generalization abilities in zero-shot classification by leveraging embeddings extracted from image and text encoders. This paper aims to robustly fine-tune…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Satoshi Suzuki , Shin'ya Yamaguchi , Shoichiro Takeda , Taiga Yamane , Naoki Makishima , Naotaka Kawata , Mana Ihori , Tomohiro Tanaka , Shota Orihashi , Ryo Masumura

Detecting out-of-distribution (OOD) inputs is crucial for the safe deployment of natural language processing (NLP) models. Though existing methods, especially those based on the statistics in the feature space of fine-tuned pre-trained…

Computation and Language · Computer Science 2023-01-31 Sishuo Chen , Wenkai Yang , Xiaohan Bi , Xu Sun

Contrastive Language-Image Pretraining (CLIP) model has exhibited remarkable efficacy in establishing cross-modal connections between texts and images, yielding impressive performance across a broad spectrum of downstream applications…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yi Zhang , Ce Zhang , Ke Yu , Yushun Tang , Zhihai He

Universal visual anomaly detection aims to identify anomalies from novel or unseen vision domains without additional fine-tuning, which is critical in open scenarios. Recent studies have demonstrated that pre-trained vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bin-Bin Gao , Yue Zhou , Jiangtao Yan , Yuezhi Cai , Weixi Zhang , Meng Wang , Jun Liu , Yong Liu , Lei Wang , Chengjie Wang

Large-scale contrastive vision-language pre-trained models provide the zero-shot model achieving competitive performance across a range of image classification tasks without requiring training on downstream data. Recent works have confirmed…

Machine Learning · Computer Science 2024-04-02 Giung Nam , Byeongho Heo , Juho Lee

We propose a generalized method for boosting the generalization ability of pre-trained vision-language models (VLMs) while fine-tuning on downstream few-shot tasks. The idea is realized by exploiting out-of-distribution (OOD) detection to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Kun Ding , Haojian Zhang , Qiang Yu , Ying Wang , Shiming Xiang , Chunhong Pan

Visual anomaly classification and segmentation are vital for automating industrial quality inspection. The focus of prior research in the field has been on training custom models for each quality inspection task, which requires…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jongheon Jeong , Yang Zou , Taewan Kim , Dongqing Zhang , Avinash Ravichandran , Onkar Dabeer

Out-of-distribution (OOD) detection is committed to delineating the classification boundaries between in-distribution (ID) and OOD images. Recent advances in vision-language models (VLMs) have demonstrated remarkable OOD detection…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixia He , Chen Zhao , Minglai Shao , Xintao Wu , Xujiang Zhao , Dong Li , Qin Tian , Linlin Yu

Vision-language models (VLMs) have demonstrated exceptional generalization capabilities for downstream tasks. Due to its efficiency, prompt learning has gradually become a more effective and efficient method for transferring VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chenhao Ding , Xinyuan Gao , Songlin Dong , Jizhou Han , Qiang Wang , Zhengdong Zhou , Yuhang He , Yihong Gong

Large-scale vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization, but adapting them to downstream tasks typically requires costly labeled data. Existing unsupervised self-training methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Qian-Wei Wang , Guanghao Meng , Ren Cai , Yaguang Song , Shu-Tao Xia

Detecting out-of-distribution (OOD) samples is essential when deploying machine learning models in open-world scenarios. Zero-shot OOD detection, requiring no training on in-distribution (ID) data, has been possible with the advent of…

Machine Learning · Computer Science 2024-06-04 Chentao Cao , Zhun Zhong , Zhanke Zhou , Yang Liu , Tongliang Liu , Bo Han

Vision-Language Models (VLMs) such as CLIP demonstrate strong zero-shot generalization, but their performance significantly degrades in cross-domain scenarios with scarce target-domain training data (Cross-Domain Few-Shot Learning, CDFSL).…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Shuai Yi , Yixiong Zou , Yuhua Li , Ruixuan Li

Recent approaches have shown that training deep neural networks directly on large-scale image-text pair collections enables zero-shot transfer on various recognition tasks. One central issue is how this can be generalized to object…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Johnathan Xie , Shuai Zheng

Fine-tuned pre-trained language models can suffer from severe miscalibration for both in-distribution and out-of-distribution (OOD) data due to over-parameterization. To mitigate this issue, we propose a regularized fine-tuning method. Our…

Computation and Language · Computer Science 2020-10-23 Lingkai Kong , Haoming Jiang , Yuchen Zhuang , Jie Lyu , Tuo Zhao , Chao Zhang

Learning generalized representations from limited training samples is crucial for applying deep neural networks in low-resource scenarios. Recently, methods based on Contrastive Language-Image Pre-training (CLIP) have exhibited promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Yao Zhu , Yuefeng Chen , Wei Wang , Xiaofeng Mao , Xiu Yan , Yue Wang , Zhigang Li , Wang lu , Jindong Wang , Xiangyang Ji

Open-vocabulary semantic segmentation aims to segment an image into semantic regions according to text descriptions, which may not have been seen during training. Recent two-stage methods first generate class-agnostic mask proposals and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Feng Liang , Bichen Wu , Xiaoliang Dai , Kunpeng Li , Yinan Zhao , Hang Zhang , Peizhao Zhang , Peter Vajda , Diana Marculescu

Vision-language models (VLMs) struggle in open-world applications, where out-of-distribution (OOD) concepts often trigger cross-modal alignment collapse and severely degrade zero-shot performance. We identify the root cause as modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jensen Zhang , Ningyuan Liu , Keze Wang

Large code datasets have become increasingly accessible for pre-training source code models. However, for the fine-tuning phase, obtaining representative training data that fully covers the code distribution for specific downstream tasks…

Software Engineering · Computer Science 2023-10-31 Hossein Hajipour , Ning Yu , Cristian-Alexandru Staicu , Mario Fritz

Contrastive language image pre-training (CLIP) is an essential component of building modern vision-language foundation models. While CLIP demonstrates remarkable zero-shot performance on downstream tasks, the multi-modal feature spaces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Shin'ya Yamaguchi , Dewei Feng , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa