中文
相关论文

相关论文: Random Word Data Augmentation with CLIP for Zero-S…

200 篇论文

Recent advancements in pre-trained vision-language models like CLIP have enabled the task of open-vocabulary segmentation. CLIP demonstrates impressive zero-shot capabilities in various downstream tasks that require holistic image…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Sule Bai , Yong Liu , Yifei Han , Haoji Zhang , Yansong Tang , Jie Zhou , Jiwen Lu

Contrastive Language-Image Pre-training (CLIP) provides a foundation model by integrating natural language into visual concepts, enabling zero-shot recognition on downstream tasks. It is usually expected that satisfactory overall accuracy…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Jie-Jing Shao , Jiang-Xin Shi , Xiao-Wen Yang , Lan-Zhe Guo , Yu-Feng Li

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Fawaz Sammani , Nikos Deligiannis

Image recognition has recently witnessed a paradigm shift, where vision-language models are now used to perform few-shot classification based on textual prompts. Among these, the CLIP model has shown remarkable capabilities for zero-shot…

计算机视觉与模式识别 · 计算机科学 2023-07-27 Lorenzo Agnolucci , Alberto Baldrati , Francesco Todino , Federico Becattini , Marco Bertini , Alberto Del Bimbo

Classifiers built upon vision-language models such as CLIP have shown remarkable zero-shot performance across a broad range of image classification tasks. Prior work has studied different ways of automatically creating descriptor sets for…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Jan Hendrik Metzen , Piyapat Saranrittichai , Chaithanya Kumar Mummadi

Out-of-distribution (OOD) detection refers to training the model on an in-distribution (ID) dataset to classify whether the input images come from unknown classes. Considerable effort has been invested in designing various OOD detection…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Hualiang Wang , Yi Li , Huifeng Yao , Xiaomeng Li

Medical anomaly detection (MAD) and segmentation play a critical role in assisting clinical diagnosis by identifying abnormal regions in medical images and localizing pathological regions. Recent CLIP-based studies are promising for anomaly…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Thuy Truong Tran , Minh Kha Do , Phuc Nguyen Duy , Min Hun Lee

This paper describes our zero-shot approaches for the Visual Word Sense Disambiguation (VWSD) Task in English. Our preliminary study shows that the simple approach of matching candidate images with the phrase using CLIP suffers from the…

计算与语言 · 计算机科学 2023-07-13 Jie S. Li , Yow-Ting Shiue , Yong-Siang Shih , Jonas Geiping

CLIP (Contrastive Language-Image Pre-training) has attained great success in pattern recognition and computer vision. Transferring CLIP to downstream tasks (e.g. zero- or few-shot classification) is a hot topic in multimodal learning.…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Zhipeng Ye , Feng Jiang , Qiufeng Wang , Kaizhu Huang , Jiaqi Huang

Recent advances in zero-shot and few-shot classification heavily rely on the success of pre-trained vision-language models (VLMs) such as CLIP. Due to a shortage of large-scale datasets, training such models for event camera data remains…

计算机视觉与模式识别 · 计算机科学 2023-11-20 Ziyi Wu , Xudong Liu , Igor Gilitschenski

Recent studies are leveraging advancements in large language models (LLMs) trained on extensive internet-crawled text data to generate textual descriptions of downstream classes in CLIP-based zero-shot image classification. While most of…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Tong Liang , Jim Davis

Zero-shot anomaly detection (ZSAD) offers potential for identifying anomalies in medical imaging without task-specific training. In this paper, we evaluate CLIP-based models, originally developed for industrial tasks, on brain tumor…

计算机视觉与模式识别 · 计算机科学 2024-11-15 Aldo Marzullo , Marta Bianca Maria Ranzini

Zero-Shot Anomaly Detection (ZSAD) aims to detect anomalies in unseen domains without target-domain adaptation. Recent CLIP-based methods have shown promising performance by leveraging prompt learning and visual-text alignment. However,…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Xinyu Zhao , Qingyun Sun , Jiayi Luo , Jianxin Li

Despite its prevalent use in image-text matching tasks in a zero-shot manner, CLIP has been shown to be highly vulnerable to adversarial perturbations added onto images. Recent studies propose to finetune the vision encoder of CLIP with…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Songlong Xing , Zhengyu Zhao , Nicu Sebe

In industrial anomaly detection (IAD), accurately identifying defects amidst diverse anomalies and under varying imaging conditions remains a significant challenge. Traditional approaches often struggle with high false-positive rates,…

计算机视觉与模式识别 · 计算机科学 2025-03-04 Yurui Pan , Lidong Wang , Yuchao Chen , Wenbing Zhu , Bo Peng , Mingmin Chi

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Contrastive language-image pre-training (CLIP) has demonstrated remarkable zero-shot classification ability, namely image classification using novel text labels. Existing works have attempted to enhance CLIP by fine-tuning on downstream…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Seongha Eom , Namgyu Ho , Jaehoon Oh , Se-Young Yun

Vision-language models, such as CLIP, have shown impressive generalization capacities when using appropriate text descriptions. While optimizing prompts on downstream labeled data has proven effective in improving performance, these methods…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Benefiting from generalizability of vision-language models (VLMs) such as CLIP, many zero-/few-shot anomaly detection (AD) approaches have achieved impressive detection performance across various datasets. Nevertheless, they require…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Yi Zhang , Jiawen Zhu , Lele Fu , Guansong Pang

Few-shot anomaly detection methods can effectively address data collecting difficulty in industrial scenarios. Compared to 2D few-shot anomaly detection (2D-FSAD), 3D few-shot anomaly detection (3D-FSAD) is still an unexplored but essential…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Zuo Zuo , Jiahao Dong , Yao Wu , Yanyun Qu , Zongze Wu