English
Related papers

Related papers: TokenCLIP: Token-wise Prompt Learning for Zero-sho…

200 papers

Contrastive language-image pretraining (CLIP) using image-text pairs has achieved impressive results on image classification in both zero-shot and transfer learning settings. However, we show that directly applying such models to recognize…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Yiwu Zhong , Jianwei Yang , Pengchuan Zhang , Chunyuan Li , Noel Codella , Liunian Harold Li , Luowei Zhou , Xiyang Dai , Lu Yuan , Yin Li , Jianfeng Gao

Recent advancements in large-scale visual-language pre-trained models have led to significant progress in zero-/few-shot anomaly detection within natural image domains. However, the substantial domain divergence between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Chaoqin Huang , Aofan Jiang , Jinghao Feng , Ya Zhang , Xinchao Wang , Yanfeng Wang

Contrastive Language-Image Pre-training (CLIP) has recently shown great promise in pixel-level zero-shot learning tasks. However, existing approaches utilizing CLIP's text and patch embeddings to generate semantic masks often misidentify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jingyao Li , Pengguang Chen , Shengju Qian , Shu Liu , Jiaya Jia

Image Anomaly Detection has been a challenging task in Computer Vision field. The advent of Vision-Language models, particularly the rise of CLIP-based frameworks, has opened new avenues for zero-shot anomaly detection. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Zhaoxiang Zhang , Hanqiu Deng , Jinan Bao , Xingyu Li

Vision-language models such as CLIP have shown impressive capabilities in aligning images and text, but they often struggle with lengthy and detailed text descriptions due to pre-training on short and concise captions. We present FAST-GOAL…

Artificial Intelligence · Computer Science 2026-05-27 Hyungyu Choi , Young Kyun Jang , Chanho Eom

Dense visual prediction tasks have been constrained by their reliance on predefined categories, limiting their applicability in real-world scenarios where visual concepts are unbounded. While Vision-Language Models (VLMs) like CLIP have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Junjie Wang , Bin Chen , Yulin Li , Bin Kang , Yichi Chen , Zhuotao Tian

Anomaly Detection involves identifying deviations from normal data distributions and is critical in fields such as medical diagnostics and industrial defect detection. Traditional AD methods typically require the availability of normal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Alireza Salehi , Mohammadreza Salehi , Reshad Hosseini , Cees G. M. Snoek , Makoto Yamada , Mohammad Sabokrou

Contrastive Language-Image Pre-training (CLIP) delivers strong cross modal generalization by aligning images and texts in a shared embedding space, yet it persistently fails at compositional reasoning over objects, attributes, and relations…

Machine Learning · Computer Science 2025-10-31 Ziliang Chen , Tianang Xiao , Jusheng Zhang , Yongsen Zheng , Xipeng Chen

Anomaly detection usually assumes that abnormality is an intrinsic property of an observation. A defect is a defect, and a rare object is rare, regardless of where it appears. Many real-world anomalies do not work this way. A runner on a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Shashank Mishra , Didier Stricker , Jason Rambach

An innovative few-shot anomaly detection approach is presented, leveraging the pre-trained CLIP model for medical data, and adapting it for both image-level anomaly classification (AC) and pixel-level anomaly segmentation (AS). A…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Mahshid Shiri , Cigdem Beyan , Vittorio Murino

With the increasing adoption of video anomaly detection in intelligent surveillance domains, conventional visual-based detection approaches often struggle with information insufficiency and high false-positive rates in complex environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Peng Wu , Wanshun Su , Guansong Pang , Yujia Sun , Qingsen Yan , Peng Wang , Yanning Zhang

Visual anomaly classification and segmentation are vital for automating industrial quality inspection. The focus of prior research in the field has been on training custom models for each quality inspection task, which requires…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jongheon Jeong , Yang Zou , Taewan Kim , Dongqing Zhang , Avinash Ravichandran , Onkar Dabeer

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

Most existing methods in vision-language retrieval match two modalities by either comparing their global feature vectors which misses sufficient information and lacks interpretability, detecting objects in images or videos and aligning the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xiaohan Zou , Changqiao Wu , Lele Cheng , Zhongyuan Wang

Despite the recent success of image-text contrastive models like CLIP and SigLIP, these models often struggle with vision-centric tasks that demand high-fidelity image understanding, such as counting, depth estimation, and fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Zineng Tang , Long Lian , Seun Eisape , XuDong Wang , Roei Herzig , Adam Yala , Alane Suhr , Trevor Darrell , David M. Chan

Recently, large-scale vision-language models such as CLIP have demonstrated immense potential in zero-shot anomaly segmentation (ZSAS) task, utilizing a unified model to directly detect anomalies on any unseen product with painstakingly…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Zhen Qu , Xian Tao , Mukesh Prasad , Fei Shen , Zhengtao Zhang , Xinyi Gong , Guiguang Ding

Anomaly detection identifies departures from expected behavior in safety-critical settings. When target-domain normal data are unavailable, zero-shot anomaly detection (ZSAD) leverages vision-language models (VLMs). However, CLIP's coarse…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Alireza Salehi , Ehsan Karami , Sepehr Noey , Sahand Noey , Makoto Yamada , Reshad Hosseini , Mohammad Sabokrou

Recent advances in brain-inspired artificial intelligence have sought to align neural signals with visual semantics using multimodal models such as CLIP. However, existing methods often treat CLIP as a static feature extractor, overlooking…

Information Retrieval · Computer Science 2025-11-13 Jiyuan Wang , Li Zhang , Haipeng Lin , Qile Liu , Gan Huang , Ziyu Li , Zhen Liang , Xia Wu

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

The application of zero-shot learning in computer vision has been revolutionized by the use of image-text matching models. The most notable example, CLIP, has been widely used for both zero-shot classification and guiding generative models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Roni Paiss , Hila Chefer , Lior Wolf