English
Related papers

Related papers: Dual-Image Enhanced CLIP for Zero-Shot Anomaly Det…

200 papers

We present Distill CLIP (DCLIP), a fine-tuned variant of the CLIP model that enhances multimodal image-text retrieval while preserving the original model's strong zero-shot classification capabilities. CLIP models are typically constrained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniel Csizmadia , Andrei Codreanu , Victor Sim , Vighnesh Prabhu , Michael Lu , Kevin Zhu , Sean O'Brien , Vasu Sharma

Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on existing evaluations of overall classification robustness, this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Weijie Tu , Weijian Deng , Tom Gedeon

Contrastive Language-Image Pretraining (CLIP) has been widely used in vision tasks. Notably, CLIP has demonstrated promising performance in few-shot learning (FSL). However, existing CLIP-based methods in training-free FSL (i.e., without…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yayuan Li , Jintao Guo , Lei Qi , Wenbin Li , Yinghuan Shi

The Visual Language Model, known for its robust cross-modal capabilities, has been extensively applied in various computer vision tasks. In this paper, we explore the use of CLIP (Contrastive Language-Image Pretraining), a vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Huazhong Zhao , Lei Qi , Xin Geng

Vision-language models such as CLIP have shown impressive capabilities in aligning images and text, but they often struggle with lengthy and detailed text descriptions due to pre-training on short and concise captions. We present FAST-GOAL…

Artificial Intelligence · Computer Science 2026-05-27 Hyungyu Choi , Young Kyun Jang , Chanho Eom

In the recent years, the dual-encoder vision-language models (\eg CLIP) have achieved remarkable text-to-image retrieval performance. However, we discover that these models usually results in very different retrievals for a pair of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jiacheng Cheng , Hijung Valentina Shin , Nuno Vasconcelos , Bryan Russell , Fabian Caba Heilbron

Image enhancement is a significant research area in the fields of computer vision and image processing. In recent years, many learning-based methods for image enhancement have been developed, where the Look-up-table (LUT) has proven to be…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Weiwen Chen , Qiuhong Ke , Zinuo Li

Despite the recent success of image-text contrastive models like CLIP and SigLIP, these models often struggle with vision-centric tasks that demand high-fidelity image understanding, such as counting, depth estimation, and fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Zineng Tang , Long Lian , Seun Eisape , XuDong Wang , Roei Herzig , Adam Yala , Alane Suhr , Trevor Darrell , David M. Chan

This paper studies zero-shot anomaly classification (AC) and segmentation (AS) in industrial vision. We reveal that the abundant normal and abnormal cues implicit in unlabeled test images can be exploited for anomaly determination, which is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Xurui Li , Ziming Huang , Feng Xue , Yu Zhou

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap between these models and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bardia Safaei , Vishal M. Patel

We aim at finetuning a vision-language model without hurting its out-of-distribution (OOD) generalization. We address two types of OOD generalization, i.e., i) domain shift such as natural to sketch images, and ii) zero-shot capability to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Jinwei Han , Zhiwen Lin , Zhongyisun Sun , Yingguo Gao , Ke Yan , Shouhong Ding , Yuan Gao , Gui-Song Xia

Recent advances in zero-shot and few-shot classification heavily rely on the success of pre-trained vision-language models (VLMs) such as CLIP. Due to a shortage of large-scale datasets, training such models for event camera data remains…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ziyi Wu , Xudong Liu , Igor Gilitschenski

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

The aim of this work is to explore the potential of pre-trained vision-language models (VLMs) for universal detection of AI-generated images. We develop a lightweight detection strategy based on CLIP features and study its performance in a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Davide Cozzolino , Giovanni Poggi , Riccardo Corvi , Matthias Nießner , Luisa Verdoliva

Contrastive Language-Image Pretraining (CLIP) enables zero-shot inference in downstream tasks such as image-text retrieval and classification. However, recent works extending CLIP suffer from the issue of modality gap, which arises when the…

Machine Learning · Computer Science 2024-12-20 Na Min An , Eunki Kim , James Thorne , Hyunjung Shim

Unsupervised domain adaption (UDA) has emerged as a popular solution to tackle the divergence between the labeled source and unlabeled target domains. Recently, some research efforts have been made to leverage large vision-language models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Jinjing Zhu , Yucheng Chen , Lin Wang

Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP is quite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yangguang Li , Feng Liang , Lichen Zhao , Yufeng Cui , Wanli Ouyang , Jing Shao , Fengwei Yu , Junjie Yan

Zero-shot anomaly detection aims to identify defects in unseen categories without target-specific training. Existing methods usually apply the same feature transformation to all samples, treating normal and anomalous data uniformly despite…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Muhammad Aqeel , Maham Nazir , Uzair Khan , Marco Cristani , Francesco Setti

X-ray imaging is pivotal in medical diagnostics, offering non-invasive insights into a range of health conditions. Recently, vision-language models, such as the Contrastive Language-Image Pretraining (CLIP) model, have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xiangyu Sun , Xiaoguang Zou , Yuanquan Wu , Guotai Wang , Shaoting Zhang

Self-supervised vision-language models trained with contrastive objectives form the basis of current state-of-the-art methods in AI vision tasks. The success of these models is a direct consequence of the huge web-scale datasets used to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Victor Akinwande , Mohammad Sadegh Norouzzadeh , Devin Willmott , Anna Bair , Madan Ravi Ganesh , J. Zico Kolter