English
Related papers

Related papers: MIP: CLIP-based Image Reconstruction from PEFT Gra…

200 papers

Numerous methods have been proposed to adapt a pre-trained foundational CLIP model for few-shot classification. As CLIP is trained on a large corpus, it generalises well through adaptation to few-shot classification. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Alexey Kravets , Vinay Namboodiri

Modern image captioning models are usually trained with text similarity objectives. However, since reference captions in public datasets often describe the most salient common objects, models trained with text similarity objectives tend to…

Computation and Language · Computer Science 2023-03-31 Jaemin Cho , Seunghyun Yoon , Ajinkya Kale , Franck Dernoncourt , Trung Bui , Mohit Bansal

CLIP (Contrastive Language-Image Pre-training) has attained great success in pattern recognition and computer vision. Transferring CLIP to downstream tasks (e.g. zero- or few-shot classification) is a hot topic in multimodal learning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhipeng Ye , Feng Jiang , Qiufeng Wang , Kaizhu Huang , Jiaqi Huang

Contrastive Language-Image Pretraining (CLIP) is a popular foundation model, supporting from zero-shot classification, retrieval to encoders for multimodal large language models (MLLMs). Although CLIP is successfully trained on…

Pre-trained vision-language models like CLIP have remarkably adapted to various downstream tasks. Nonetheless, their performance heavily depends on the specificity of the input text prompts, which requires skillful prompt template…

Machine Learning · Computer Science 2024-10-22 Yingjun Du , Wenfang Sun , Cees G. M. Snoek

Federated Class Incremental Learning (FCIL) is a new direction in continual learning (CL) for addressing catastrophic forgetting and non-IID data distribution simultaneously. Existing FCIL methods call for high communication costs and…

We present a comprehensive experimental study on pretrained feature extractors for visual out-of-distribution (OOD) detection, focusing on adapting contrastive language-image pretrained (CLIP) models. Without fine-tuning on the training…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Nikolas Adaloglou , Felix Michels , Tim Kaiser , Markus Kollmann

Large pretrained vision-language models like CLIP have shown promising generalization capability, but may struggle in specialized domains (e.g., satellite imagery) or fine-grained classification (e.g., car models) where the visual concepts…

Machine Learning · Computer Science 2024-11-01 Chen Huang , Skyler Seto , Samira Abnar , David Grangier , Navdeep Jaitly , Josh Susskind

Although fusion of information from multiple views of mammograms plays an important role to increase accuracy of breast cancer detection, developing multi-view mammograms-based computer-aided diagnosis (CAD) schemes still faces challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xuxin Chen , Yuheng Li , Mingzhe Hu , Ella Salari , Xiaoqian Chen , Richard L. J. Qiu , Bin Zheng , Xiaofeng Yang

Text-to-image person re-identification (TIReID) aims to retrieve the target person from an image gallery via a textual description query. Recently, pre-trained vision-language models like CLIP have attracted significant attention and have…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Weihao Li , Lei Tan , Pingyang Dai , Yan Zhang

We propose Context-Adaptive Multi-Prompt Embedding, a novel approach to enrich semantic representations in vision-language contrastive learning. Unlike standard CLIP-style models that rely on a single text embedding, our method introduces…

Machine Learning · Computer Science 2025-08-07 Dahun Kim , Anelia Angelova

The rapid advancement of generative models has significantly enhanced the quality of AI-generated images, raising concerns about misinformation and the erosion of public trust. Detecting AI-generated images has thus become a critical…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Yakun Niu , Yingjian Chen , Lei Zhang

While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity of Whole Slide Images (WSIs) continue to pose challenges for multimodal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Fengchun Liu , Songhan Jiang , Linghan Cai , Ziyue Wang , Yongbing Zhang

Prompt tuning introduces learnable prompt vectors that adapt pretrained vision-language models to downstream tasks in a parameter-efficient manner. However, under limited supervision, prompt tuning alters pretrained representations and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Xi Yang , Yuanrong Xu , Weigang Zhang , Guangming Lu , David Zhang , Jie Wen

Iterative prompt refinement is central to reproducing target images with text to image generative models. Previous studies have incorporated image similarity metrics (ISMs) as additional feedback to human users. Existing ISMs such as LPIPS…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Khoi Trinh , Jay Rothenberger , Scott Seidenberger , Dimitrios Diochnos , Anindya Maiti

The recent CLIP-based methods have shown promising zero-shot and few-shot performance on image classification tasks. Existing approaches such as CoOp and Tip-Adapter only focus on high-level visual features that are fully aligned with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiaying Shi , Xuetong Xue , Shenghui Xu

Pretrained vision-language models (VLMs) such as CLIP have shown impressive generalization capability in downstream vision tasks with appropriate text prompts. Instead of designing prompts manually, Context Optimization (CoOp) has been…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Chengcheng Ma , Yang Liu , Jiankang Deng , Lingxi Xie , Weiming Dong , Changsheng Xu

Recent advances in pre-training vision-language models like CLIP have shown great potential in learning transferable visual representations. Nonetheless, for downstream inference, CLIP-like models suffer from either 1) degraded accuracy and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Feng Wang , Manling Li , Xudong Lin , Hairong Lv , Alexander G. Schwing , Heng Ji

This paper investigates the application of unsupervised learning methods for computed tomography (CT) reconstruction. To motivate our work, we review several existing priors, namely the truncated Gaussian prior, the $l_1$ prior, the total…

Image and Video Processing · Electrical Eng. & Systems 2023-06-02 Chen Cheng , Qingping Zhou

Contrastive Language-Image Pretraining (CLIP) is widely used to train models to align images and texts in a common embedding space by mapping them to fixed-sized vectors. These models are key to multimodal information retrieval and related…