中文
相关论文

相关论文: Learning to Adapt CLIP for Few-Shot Monocular Dept…

200 篇论文

This expository paper introduces a simplified approach to image-based quality inspection in manufacturing using OpenAI's CLIP (Contrastive Language-Image Pretraining) model adapted for few-shot learning. While CLIP has demonstrated…

Learning generalized representations from limited training samples is crucial for applying deep neural networks in low-resource scenarios. Recently, methods based on Contrastive Language-Image Pre-training (CLIP) have exhibited promising…

计算机视觉与模式识别 · 计算机科学 2023-12-08 Yao Zhu , Yuefeng Chen , Wei Wang , Xiaofeng Mao , Xiu Yan , Yue Wang , Zhigang Li , Wang lu , Jindong Wang , Xiangyang Ji

Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning. Unlike traditional visual systems trained by a fixed set of discrete labels, a new paradigm was introduced in…

计算机视觉与模式识别 · 计算机科学 2025-03-26 Peng Gao , Shijie Geng , Renrui Zhang , Teli Ma , Rongyao Fang , Yongfeng Zhang , Hongsheng Li , Yu Qiao

Large-scale web-crawled datasets are fundamental for the success of pre-training vision-language models, such as CLIP. However, the inherent noise and potential irrelevance of web-crawled AltTexts pose challenges in achieving precise…

计算机视觉与模式识别 · 计算机科学 2024-03-15 Zhengfeng Lai , Haotian Zhang , Bowen Zhang , Wentao Wu , Haoping Bai , Aleksei Timofeev , Xianzhi Du , Zhe Gan , Jiulong Shan , Chen-Nee Chuah , Yinfei Yang , Meng Cao

Fine-grained image classification, particularly in zero/few-shot scenarios, presents a significant challenge for vision-language models (VLMs), such as CLIP. These models often struggle with the nuanced task of distinguishing between…

计算与语言 · 计算机科学 2024-05-21 Canshi Wei

Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Kaiyang Zhou , Jingkang Yang , Chen Change Loy , Ziwei Liu

Large-scale pre-trained Vision-Language Models (VLMs) have exhibited impressive zero-shot performance and transferability, allowing them to adapt to downstream tasks in a data-efficient manner. However, when only a few labeled samples are…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Ce Zhang , Simon Stepputtis , Katia Sycara , Yaqi Xie

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Naresh Kumar Lahajal , Harini S

Contrastive language-image pretraining (CLIP) links vision and language modalities into a unified embedding space, yielding the tremendous potential for vision-language (VL) tasks. While early concurrent works have begun to study this…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Zhecan Wang , Noel Codella , Yen-Chun Chen , Luowei Zhou , Jianwei Yang , Xiyang Dai , Bin Xiao , Haoxuan You , Shih-Fu Chang , Lu Yuan

Large vision-language models (VLMs), such as CLIP, learn rich joint image-text representations, facilitating advances in numerous downstream tasks, including zero-shot classification and text-to-image generation. Nevertheless, existing VLMs…

计算机视觉与模式识别 · 计算机科学 2023-02-24 Roni Paiss , Ariel Ephrat , Omer Tov , Shiran Zada , Inbar Mosseri , Michal Irani , Tali Dekel

Contrastive Language-Image Pretraining (CLIP) has shown impressive zero-shot performance on image classification. However, state-of-the-art methods often rely on fine-tuning techniques like prompt learning and adapter-based tuning to…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Ans Munir , Faisal Z. Qureshi , Muhammad Haris Khan , Mohsen Ali

Few-shot image classification remains a critical challenge in the field of computer vision, particularly in data-scarce environments. Existing methods typically rely on pre-trained visual-language models, such as CLIP. However, due to the…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Xi Yang , Pai Peng , Wulin Xie , Xiaohuan Lu , Jie Wen

In this paper, we introduce DetailCLIP: A Detail-Oriented CLIP to address the limitations of contrastive learning-based vision-language models, particularly CLIP, in handling detail-oriented and fine-grained tasks like segmentation. While…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Amin Karimi Monsefi , Kishore Prakash Sailaja , Ali Alilooee , Ser-Nam Lim , Rajiv Ramnath

Few-shot segmentation remains challenging due to the limitations of its labeling information for unseen classes. Most previous approaches rely on extracting high-level feature maps from the frozen visual encoder to compute the pixel-wise…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Jin Wang , Bingfeng Zhang , Jian Pang , Honglong Chen , Weifeng Liu

Zero-shot vision-language models (VLMs) have shown promise for chest radiograph classification, but their performance is often limited by confounding label co-occurrence, long-tail class imbalance, and transfer instability under domain…

机器学习 · 计算机科学 2026-04-21 Florian Kittler , Sheethal Bhat , Andreas Maier

Vision-language models (VLMs) such as CLIP are trained via contrastive learning between text and image pairs, resulting in aligned image and text embeddings that are useful for many downstream tasks. A notable drawback of CLIP, however, is…

机器学习 · 计算机科学 2025-07-08 Dylan Sam , Devin Willmott , Joao D. Semedo , J. Zico Kolter

Depth estimation from single monocular images is a key component of scene understanding and has benefited largely from deep convolutional neural networks (CNN) recently. In this article, we take advantage of the recent deep residual…

计算机视觉与模式识别 · 计算机科学 2017-08-14 Yuanzhouhan Cao , Zifeng Wu , Chunhua Shen

Transduction is a powerful paradigm that leverages the structure of unlabeled data to boost predictive accuracy. We present TransCLIP, a novel and computationally efficient transductive approach designed for Vision-Language Models (VLMs).…

计算机视觉与模式识别 · 计算机科学 2024-06-05 Maxime Zanella , Benoît Gérin , Ismail Ben Ayed

Recent advances in visual-language models have shown remarkable zero-shot text-image matching ability that is transferable to downstream tasks such as object detection and segmentation. Adapting these models for object counting, however,…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Ruixiang Jiang , Lingbo Liu , Changwen Chen

Few-shot, fine-grained classification in computer vision poses significant challenges due to the need to differentiate subtle class distinctions with limited data. This paper presents a novel method that enhances the Contrastive…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Eric Brouwer , Jan Erik van Woerden , Gertjan Burghouts , Matias Valdenegro-Toro , Marco Zullich