中文
相关论文

相关论文: AmorLIP: Efficient Language-Image Pretraining via …

200 篇论文

Contrastive Language-Image Pre-training (CLIP) provides a foundation model by integrating natural language into visual concepts, enabling zero-shot recognition on downstream tasks. It is usually expected that satisfactory overall accuracy…

计算机视觉与模式识别 · 计算机科学 2023-10-06 Jie-Jing Shao , Jiang-Xin Shi , Xiao-Wen Yang , Lan-Zhe Guo , Yu-Feng Li

Contrastive Language-Image Pre-training (CLIP) has become the standard for cross-modal image-text representation learning. Improving CLIP typically requires additional data and retraining with new loss functions, but these demands raise…

计算机视觉与模式识别 · 计算机科学 2025-02-10 Haonan Wang , Minbin Huang , Runhui Huang , Lanqing Hong , Hang Xu , Tianyang Hu , Xiaodan Liang , Zhenguo Li , Hong Cheng , Kenji Kawaguchi

Recent deep learning-based methods for lossy image compression achieve competitive rate-distortion performance through extensive end-to-end training and advanced architectures. However, emerging applications increasingly prioritize semantic…

计算机视觉与模式识别 · 计算机科学 2025-09-09 Ruiqi Shen , Haotian Wu , Wenjing Zhang , Jiangjing Hu , Deniz Gunduz

CLIP has achieved impressive zero-shot performance after pre-training on a large-scale dataset consisting of paired image-text data. Previous works have utilized CLIP by incorporating manually designed visual prompts like colored circles…

计算机视觉与模式识别 · 计算机科学 2024-08-22 Jiedong Zhuang , Jiaqi Hu , Lianrui Mu , Rui Hu , Xiaoyu Liang , Jiangnan Ye , Haoji Hu

We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT, by exploring the potential of Contrastive Language-Image Pre-Training (CLIP) for pixel-level image enhancement. We show that the open-world CLIP…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Zhexin Liang , Chongyi Li , Shangchen Zhou , Ruicheng Feng , Chen Change Loy

Vision-language models, such as contrastive language-image pre-training (CLIP), have demonstrated impressive results in natural image domains. However, these models often struggle when applied to specialized domains like remote sensing, and…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jinwoo Shin

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap between these models and…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Bardia Safaei , Vishal M. Patel

Capitalizing on vast amount of image-text data, large-scale vision-language pre-training has demonstrated remarkable zero-shot capabilities and has been utilized in several applications. However, models trained on general everyday…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Umair Nawaz , Muhammad Awais , Hanan Gani , Muzammal Naseer , Fahad Khan , Salman Khan , Rao Muhammad Anwer

Traditional computer vision models are trained to predict a fixed set of predefined categories. Recently, natural language has been shown to be a broader and richer source of supervision that provides finer descriptions to visual concepts…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Ruizhe Cheng , Bichen Wu , Peizhao Zhang , Peter Vajda , Joseph E. Gonzalez

Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Kaiyang Zhou , Jingkang Yang , Chen Change Loy , Ziwei Liu

Vision-Language Models (VLMs) have shown strong performance in zero-shot image classification tasks. However, existing methods, including Contrastive Language-Image Pre-training (CLIP), all rely on annotated text-to-image pairs for aligning…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Dianxing Shi , Dingjie Fu , Yuqiao Liu , Jun Wang

Contrastive Language-Image Pretraining (CLIP) has gained popularity for its remarkable zero-shot capacity. Recent research has focused on developing efficient fine-tuning methods, such as prompt learning and adapter, to enhance CLIP's…

计算机视觉与模式识别 · 计算机科学 2024-02-07 Zhengbo Wang , Jian Liang , Lijun Sheng , Ran He , Zilei Wang , Tieniu Tan

CLIP (Contrastive Language-Image Pre-training) uses contrastive learning from noise image-text pairs to excel at recognizing a wide array of candidates, yet its focus on broad associations hinders the precision in distinguishing subtle…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Ziyu Liu , Zeyi Sun , Yuhang Zang , Wei Li , Pan Zhang , Xiaoyi Dong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li

Recent advancements in Contrastive Language-Image Pre-training (CLIP) have demonstrated notable success in self-supervised representation learning across various tasks. However, the existing CLIP-like approaches often demand extensive GPU…

计算机视觉与模式识别 · 计算机科学 2024-07-31 Yuexi Du , Brian Chang , Nicha C. Dvornek

Multi-modal contrastive models such as CLIP achieve state-of-the-art performance in zero-shot classification by embedding input images and texts on a joint representational space. Recently, a modality gap has been reported in two-encoder…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Abrar Fahim , Alex Murphy , Alona Fyshe

CLIP models perform remarkably well on zero-shot classification and retrieval tasks. But recent studies have shown that learnt representations in CLIP are not well suited for dense prediction tasks like object detection, semantic…

计算机视觉与模式识别 · 计算机科学 2024-05-16 Pavan Kumar Anasosalu Vasu , Hadi Pouransari , Fartash Faghri , Oncel Tuzel

Contrastive Language-Image Pretraining (CLIP) has demonstrated impressive zero-shot learning abilities for image understanding, yet limited effort has been made to investigate CLIP for zero-shot video recognition. We introduce Open-VCLIP, a…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Zejia Weng , Xitong Yang , Ang Li , Zuxuan Wu , Yu-Gang Jiang

The CLIP (Contrastive Language-Image Pre-training) model and its variants are becoming the de facto backbone in many applications. However, training a CLIP model from hundreds of millions of image-text pairs can be prohibitively expensive.…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Liangliang Cao , Bowen Zhang , Chen Chen , Yinfei Yang , Xianzhi Du , Wencong Zhang , Zhiyun Lu , Yantao Zheng

Large-scale cross-modal pre-training paradigms have recently shown ubiquitous success on a wide range of downstream tasks, e.g., zero-shot classification, retrieval and image captioning. However, their successes highly rely on the scale and…

计算机视觉与模式识别 · 计算机科学 2023-01-05 Runhui Huang , Yanxin Long , Jianhua Han , Hang Xu , Xiwen Liang , Chunjing Xu , Xiaodan Liang