中文
相关论文

相关论文: A Closer Look at the Explainability of Contrastive…

200 篇论文

Contrastive Language-Image Pre-training (CLIP) learns rich representations via readily available supervision of natural language. It improves the performance of downstream vision tasks, including but not limited to the zero-shot, long tail,…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yi Li , Hualiang Wang , Yiqun Duan , Hang Xu , Xiaomeng Li

Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks due to its generalizability and…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Zihao Zhao , Yuxiao Liu , Han Wu , Mei Wang , Yonghao Li , Sheng Wang , Lin Teng , Disheng Liu , Zhiming Cui , Qian Wang , Dinggang Shen

Contrastive Language-Image Pre-training (CLIP) formulates image classification as an image-to-text matching task, i.e., matching images to the corresponding natural language descriptions instead of discrete category IDs. This allows for…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Shuhuai Ren , Lei Li , Xuancheng Ren , Guangxiang Zhao , Xu Sun

Contrastive Language-Image Pre-training (CLIP) has been a celebrated method for training vision encoders to generate image/text representations facilitating various applications. Recently, CLIP has been widely adopted as the vision backbone…

计算机视觉与模式识别 · 计算机科学 2025-02-20 Hong-You Chen , Zhengfeng Lai , Haotian Zhang , Xinze Wang , Marcin Eichner , Keen You , Meng Cao , Bowen Zhang , Yinfei Yang , Zhe Gan

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

机器学习 · 计算机科学 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Contrastive Language-Image Pre-training (CLIP) has become a cornerstone in vision-language representation learning, powering diverse downstream tasks and serving as the default vision backbone in multimodal large language models (MLLMs).…

计算机视觉与模式识别 · 计算机科学 2026-01-29 Chuan Qin , Constantin Venhoff , Sonia Joseph , Fanyi Xiao , Stefan Scherer

A pre-trained visual-language model, contrastive language-image pre-training (CLIP), successfully accomplishes various downstream tasks with text prompts, such as finding images or localizing regions within the image. Despite CLIP's strong…

计算机视觉与模式识别 · 计算机科学 2025-02-18 YeongHyeon Park , Myung Jin Kim , Hyeong Seok Kim

Despite the success of large-scale pretrained Vision-Language Models (VLMs) especially CLIP in various open-vocabulary tasks, their application to semantic segmentation remains challenging, producing noisy segmentation maps with…

计算机视觉与模式识别 · 计算机科学 2024-07-18 Mengcheng Lan , Chaofeng Chen , Yiping Ke , Xinjiang Wang , Litong Feng , Wayne Zhang

Contrastive Language-Image Pre-training (CLIP) models have demonstrated remarkable generalization capabilities across multiple challenging distribution shifts. However, there is still much to be explored in terms of their robustness to the…

计算机视觉与模式识别 · 计算机科学 2024-02-13 Weijie Tu , Weijian Deng , Tom Gedeon

Contrastive Language-Image Pre-training (CLIP) plays an essential role in extracting valuable content information from images across diverse tasks. It aligns textual and visual modalities to comprehend the entire image, including all the…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Zeyi Sun , Ye Fang , Tong Wu , Pan Zhang , Yuhang Zang , Shu Kong , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

Contrastive Language-Image Pre-training (CLIP) demonstrates strong potential in medical image analysis but requires substantial data and computational resources. Due to these restrictions, existing CLIP applications in medical imaging focus…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Yuexi Du , John Onofrey , Nicha C. Dvornek

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

Contrastive language-image pre-training (CLIP) serves as a de-facto standard to align images and texts. Nonetheless, the loose correlation between images and texts of web-crawled data renders the contrastive objective data inefficient and…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Jinghao Zhou , Li Dong , Zhe Gan , Lijuan Wang , Furu Wei

The success of large-scale contrastive vision-language pretraining (CLIP) has benefited both visual recognition and multimodal content understanding. The concise design brings CLIP the advantage in inference efficiency against other…

计算机视觉与模式识别 · 计算机科学 2023-03-07 Shijie Geng , Jianbo Yuan , Yu Tian , Yuxiao Chen , Yongfeng Zhang

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Recent years have witnessed the fast development of large-scale pre-training frameworks that can extract multi-modal representations in a unified form and achieve promising performances when transferred to downstream tasks. Nevertheless,…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Xuran Pan , Tianzhu Ye , Dongchen Han , Shiji Song , Gao Huang

Contrastive Language-Image Pre-training (CLIP) has significantly improved performance in various vision-language tasks by expanding the dataset with image-text pairs obtained from websites. This paper further explores CLIP from the…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Tiancheng Gu , Kaicheng Yang , Xiang An , Ziyong Feng , Dongnan Liu , Weidong Cai , Jiankang Deng

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

计算机视觉与模式识别 · 计算机科学 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

Contrastive Language-Image Pretraining (CLIP) has emerged as a novel paradigm to learn visual models from language supervision. While researchers continue to push the frontier of CLIP, reproducing these works remains challenging. This is…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Yufeng Cui , Lichen Zhao , Feng Liang , Yangguang Li , Jing Shao

Contrastive Language-Image Pre-training (CLIP) has significantly boosted the performance of various vision-language tasks by scaling up the dataset with image-text pairs collected from the web. However, the presence of intrinsic noise and…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Kaicheng Yang , Jiankang Deng , Xiang An , Jiawei Li , Ziyong Feng , Jia Guo , Jing Yang , Tongliang Liu
‹ 上一页 1 2 3 10 下一页 ›