English
Related papers

Related papers: EZ-CLIP: Efficient Zeroshot Video Action Recogniti…

200 papers

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

Large-scale pre-trained models have demonstrated impressive performance in vision and language tasks within open-world scenarios. Due to the lack of comparable pre-trained models for 3D shapes, recent methods utilize language-image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Dan Song , Xinwei Fu , Ning Liu , Weizhi Nie , Wenhui Li , Lanjun Wang , You Yang , Anan Liu

Image geolocalization is the challenging task of predicting the geographic coordinates of origin for a given photo. It is an unsolved problem relying on the ability to combine visual clues with general knowledge about the world to make…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Lukas Haas , Silas Alberti , Michal Skreta

Large-scale vision-language models such as CLIP achieve strong zero-shot recognition but struggle with classes that are rarely seen during pretraining, including newly emerging entities and culturally specific categories. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Aishwarya Agarwal , Srikrishna Karanam , Vineet Gandhi

Pre-trained vision and language models such as CLIP have witnessed remarkable success in connecting images and texts with a primary focus on English texts. Despite recent efforts to extend CLIP to support other languages, disparities in…

Computation and Language · Computer Science 2023-10-31 Zhen Zhang , Jialu Wang , Xin Eric Wang

Generalized Zero-shot Semantic Segmentation aims to segment both seen and unseen categories only under the supervision of the seen ones. To tackle this, existing methods adopt the large-scale Vision Language Models (VLMs) which obtain…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jialei Chen , Daisuke Deguchi , Chenkai Zhang , Xu Zheng , Hiroshi Murase

Contrastive Language-Image Pretraining (CLIP) is a popular foundation model, supporting from zero-shot classification, retrieval to encoders for multimodal large language models (MLLMs). Although CLIP is successfully trained on…

Contrastive Language-Image Pre-training (CLIP) excels in multimodal tasks such as image-text retrieval and zero-shot classification but struggles with fine-grained understanding due to its focus on coarse-grained short captions. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Chunyu Xie , Bin Wang , Fanjing Kong , Jincheng Li , Dawei Liang , Gengshen Zhang , Dawei Leng , Yuhui Yin

Universal visual anomaly detection aims to identify anomalies from novel or unseen vision domains without additional fine-tuning, which is critical in open scenarios. Recent studies have demonstrated that pre-trained vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Bin-Bin Gao , Yue Zhou , Jiangtao Yan , Yuezhi Cai , Weixi Zhang , Meng Wang , Jun Liu , Yong Liu , Lei Wang , Chengjie Wang

The Contrastive Language-Image Pre-training (CLIP) Model is a recently proposed large-scale pre-train model which attracts increasing attention in the computer vision community. Benefiting from its gigantic image-text training set, the CLIP…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yuxuan Ding , Lingqiao Liu , Chunna Tian , Jingyuan Yang , Haoxuan Ding

Recently, zero-shot and few-shot learning via Contrastive Vision-Language Pre-training (CLIP) have shown inspirational performance on 2D visual recognition, which learns to match images with their corresponding texts in open-vocabulary…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Renrui Zhang , Ziyu Guo , Wei Zhang , Kunchang Li , Xupeng Miao , Bin Cui , Yu Qiao , Peng Gao , Hongsheng Li

Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks due to its generalizability and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zihao Zhao , Yuxiao Liu , Han Wu , Mei Wang , Yonghao Li , Sheng Wang , Lin Teng , Disheng Liu , Zhiming Cui , Qian Wang , Dinggang Shen

Contrastive Language-Image Pretraining (CLIP) has demonstrated strong zero-shot performance across diverse downstream text-image tasks. Existing CLIP methods typically optimize a contrastive objective using negative samples drawn from each…

Machine Learning · Computer Science 2025-10-23 Haotian Sun , Yitong Li , Yuchen Zhuang , Niao He , Hanjun Dai , Bo Dai

Contrastive vision-language models excel in zero-shot image recognition but face challenges in few-shot scenarios due to computationally intensive offline fine-tuning using prompt learning, which risks overfitting. To overcome these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Phuoc-Nguyen Bui , Khanh-Binh Nguyen , Hyunseung Choo

CLIP (Contrastive Language-Image Pretraining) is an efficient method for learning computer vision tasks from natural language supervision that has powered a recent breakthrough in deep learning due to its zero-shot transfer capabilities. By…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Arnau Martí Sarri , Victor Rodriguez-Fernandez

Visual anomaly detection has been widely used in industrial inspection and medical diagnosis. Existing methods typically demand substantial training samples, limiting their utility in zero-/few-shot scenarios. While recent efforts have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Qingqing Fang , Wenxi Lv , Qinliang Su

Contrastive Language-Image Pre-training (CLIP) models have shown promising performance on zero-shot visual recognition tasks by learning visual representations under natural language supervision. Recent studies attempt the use of CLIP to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Hanqiu Deng , Zhaoxiang Zhang , Jinan Bao , Xingyu Li

Although deep learning models have shown impressive performance on supervised learning tasks, they often struggle to generalize well when the training (source) and test (target) domains differ. Unsupervised domain adaptation (DA) has…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Mainak Singha , Harsh Pal , Ankit Jha , Biplab Banerjee

Few-shot segmentation remains challenging due to the limitations of its labeling information for unseen classes. Most previous approaches rely on extracting high-level feature maps from the frozen visual encoder to compute the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Jin Wang , Bingfeng Zhang , Jian Pang , Honglong Chen , Weifeng Liu

Gameplay videos contain rich information about how players interact with the game and how the game responds. Sharing gameplay videos on social media platforms, such as Reddit, has become a common practice for many players. Often, players…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Mohammad Reza Taesiri , Finlay Macklon , Cor-Paul Bezemer