English
Related papers

Related papers: SCOT: Self-Supervised Contrastive Pretraining For …

200 papers

The learning objective of vision-language approach of CLIP does not effectively account for the noisy many-to-many correspondences found in web-harvested image captioning datasets, which contributes to its compute and data inefficiency. To…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Alex Andonian , Shixing Chen , Raffay Hamid

The task of Composed Image Retrieval (CoIR) involves queries that combine image and text modalities, allowing users to express their intent more effectively. However, current CoIR datasets are orders of magnitude smaller compared to other…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Matan Levy , Rami Ben-Ari , Nir Darshan , Dani Lischinski

Vision-language models like CLIP have demonstrated remarkable zero-shot capabilities in classification and retrieval. However, these models often struggle with compositional reasoning - the ability to understand the relationships between…

Machine Learning · Computer Science 2025-10-29 Amit Peleg , Naman Deep Singh , Matthias Hein

Contrastive losses yield state-of-the-art performance for person re-identification, face verification and few shot learning. They have recently outperformed the cross-entropy loss on classification at the ImageNet scale and outperformed all…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Bharti Munjal , Sikandar Amin , Fabio Galasso

Composed image retrieval (CIR) aims to retrieve a target image that depicts a reference image modified by a textual description. While recent vision-language models (VLMs) achieve promising CIR performance by embedding images and text into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 François Gardères , Camille-Sovanneary Gauthier , Jean Ponce , Shizhe Chen

Children can rapidly generalize compositionally-constructed rules to unseen test sets. On the other hand, deep reinforcement learning (RL) agents need to be trained over millions of episodes, and their ability to generalize to unseen…

Machine Learning · Computer Science 2024-05-06 Zijun Lin , Haidi Azaman , M Ganesh Kumar , Cheston Tan

Zero-shot compositional action recognition (ZS-CAR) aims to identify unseen verb-object compositions in the videos by exploiting the learned knowledge of verb and object primitives during training. Despite compositional learning's progress…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Gefan Ye , Lin Li , Kexin Li , Jun Xiao , Long Chen

Traditional computer vision models are trained to predict a fixed set of predefined categories. Recently, natural language has been shown to be a broader and richer source of supervision that provides finer descriptions to visual concepts…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Ruizhe Cheng , Bichen Wu , Peizhao Zhang , Peter Vajda , Joseph E. Gonzalez

Object recognition has become prevalent across various industries. However, most existing applications are limited to identifying objects alone, without considering their associated states. The ability to recognize both the state and object…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Cheng-Hong Chang , Pei-Hsuan Tsai

Videos are a rich source for self-supervised learning (SSL) of visual representations due to the presence of natural temporal transformations of objects. However, current methods typically randomly sample video clips for learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Brian Chen , Ramprasaath R. Selvaraju , Shih-Fu Chang , Juan Carlos Niebles , Nikhil Naik

Compositional actions consist of dynamic (verbs) and static (objects) concepts. Humans can easily recognize unseen compositions using the learned concepts. For machines, solving such a problem requires a model to recognize unseen actions…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Rongchang Li , Zhenhua Feng , Tianyang Xu , Linze Li , Xiao-Jun Wu , Muhammad Awais , Sara Atito , Josef Kittler

There has been a recent spike in interest in multi-modal Language and Vision problems. On the language side, most of these models primarily focus on English since most multi-modal datasets are monolingual. We try to bridge this gap with a…

Machine Learning · Computer Science 2021-09-17 Pranav Aggarwal , Ritiz Tambi , Ajinkya Kale

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

Machine Learning · Computer Science 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

As natural language interfaces enable users to express increasingly complex natural language queries, there is a parallel explosion of user review content that can allow users to better find items such as restaurants, books, or movies that…

Contrastive Language-Image Pretraining (CLIP) enables zero-shot inference in downstream tasks such as image-text retrieval and classification. However, recent works extending CLIP suffer from the issue of modality gap, which arises when the…

Machine Learning · Computer Science 2024-12-20 Na Min An , Eunki Kim , James Thorne , Hyunjung Shim

Cross-modal attention mechanisms have been widely applied to the image-text matching task and have achieved remarkable improvements thanks to its capability of learning fine-grained relevance across different modalities. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Yuxiao Chen , Jianbo Yuan , Long Zhao , Tianlang Chen , Rui Luo , Larry Davis , Dimitris N. Metaxas

Zero-shot Composed Image Retrieval (ZS-CIR) enables image search using a reference image and a text prompt without requiring specialized text-image composition networks trained on large-scale paired data. However, current ZS-CIR approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Osman Tursun , Sinan Kalkan , Simon Denman , Clinton Fookes

We investigate a strategy for improving the efficiency of contrastive learning of visual representations by leveraging a small amount of supervised information during pre-training. We propose a semi-supervised loss, SuNCEt, based on…

Machine Learning · Computer Science 2020-12-03 Mahmoud Assran , Nicolas Ballas , Lluis Castrejon , Michael Rabbat

Zero-shot sketch-based image retrieval (ZS-SBIR) is challenging due to the cross-domain nature of sketches and photos, as well as the semantic gap between seen and unseen image distributions. Previous methods fine-tune pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Shiyin Dong , Mingrui Zhu , Nannan Wang , Xinbo Gao

Low-shot sketch-based image retrieval is an emerging task in computer vision, allowing to retrieve natural images relevant to hand-drawn sketch queries that are rarely seen during the training phase. Related prior works either require…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Anjan Dutta , Zeynep Akata