English
Related papers

Related papers: Improving Composed Image Retrieval via Contrastive…

200 papers

The aim of a Content-Based Image Retrieval (CBIR) system, also known as Query by Image Content (QBIC), is to help users to retrieve relevant images based on their contents. CBIR technologies provide a method to find images in large…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Aman Chadha , Sushmit Mallik , Ravdeep Johar

The CLIP model has been recently proven to be very effective for a variety of cross-modal tasks, including the evaluation of captions generated from vision-and-language architectures. In this paper, we propose a new recipe for a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Sara Sarto , Manuele Barraco , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Contrastive learning predicts whether two images belong to the same category by training a model to make their feature representations as close or as far away as possible. In this paper, we rethink how to mine samples in contrastive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Hengkui Dong , Xianzhong Long , Yun Li

The present research scholars are having keen interest in doing their research activities in the area of Data mining all over the world. Especially, [13]Mining Image data is the one of the essential features in this present scenario since…

Computer Vision and Pattern Recognition · Computer Science 2010-12-02 A. Kannan , V. Mohan , N. Anbazhagan

Composed image retrieval (CIR) requires complex reasoning over heterogeneous visual and textual constraints. Existing approaches largely fall into two paradigms: unified embedding retrieval, which suffers from single-model myopia, and…

Artificial Intelligence · Computer Science 2026-02-10 Teng Wang , Rong Shan , Jianghao Lin , Junjie Wu , Tianyi Xu , Jianping Zhang , Wenteng Chen , Changwang Zhang , Zhaoxiang Wang , Weinan Zhang , Jun Wang

Current text conditioned image generation methods output realistic looking images, but they fail to capture specific styles. Simply finetuning them on the target style datasets still struggles to grasp the style features. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Serkan Ozturk , Samet Hicsonmez , Pinar Duygulu

Retrieving fine-grained visual content based on user intent remains a challenge in multi-modal systems. Although current Composed Image Retrieval (CIR) methods combine reference images with retrieval texts, they are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Tong Wang , Guanyu Yang , Nian Liu , Zongyan Han , Jinxing Zhou , Salman Khan , Fahad Shahbaz Khan

As a fundamental and challenging task in bridging language and vision domains, Image-Text Retrieval (ITR) aims at searching for the target instances that are semantically relevant to the given query from the other modality, and its key…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yan Zhang , Zhong Ji , Di Wang , Yanwei Pang , Xuelong Li

Learning representations that transfer well to diverse downstream tasks remains a central challenge in representation learning. Existing paradigms -- contrastive learning, self-supervised masking, and denoising auto-encoders -- balance this…

Machine Learning · Computer Science 2025-09-29 Micha Livne

Broadspread use of medical imaging devices with digital storage has paved the way for curation of substantial data repositories. Fast access to image samples with similar appearance to suspected cases can help establish a consulting system…

Image and Video Processing · Electrical Eng. & Systems 2022-11-29 Şaban Öztürk , Emin Celik , Tolga Cukur

The triplet loss with semi-hard negatives has become the de facto choice for image-caption retrieval (ICR) methods that are optimized from scratch. Recent progress in metric learning has given rise to new loss functions that outperform the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Maurits Bleeker , Maarten de Rijke

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Quantifying and evaluating image complexity can be instrumental in enhancing the performance of various computer vision tasks. Supervised learning can effectively learn image complexity features from well-annotated datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Shipeng Liu , Liang Zhao , Dengfeng Chen , Zhanping Song

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Jonas Dippel , Steffen Vogler , Johannes Höhne

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

The learn-to-compare paradigm of contrastive representation learning (CRL), which compares positive samples with negative ones for representation learning, has achieved great success in a wide range of domains, including natural language…

Information Retrieval · Computer Science 2022-06-02 Lanling Xu , Jianxun Lian , Wayne Xin Zhao , Ming Gong , Linjun Shou , Daxin Jiang , Xing Xie , Ji-Rong Wen

This paper proposes a novel diffusion-based model, CompoDiff, for solving zero-shot Composed Image Retrieval (ZS-CIR) with latent diffusion. This paper also introduces a new synthetic dataset, named SynthTriplets18M, with 18.8 million…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Geonmo Gu , Sanghyuk Chun , Wonjae Kim , HeeJae Jun , Yoohoon Kang , Sangdoo Yun

In this paper, we propose a new framework for improving Content Based Image Retrieval (CBIR) for texture images. This is achieved by using a new image representation based on the RCT-Plus transform which is a novel variant of the Redundant…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Asal Rouhafzay , Nadia Baaziz , Mohand Said Allili