English
Related papers

Related papers: Composing Text and Image for Image Retrieval - An …

200 papers

Visual localization, i.e., camera pose estimation in a known scene, is a core component of technologies such as autonomous driving and augmented reality. State-of-the-art localization approaches often rely on image retrieval techniques for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Noé Pion , Martin Humenberger , Gabriela Csurka , Yohann Cabon , Torsten Sattler

Composed Image Retrieval (CIR) involves retrieving a target image based on a composed query of an image paired with text that specifies modifications or changes to the visual reference. CIR is inherently an instruction-following task, as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenliang Zhong , Weizhi An , Feng Jiang , Hehuan Ma , Yuzhi Guo , Junzhou Huang

Textual-visual cross-modal retrieval has been a hot research topic in both computer vision and natural language processing communities. Learning appropriate representations for multi-modal data is crucial for the cross-modal retrieval…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Jiuxiang Gu , Jianfei Cai , Shafiq Joty , Li Niu , Gang Wang

Composed image retrieval (CIR) is the task of retrieving specific images by using a query that involves both a reference image and a relative caption. Most existing CIR models adopt the late-fusion strategy to combine visual and language…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Yang Bai , Xinxing Xu , Yong Liu , Salman Khan , Fahad Khan , Wangmeng Zuo , Rick Siow Mong Goh , Chun-Mei Feng

Many User interactive systems are proposed all methods are trying to implement as a user friendly and various approaches proposed but most of the systems not reached to the use specifications like user friendly systems with user interest,…

Computer Vision and Pattern Recognition · Computer Science 2012-04-12 R. Venkata Ramana Chary , D. Rajya Lakshmi , K. V. N. Sunitha

The goal of this work is to bring semantics into the tasks of text recognition and retrieval in natural images. Although text recognition and retrieval have received a lot of attention in recent years, previous works have focused on…

Computer Vision and Pattern Recognition · Computer Science 2015-09-22 Albert Gordo , Jon Almazan , Naila Murray , Florent Perronnin

Image to image matching has been well studied in the computer vision community. Previous studies mainly focus on training a deep metric learning model matching visual patterns between the query image and gallery images. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Xinliang Zhu , Michael Huang , Han Ding , Jinyu Yang , Kelvin Chen , Tao Zhou , Tal Neiman , Ouye Xie , Son Tran , Benjamin Yao , Doug Gray , Anuj Bindal , Arnab Dhua

Information retrieval lies at the foundation of the modern digital industry. While natural language search has seen dramatic progress in recent years largely driven by embedding-based models and large-scale pretraining, the field still…

Artificial Intelligence · Computer Science 2026-02-20 Adrià Molina , Oriol Ramos Terrades , Josep Lladós

Feature means countenance, remote sensing scene objects with similar characteristics, associated to interesting scene elements in the image formation process. They are classified into three types in image processing, that is low, middle and…

Computer Vision and Pattern Recognition · Computer Science 2013-07-18 T. Dharani , I. Laurence Aroquiaraj

Quality feature representation is key to instance image retrieval. To attain it, existing methods usually resort to a deep model pre-trained on benchmark datasets or even fine-tune the model with a task-dependent labelled auxiliary dataset.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Zhongyan Zhang , Lei Wang , Yang Wang , Luping Zhou , Jianjia Zhang , Peng Wang , Fang Chen

In the recent years, the dual-encoder vision-language models (\eg CLIP) have achieved remarkable text-to-image retrieval performance. However, we discover that these models usually results in very different retrievals for a pair of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jiacheng Cheng , Hijung Valentina Shin , Nuno Vasconcelos , Bryan Russell , Fabian Caba Heilbron

The aim of a Content-Based Image Retrieval (CBIR) system, also known as Query by Image Content (QBIC), is to help users to retrieve relevant images based on their contents. CBIR technologies provide a method to find images in large…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Aman Chadha , Sushmit Mallik , Ravdeep Johar

Large, multi-frequency imaging surveys, such as the Large Synaptic Survey Telescope (LSST), need to do near-real time analysis of very large datasets. This raises a host of statistical and computational problems where standard methods do…

Instrumentation and Methods for Astrophysics · Physics 2015-05-20 Darren Homrighausen , Christopher Genovese , Andy Connolly , Andy Becker , Russell Owen

In this work we introduce a cross modal image retrieval system that allows both text and sketch as input modalities for the query. A cross-modal deep network architecture is formulated to jointly model the sketch and text input modalities…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Sounak Dey , Anjan Dutta , Suman K. Ghosh , Ernest Valveny , Josep Lladós , Umapada Pal

A major difficulty in applying word vector embeddings in IR is in devising an effective and efficient strategy for obtaining representations of compound units of text, such as whole documents, (in comparison to the atomic words), for the…

Information Retrieval · Computer Science 2016-06-28 Dwaipayan Roy , Debasis Ganguly , Mandar Mitra , Gareth J. F. Jones

Existing image-text matching approaches typically infer the similarity of an image-text pair by capturing and aggregating the affinities between the text and each independent object of the image. However, they ignore the connections between…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Tianlang Chen , Jiebo Luo

Visual media has always been the most enjoyed way of communication. From the advent of television to the modern day hand held computers, we have witnessed the exponential growth of images around us. Undoubtedly it's a fact that they carry a…

Information Retrieval · Computer Science 2015-02-26 Jamil Ahmad , Muhammad Sajjad , Irfan Mehmood , Seungmin Rho , Sung Wook Baik

The goal of visual word sense disambiguation is to find the image that best matches the provided description of the word's meaning. It is a challenging problem, requiring approaches that combine language and image understanding. In this…

Computation and Language · Computer Science 2023-04-17 Sławomir Dadas

Given an image and a target modification (e.g an image of the Eiffel tower and the text "without people and at night-time"), Compositional Image Retrieval (CIR) aims to retrieve the relevant target image in a database. While supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Image-sentence retrieval has attracted extensive research attention in multimedia and computer vision due to its promising application. The key issue lies in jointly learning the visual and textual representation to accurately estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Xuri Ge , Fuhai Chen , Songpei Xu , Fuxiang Tao , Joemon M. Jose