English
Related papers

Related papers: Caption-Matching: A Multimodal Approach for Cross-…

200 papers

Composed Image Retrieval (CIR) is an emerging yet challenging task that allows users to search for target images using a multimodal query, comprising a reference image and a modification text specifying the user's desired changes to the…

Multimedia · Computer Science 2025-03-05 Xuemeng Song , Haoqiang Lin , Haokun Wen , Bohan Hou , Mingzhu Xu , Liqiang Nie

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Mingyu Zhang , Zixu Li , Zhiwei Chen , Zhiheng Fu , Xiaowei Zhu , Jiajia Nie , Yinwei Wei , Yupeng Hu

The objective of Content-Based Image Retrieval (CBIR) methods is essentially to extract, from large (image) databases, a specified number of images similar in visual and semantic content to a so-called query image. To bridge the semantic…

Information Retrieval · Computer Science 2015-02-12 Smarajit Bose , Amita Pal , Jhimli Mallick , Sunil Kumar , Pratyaydipta Rudra

Change captioning aims to describe the difference between a pair of similar images. Its key challenge is how to learn a stable difference representation under pseudo changes caused by viewpoint change. In this paper, we address this by…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Yunbin Tu , Liang Li , Li Su , Zheng-Jun Zha , Chenggang Yan , Qingming Huang

Remote sensing image change captioning (RSICC) aims to articulate the changes in objects of interest within bi-temporal remote sensing images using natural language. Given the limitations of current RSICC methods in expressing general…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yongshuo Zhu , Lu Li , Keyan Chen , Chenyang Liu , Fugen Zhou , Zhenwei Shi

Many vision problems require matching images of object instances across different domains. These include fine-grained sketch-based image retrieval (FG-SBIR) and Person Re-identification (person ReID). Existing approaches attempt to learn a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Qian Yu , Xiaobin Chang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales

Distinctive Image Captioning (DIC) -- generating distinctive captions that describe the unique details of a target image -- has received considerable attention over the last few years. A recent DIC work proposes to generate distinctive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Yangjun Mao , Long Chen , Zhihong Jiang , Dong Zhang , Zhimeng Zhang , Jian Shao , Jun Xiao

Composed Image Retrieval (CIR) is a task that retrieves images similar to a query, based on a provided textual modification. Current techniques rely on supervised learning for CIR models using labeled triplets of the reference image, text,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Young Kyun Jang , Donghyun Kim , Zihang Meng , Dat Huynh , Ser-Nam Lim

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 Qingzhong Wang , Antoni B. Chan

Image captioning is a multimodal task involving computer vision and natural language processing, where the goal is to learn a mapping from the image to its natural language description. In general, the mapping function is learned from a…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jiuxiang Gu , Shafiq Joty , Jianfei Cai , Gang Wang

In the information and communications technology (ICT) industry, training a domain-specific large language model (LLM) or constructing a retrieval-augmented generation system requires a substantial amount of high-value domain knowledge.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Lianying Chao , Kai Zhang , Haoran Cai , Sijie Wu , Xubin Li , Xin Chen

Image Captioning is a task that combines computer vision and natural language processing, where it aims to generate descriptive legends for images. It is a two-fold process relying on accurate image understanding and correct language…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Ahmed Elhagry , Karima Kadaoui

Infrared (IR) imaging offers advantages in several fields due to its unique ability of capturing content in extreme light conditions. However, the demanding hardware requirements of high-resolution IR sensors limit its widespread…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jingchao Peng , Thomas Bashford-Rogers , Zhuang Shao , Haitao Zhao , Aru Ranjan Singh , Abhishek Goswami , Kurt Debattista

A wide range of image captioning models has been developed, achieving significant improvement based on popular metrics, such as BLEU, CIDEr, and SPICE. However, although the generated captions can accurately describe the image, they are…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Jiuniu Wang , Wenjia Xu , Qingzhong Wang , Antoni B. Chan

Image captioning and cross-modal retrieval are examples of tasks that involve the joint analysis of visual and linguistic information. In connection to remote sensing imagery, these tasks can help non-expert users in extracting relevant…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 João Daniel Silva , João Magalhães , Devis Tuia , Bruno Martins

We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a…

Computation and Language · Computer Science 2015-08-11 Jack Hessel , Nicolas Savva , Michael J. Wilber

Unpaired Image Captioning (UIC) has been developed to learn image descriptions from unaligned vision-language sample pairs. Existing works usually tackle this task using adversarial learning and visual concept reward based on reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Peipei Zhu , Xiao Wang , Lin Zhu , Zhenglong Sun , Weishi Zheng , Yaowei Wang , Changwen Chen

While deep-learning models have been shown to perform well on image-to-text datasets, it is difficult to use them in practice for captioning images. This is because captions traditionally tend to be context-dependent and offer complementary…

Machine Learning · Computer Science 2023-06-07 Shinjini Ghosh , Sagnik Anupam

Image captioning, a challenging task where the machine automatically describes an image by sentences, has drawn significant attention in recent years. Despite the remarkable improvements of recent approaches, however, these methods are…

Multimedia · Computer Science 2020-01-14 Qianyu Feng , Yu Wu , Hehe Fan , Chenggang Yan , Yi Yang

Content-based image retrieval (CBIR) systems have emerged as crucial tools in the field of computer vision, allowing for image search based on visual content rather than relying solely on metadata. This survey paper presents a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Hamed Qazanfari , Mohammad M. AlyanNezhadi , Zohreh Nozari Khoshdaregi