中文
相关论文

相关论文: Caption-Matching: A Multimodal Approach for Cross-…

200 篇论文

Composed Image Retrieval (CIR) is an emerging yet challenging task that allows users to search for target images using a multimodal query, comprising a reference image and a modification text specifying the user's desired changes to the…

多媒体 · 计算机科学 2025-03-05 Xuemeng Song , Haoqiang Lin , Haokun Wen , Bohan Hou , Mingzhu Xu , Liqiang Nie

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Mingyu Zhang , Zixu Li , Zhiwei Chen , Zhiheng Fu , Xiaowei Zhu , Jiajia Nie , Yinwei Wei , Yupeng Hu

The objective of Content-Based Image Retrieval (CBIR) methods is essentially to extract, from large (image) databases, a specified number of images similar in visual and semantic content to a so-called query image. To bridge the semantic…

信息检索 · 计算机科学 2015-02-12 Smarajit Bose , Amita Pal , Jhimli Mallick , Sunil Kumar , Pratyaydipta Rudra

Change captioning aims to describe the difference between a pair of similar images. Its key challenge is how to learn a stable difference representation under pseudo changes caused by viewpoint change. In this paper, we address this by…

计算机视觉与模式识别 · 计算机科学 2023-09-29 Yunbin Tu , Liang Li , Li Su , Zheng-Jun Zha , Chenggang Yan , Qingming Huang

Remote sensing image change captioning (RSICC) aims to articulate the changes in objects of interest within bi-temporal remote sensing images using natural language. Given the limitations of current RSICC methods in expressing general…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Yongshuo Zhu , Lu Li , Keyan Chen , Chenyang Liu , Fugen Zhou , Zhenwei Shi

Many vision problems require matching images of object instances across different domains. These include fine-grained sketch-based image retrieval (FG-SBIR) and Person Re-identification (person ReID). Existing approaches attempt to learn a…

计算机视觉与模式识别 · 计算机科学 2018-04-06 Qian Yu , Xiaobin Chang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales

Distinctive Image Captioning (DIC) -- generating distinctive captions that describe the unique details of a target image -- has received considerable attention over the last few years. A recent DIC work proposes to generate distinctive…

计算机视觉与模式识别 · 计算机科学 2022-07-25 Yangjun Mao , Long Chen , Zhihong Jiang , Dong Zhang , Zhimeng Zhang , Jian Shao , Jun Xiao

Composed Image Retrieval (CIR) is a task that retrieves images similar to a query, based on a provided textual modification. Current techniques rely on supervised learning for CIR models using labeled triplets of the reference image, text,…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Young Kyun Jang , Donghyun Kim , Zihang Meng , Dat Huynh , Ser-Nam Lim

Image captioning is a challenging task that combines the field of computer vision and natural language processing. A variety of approaches have been proposed to achieve the goal of automatically describing an image, and recurrent neural…

计算机视觉与模式识别 · 计算机科学 2018-05-24 Qingzhong Wang , Antoni B. Chan

Image captioning is a multimodal task involving computer vision and natural language processing, where the goal is to learn a mapping from the image to its natural language description. In general, the mapping function is learned from a…

计算机视觉与模式识别 · 计算机科学 2018-07-19 Jiuxiang Gu , Shafiq Joty , Jianfei Cai , Gang Wang

In the information and communications technology (ICT) industry, training a domain-specific large language model (LLM) or constructing a retrieval-augmented generation system requires a substantial amount of high-value domain knowledge.…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Lianying Chao , Kai Zhang , Haoran Cai , Sijie Wu , Xubin Li , Xin Chen

Image Captioning is a task that combines computer vision and natural language processing, where it aims to generate descriptive legends for images. It is a two-fold process relying on accurate image understanding and correct language…

计算机视觉与模式识别 · 计算机科学 2021-07-29 Ahmed Elhagry , Karima Kadaoui

Infrared (IR) imaging offers advantages in several fields due to its unique ability of capturing content in extreme light conditions. However, the demanding hardware requirements of high-resolution IR sensors limit its widespread…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Jingchao Peng , Thomas Bashford-Rogers , Zhuang Shao , Haitao Zhao , Aru Ranjan Singh , Abhishek Goswami , Kurt Debattista

A wide range of image captioning models has been developed, achieving significant improvement based on popular metrics, such as BLEU, CIDEr, and SPICE. However, although the generated captions can accurately describe the image, they are…

计算机视觉与模式识别 · 计算机科学 2020-09-30 Jiuniu Wang , Wenjia Xu , Qingzhong Wang , Antoni B. Chan

Image captioning and cross-modal retrieval are examples of tasks that involve the joint analysis of visual and linguistic information. In connection to remote sensing imagery, these tasks can help non-expert users in extracting relevant…

计算机视觉与模式识别 · 计算机科学 2024-02-12 João Daniel Silva , João Magalhães , Devis Tuia , Bruno Martins

We examine the possibility that recent promising results in automatic caption generation are due primarily to language models. By varying image representation quality produced by a convolutional neural network, we find that a…

计算与语言 · 计算机科学 2015-08-11 Jack Hessel , Nicolas Savva , Michael J. Wilber

Unpaired Image Captioning (UIC) has been developed to learn image descriptions from unaligned vision-language sample pairs. Existing works usually tackle this task using adversarial learning and visual concept reward based on reinforcement…

计算机视觉与模式识别 · 计算机科学 2022-11-21 Peipei Zhu , Xiao Wang , Lin Zhu , Zhenglong Sun , Weishi Zheng , Yaowei Wang , Changwen Chen

While deep-learning models have been shown to perform well on image-to-text datasets, it is difficult to use them in practice for captioning images. This is because captions traditionally tend to be context-dependent and offer complementary…

机器学习 · 计算机科学 2023-06-07 Shinjini Ghosh , Sagnik Anupam

Image captioning, a challenging task where the machine automatically describes an image by sentences, has drawn significant attention in recent years. Despite the remarkable improvements of recent approaches, however, these methods are…

多媒体 · 计算机科学 2020-01-14 Qianyu Feng , Yu Wu , Hehe Fan , Chenggang Yan , Yi Yang

Content-based image retrieval (CBIR) systems have emerged as crucial tools in the field of computer vision, allowing for image search based on visual content rather than relying solely on metadata. This survey paper presents a comprehensive…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Hamed Qazanfari , Mohammad M. AlyanNezhadi , Zohreh Nozari Khoshdaregi