English
Related papers

Related papers: Self-Supervised Cross-Modal Text-Image Time Series…

200 papers

How humans can effectively and efficiently acquire images has always been a perennial question. A classic solution is text-to-image retrieval from an existing database; however, the limited database typically lacks creativity. By contrast,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Leigang Qu , Haochuan Li , Tan Wang , Wenjie Wang , Yongqi Li , Liqiang Nie , Tat-Seng Chua

Until recently, the number of public real-world text images was insufficient for training scene text recognizers. Therefore, most modern training methods rely on synthetic data and operate in a fully supervised manner. Nevertheless, the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Aviad Aberdam , Roy Ganz , Shai Mazor , Ron Litman

Under the flourishing development in performance, current image-text retrieval methods suffer from $N$-related time complexity, which hinders their application in practice. Targeting at efficiency improvement, this paper presents a simple…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Min Cao , Yang Bai , Jingyao Wang , Ziqiang Cao , Liqiang Nie , Min Zhang

Image Super-Resolution (SR) aims to reconstruct high-resolution images from degraded low-resolution inputs. While diffusion-based SR methods offer powerful generative capabilities, their performance heavily depends on how semantic priors…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Lei Jiang , Xin Liu , Xinze Tong , Zhiliang Li , Jie Liu , Jie Tang , Gangshan Wu

Remote sensing (RS) image-text retrieval plays a critical role in understanding massive RS imagery. However, the dense multi-object distribution and complex backgrounds in RS imagery make it difficult to simultaneously achieve fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xi Chen , Xu Chen , Xiangyang Jia , Xu Zhang , Shuquan Wei , Wei Wang

Scene Text Image Super-Resolution (STISR) aims to restore high-resolution details in low-resolution text images, which is crucial for both human readability and machine recognition. Existing methods, however, often depend on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Axi Niu , Kang Zhang , Qingsen Yan , Hao Jin , Jinqiu Sun , Yanning Zhang

Despite the evolution of deep-learning-based visual-textual processing systems, precise multi-modal matching remains a challenging task. In this work, we tackle the task of cross-modal retrieval through image-sentence matching based on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Nicola Messina , Giuseppe Amato , Andrea Esuli , Fabrizio Falchi , Claudio Gennaro , Stéphane Marchand-Maillet

Composed Image Retrieval (CIR) is a complex task that retrieves images using a query, which is configured with an image and a caption that describes desired modifications to that image. Supervised CIR approaches have shown strong…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Young Kyun Jang , Dat Huynh , Ashish Shah , Wen-Kai Chen , Ser-Nam Lim

Cross-modal retrieval has become popular in recent years, particularly with the rise of multimedia. Generally, the information from each modality exhibits distinct representations and semantic information, which makes feature tends to be in…

Information Retrieval · Computer Science 2023-08-29 Zichen Yuan , Qi Shen , Bingyi Zheng , Yuting Liu , Linying Jiang , Guibing Guo

In this work we introduce a cross modal image retrieval system that allows both text and sketch as input modalities for the query. A cross-modal deep network architecture is formulated to jointly model the sketch and text input modalities…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Sounak Dey , Anjan Dutta , Suman K. Ghosh , Ernest Valveny , Josep Lladós , Umapada Pal

Our objective is language-based search of large-scale image and video datasets. For this task, the approach that consists of independently mapping text and vision to a joint embedding space, a.k.a. dual encoders, is attractive as retrieval…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Antoine Miech , Jean-Baptiste Alayrac , Ivan Laptev , Josef Sivic , Andrew Zisserman

Content-Based Image Retrieval (CIR) aims to search for a target image by concurrently comprehending the composition of an example image and a complementary text, which potentially impacts a wide variety of real-world applications, such as…

Artificial Intelligence · Computer Science 2022-07-12 Wenqiao Zhang , Jiannan Guo , Mengze Li , Haochen Shi , Shengyu Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang

Image-text matching (ITM) is a fundamental problem in computer vision. The key issue lies in jointly learning the visual and textual representation to estimate their similarity accurately. Most existing methods focus on feature enhancement…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xuri Ge , Fuhai Chen , Songpei Xu , Fuxiang Tao , Jie Wang , Joemon M. Jose

Remote sensing image super-resolution (RSISR) is a crucial task in remote sensing image processing, aiming to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts. Despite the growing number of RSISR methods…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Yunliang Qi , Meng Lou , Yimin Liu , Lu Li , Zhen Yang , Wen Nie

The task of composed image retrieval (CIR) aims to retrieve images based on the query image and the text describing the users' intent. Existing methods have made great progress with the advanced large vision-language (VL) model in CIR task,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yongchao Du , Min Wang , Wengang Zhou , Shuping Hui , Houqiang Li

Remote Sensing Image Super-Resolution (RSISR) reconstructs high-resolution (HR) remote sensing images from low-resolution inputs to support fine-grained ground object interpretation. Existing methods face three key challenges: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Yide Liu , Haijiang Sun , Xiaowen Zhang , Qiaoyuan Liu , Zhouchang Chen , Chongzhuo Xiao

Single image super-resolution (SISR) is a challenging ill-posed problem that aims to up-sample a given low-resolution (LR) image to a high-resolution (HR) counterpart. Due to the difficulty in obtaining real LR-HR training pairs, recent…

Image and Video Processing · Electrical Eng. & Systems 2023-09-01 Reyhaneh Neshatavar , Mohsen Yavartanoo , Sanghyun Son , Kyoung Mu Lee

Image Super-Resolution (ISR), which aims at recovering High-Resolution (HR) images from the corresponding Low-Resolution (LR) counterparts. Although recent progress in ISR has been remarkable. However, they are way too computationally…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jie Cai , Zibo Meng , Jiaming Ding , Chiu Man Ho

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

In this paper, we present TMR, a simple yet effective approach for text to 3D human motion retrieval. While previous work has only treated retrieval as a proxy evaluation metric, we tackle it as a standalone task. Our method extends the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Mathis Petrovich , Michael J. Black , Gül Varol