English
Related papers

Related papers: Image-text Retrieval: A Survey on Recent Research …

200 papers

Handwritten Text Recognition (HTR) has become an essential field within pattern recognition and machine learning, with applications spanning historical document preservation to modern data entry and accessibility solutions. The complexity…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Carlos Garrido-Munoz , Antonio Rios-Vila , Jorge Calvo-Zaragoza

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni

Deep learning-based models encounter challenges when processing long-tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Changyao Tian , Wenhai Wang , Xizhou Zhu , Jifeng Dai , Yu Qiao

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Naresh Kumar Lahajal , Harini S

Understanding the content of events occurring in the video and their inherent temporal logic is crucial for video-text retrieval. However, web-crawled pre-training datasets often lack sufficient event information, and the widely adopted…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zongyang Ma , Ziqi Zhang , Yuxin Chen , Zhongang Qi , Chunfeng Yuan , Bing Li , Yingmin Luo , Xu Li , Xiaojuan Qi , Ying Shan , Weiming Hu

Text-to-image generation has attracted significant interest from researchers and practitioners in recent years due to its widespread and diverse applications across various industries. Despite the progress made in the domain of vision and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Yutong Zhou , Nobutaka Shimada

Despite advances in multimodal learning, challenging benchmarks for mixed-modal image retrieval that combines visual and textual information are lacking. This paper introduces a novel benchmark to rigorously evaluate image retrieval that…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Cristian-Ioan Blaga , Paul Suganthan , Sahil Dua , Krishna Srinivasan , Enrique Alfonseca , Peter Dornbach , Tom Duerig , Imed Zitouni , Zhe Dong

Searching is an important tool of information gathering, if information is in the form of picture than it play a major role to take quick action and easy to memorize. This is a human tendency to retain more picture than text. The complexity…

Information Retrieval · Computer Science 2011-12-12 Anamika Sharma

Linguistic knowledge has brought great benefits to scene text recognition by providing semantics to refine character sequences. However, since linguistic knowledge has been applied individually on the output sequence, previous methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Byeonghu Na , Yoonsik Kim , Sungrae Park

Machine learning plays a role in many aspects of modern IR systems, and deep learning is applied in all of them. The fast pace of modern-day research has given rise to many different approaches for many different IR problems. The amount of…

Information Retrieval · Computer Science 2017-07-14 Tom Kenter , Alexey Borisov , Christophe Van Gysel , Mostafa Dehghani , Maarten de Rijke , Bhaskar Mitra

Acquiring valuable data from the rapidly expanding information on the internet has become a significant concern, and recommender systems have emerged as a widely used and effective tool for helping users discover items of interest. The…

Information Retrieval · Computer Science 2025-02-25 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Wei Wang , Xiping Hu , Steven Hoi , Edith Ngai

Despite recent advancements in Multilingual Information Retrieval (MLIR), a significant gap remains between research and practical deployment. Many studies assess MLIR performance in isolated settings, limiting their applicability to…

Information Retrieval · Computer Science 2025-10-15 Vera Pavlova , Mohammed Makhlouf

Large-scale Vision-Language Models (LVLMs) process both images and text, excelling in multimodal tasks such as image captioning and description generation. However, while these models excel at generating factual content, their ability to…

Image-Text Retrieval (ITR) systems are central to multimodal information access, with Vision-Language Models (VLMs) showing strong performance on standard benchmarks. However, these benchmarks predominantly rely on coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Mariya Hendriksen , Shuo Zhang , Ridho Reinanda , Mohamed Yahya , Edgar Meij , Maarten de Rijke

The rapid development of the autonomous driving industry has led to a significant accumulation of autonomous driving data. Consequently, there comes a growing demand for retrieving data to provide specialized optimization. However, directly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Tao Tang , Dafeng Wei , Zhengyu Jia , Tian Gao , Changwei Cai , Chengkai Hou , Peng Jia , Kun Zhan , Haiyang Sun , Jingchen Fan , Yixing Zhao , Fu Liu , Xiaodan Liang , Xianpeng Lang , Yang Wang

Information retrieval aims to find information that meets users' needs from the corpus. Different needs correspond to different IR tasks such as document retrieval, open-domain question answering, retrieval-based dialogue, etc., while they…

Information Retrieval · Computer Science 2023-12-19 Shicheng Xu , Liang Pang , Huawei Shen , Xueqi Cheng

This study deals with the problem of information retrieval (IR) for Vietnamese legal texts. Despite being well researched in many languages, information retrieval has still not received much attention from the Vietnamese research community.…

Computation and Language · Computer Science 2022-11-15 Nhat-Minh Pham , Ha-Thanh Nguyen , Trong-Hop Do

Text retrieval is a long-standing research topic on information seeking, where a system is required to return relevant information resources to user's queries in natural language. From classic retrieval methods to learning-based ranking…

Information Retrieval · Computer Science 2022-11-29 Wayne Xin Zhao , Jing Liu , Ruiyang Ren , Ji-Rong Wen

Image captioning models often suffer from performance degradation when applied to novel datasets, as they are typically trained on domain-specific data. To enhance generalization in out-of-domain scenarios, retrieval-augmented approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hao Wu , Zhihang Zhong , Xiao Sun

Scene text recognition (STR) is a challenging problem due to the imperfect imagery conditions in natural images. State-of-the-art methods utilize both visual cues and linguistic knowledge to tackle this challenging problem. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Xiaojie Chu , Yongtao Wang