English
Related papers

Related papers: Improving Text-based Person Search via Part-level …

200 papers

Cross-modal retrieval between visual data and natural language description remains a long-standing challenge in multimedia. While recent image-text retrieval methods offer great promise by learning deep representations aligned across…

Searching persons in large-scale image databases with the query of natural language description has important applications in video surveillance. Existing methods mainly focused on searching persons with image-based or attribute-based…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Shuang Li , Tong Xiao , Hongsheng Li , Bolei Zhou , Dayu Yue , Xiaogang Wang

Fine-grained text-to-image retrieval aims to retrieve a fine-grained target image with a given text query. Existing methods typically assume that each training image is accurately depicted by its textual descriptions. However, textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Zehong Ma , Hao Chen , Wei Zeng , Limin Su , Shiliang Zhang

This paper addresses the gap between general-purpose text embeddings and the specific demands of item retrieval tasks. We demonstrate the shortcomings of existing models in capturing the nuances necessary for zero-shot performance on item…

Information Retrieval · Computer Science 2024-03-01 Yuxuan Lei , Jianxun Lian , Jing Yao , Mingqi Wu , Defu Lian , Xing Xie

Text-based person retrieval aims to identify the specific persons using textual descriptions as queries. Existing ad vanced methods typically depend on vision-language pre trained (VLP) models to facilitate effective cross-modal alignment.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bin Kang , Bin Chen , Junjie Wang , Yong Xu

Textual-visual cross-modal retrieval has been a hot research topic in both computer vision and natural language processing communities. Learning appropriate representations for multi-modal data is crucial for the cross-modal retrieval…

Computer Vision and Pattern Recognition · Computer Science 2018-06-14 Jiuxiang Gu , Jianfei Cai , Shafiq Joty , Li Niu , Gang Wang

Text-based person search (TBPS) is of significant importance in intelligent surveillance, which aims to retrieve pedestrian images with high semantic relevance to a given text description. This retrieval task is characterized with both…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Zhong Ji , Junhua Hu , Deyin Liu , Lin Yuanbo Wu , Ye zhao

Scene text retrieval aims to localize and search all text instances from an image gallery, which are the same or similar to a given query text. Such a task is usually realized by matching a query text to the recognized words, outputted by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Hao Wang , Xiang Bai , Mingkun Yang , Shenggao Zhu , Jing Wang , Wenyu Liu

Text-based person anomaly retrieval has emerged as a challenging task, with most existing approaches relying on complex deep-learning techniques. This raises a research question: How can the model be optimized to achieve greater…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tien-Huy Nguyen , Huu-Loc Tran , Huu-Phong Phan-Nguyen , Quang-Vinh Dinh

Text-based person re-identification (Re-ID) is a challenging topic in the field of complex multimodal analysis, its ultimate aim is to recognize specific pedestrians by scrutinizing attributes/natural language descriptions. Despite the wide…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Fanzhi Jiang , Su Yang , Mark W. Jones , Liumei Zhang

We consider the problem of person search in unconstrained scene images. Existing methods usually focus on improving the person detection accuracy to mitigate negative effects imposed by misalignment, mis-detections, and false alarms…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Xu Lan , Xiatian Zhu , Shaogang Gong

End-to-end person search aims to jointly detect and re-identify a target person in raw scene images with a unified model. The detection task unifies all persons while the re-id task discriminates different identities, resulting in conflict…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pengcheng Zhang , Xiao Bai , Jin Zheng , Xin Ning

Text-based Person Search (TBPS) aims to retrieve the person images using natural language descriptions. Recently, Contrastive Language Image Pretraining (CLIP), a universal large cross-modal vision-language pre-training model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Min Cao , Yang Bai , Ziyin Zeng , Mang Ye , Min Zhang

Text contained in an image carries high-level semantics that can be exploited to achieve richer image understanding. In particular, the mere presence of text provides strong guiding content that should be employed to tackle a diversity of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Andres Mafla , Sounak Dey , Ali Furkan Biten , Lluis Gomez , Dimosthenis Karatzas

With growing public safety demands, text-based person anomaly search has emerged as a critical task, aiming to retrieve individuals with abnormal behaviors via natural language descriptions. Unlike conventional person search, this task…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Hao Ju , Hu Zhang , Zhedong Zheng

We propose and demonstrate a representation learning approach by maximizing the mutual information between local features of images and text. The goal of this approach is to learn useful image representations by taking advantage of the rich…

Image and Video Processing · Electrical Eng. & Systems 2021-12-16 Ruizhi Liao , Daniel Moyer , Miriam Cha , Keegan Quigley , Seth Berkowitz , Steven Horng , Polina Golland , William M. Wells

Classical person re-identification approaches assume that a person of interest has appeared across different cameras and can be queried by one of the existing images. However, in real-world surveillance scenarios, frequently no visual…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Ammarah Farooq , Muhammad Awais , Fei Yan , Josef Kittler , Ali Akbari , Syed Safwan Khalid

Current image-text retrieval methods have demonstrated impressive performance in recent years. However, they still face two problems: the inter-modal matching missing problem and the intra-modal semantic loss problem. These problems can…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hailang Huang , Zhijie Nie , Ziqiao Wang , Ziyu Shang

Learning a good representation of text is key to many recommendation applications. Examples include news recommendation where texts to be recommended are constantly published everyday. However, most existing recommendation techniques, such…

Information Retrieval · Computer Science 2017-06-27 Ting Chen , Liangjie Hong , Yue Shi , Yizhou Sun

In this paper we study the problem of content-based image retrieval. In this problem, the most popular performance measure is the top precision measure, and the most important component of a retrieval system is the similarity function used…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Ru-Ze Liang , Lihui Shi , Haoxiang Wang , Jiandong Meng , Jim Jing-Yan Wang , Qingquan Sun , Yi Gu