English
Related papers

Related papers: Self-Enhancement Improves Text-Image Retrieval in …

200 papers

The explosive growth of video streaming presents challenges in achieving high accuracy and low training costs for video-language retrieval. However, existing methods rely on large-scale pre-training to improve video retrieval performance,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Haoyu Zhao , Jiaxi Gu , Shicong Wang , Xing Zhang , Hang Xu , Zuxuan Wu , Yu-Gang Jiang

Cloth changing person re-identification(Re-ID) can work under more complicated scenarios with higher security than normal Re-ID and biometric techniques and is therefore extremely valuable in applications. Meanwhile, higher flexibility in…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Renjie Zhang , Yu Fang , Huaxin Song , Fangbin Wan , Yanwei Fu , Hirokazu Kato , Yang Wu

Content-Based Image Retrieval (CIR) aims to search for a target image by concurrently comprehending the composition of an example image and a complementary text, which potentially impacts a wide variety of real-world applications, such as…

Artificial Intelligence · Computer Science 2022-07-12 Wenqiao Zhang , Jiannan Guo , Mengze Li , Haochen Shi , Shengyu Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang

Weakly supervised multimodal video anomaly detection has gained significant attention, yet the potential of the text modality remains under-explored. Text provides explicit semantic information that can enhance anomaly characterization and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Shengyang Sun , Jiashen Hua , Junyi Feng , Xiaojin Gong

Image captioning models often suffer from performance degradation when applied to novel datasets, as they are typically trained on domain-specific data. To enhance generalization in out-of-domain scenarios, retrieval-augmented approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hao Wu , Zhihang Zhong , Xiao Sun

Text-based person anomaly retrieval has emerged as a challenging task, with most existing approaches relying on complex deep-learning techniques. This raises a research question: How can the model be optimized to achieve greater…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tien-Huy Nguyen , Huu-Loc Tran , Huu-Phong Phan-Nguyen , Quang-Vinh Dinh

A big convergence of language, vision, and multimodal pretraining is emerging. In this work, we introduce a general-purpose multimodal foundation model BEiT-3, which achieves state-of-the-art transfer performance on both vision and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Wenhui Wang , Hangbo Bao , Li Dong , Johan Bjorck , Zhiliang Peng , Qiang Liu , Kriti Aggarwal , Owais Khan Mohammed , Saksham Singhal , Subhojit Som , Furu Wei

Though deep learning based scene text detection has achieved great progress, well-trained detectors suffer from severe performance degradation for different domains. In general, a tremendous amount of data is indispensable to train the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Yudi Chen , Wei Wang , Yu Zhou , Fei Yang , Dongbao Yang , Weiping Wang

Text-to-image retrieval (TIR) aims to find relevant images based on a textual query, but existing approaches are primarily based on whole-image captions and lack interpretability. Meanwhile, referring expression segmentation (RES) enables…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Li-Cheng Shen , Jih-Kang Hsieh , Wei-Hua Li , Chu-Song Chen

Activity image-to-video retrieval task aims to retrieve videos containing the similar activity as the query image, which is a challenging task because videos generally have many background segments irrelevant to the activity. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Ruicong Xu , Li Niu , Jianfu Zhang , Liqing Zhang

Cross-modal text-molecule retrieval task bridges molecule structures and natural language descriptions. Existing methods predominantly focus on aligning text modality and molecule modality, yet they overlook adaptively adjusting the…

Computation and Language · Computer Science 2025-02-18 Hongyan Wu , Peijian Zeng , Weixiong Zheng , Lianxi Wang , Nankai Lin , Shengyi Jiang , Aimin Yang

Every hour, huge amounts of visual contents are posted on social media and user-generated content platforms. To find relevant videos by means of a natural language query, text-video retrieval methods have received increased attention over…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Alex Falcon , Giuseppe Serra , Oswald Lanz

Long-form video understanding presents significant challenges for interactive retrieval systems, as conventional methods struggle to process extensive video content efficiently. Existing approaches often rely on single models, inefficient…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Huu-Loc Tran , Tinh-Anh Nguyen-Nhu , Huu-Phong Phan-Nguyen , Tien-Huy Nguyen , Nhat-Minh Nguyen-Dich , Anh Dao , Huy-Duc Do , Quan Nguyen , Hoang M. Le , Quang-Vinh Dinh

Interactive Text-to-image retrieval (I-TIR) is an important enabler for a wide range of state-of-the-art services in domains such as e-commerce and education. However, current methods rely on finetuned Multimodal Large Language Models…

Information Retrieval · Computer Science 2025-07-11 Zijun Long , Kangheng Liang , Gerardo Aragon-Camarasa , Richard Mccreadie , Paul Henderson

In this report, we introduce the Qwen3-VL-Embedding and Qwen3-VL-Reranker model series, the latest extensions of the Qwen family built on the Qwen3-VL foundation model. Together, they provide an end-to-end pipeline for high-precision…

Computation and Language · Computer Science 2026-01-21 Mingxin Li , Yanzhao Zhang , Dingkun Long , Keqin Chen , Sibo Song , Shuai Bai , Zhibo Yang , Pengjun Xie , An Yang , Dayiheng Liu , Jingren Zhou , Junyang Lin

As retrieval-augmented generation (RAG) becomes more widespread, the role of retrieval is shifting from retrieving information for human browsing to retrieving context for AI reasoning. This shift creates more complex search environments,…

Computation and Language · Computer Science 2026-01-05 Jiawei Zhou , Lei Chen

Unlike traditional Multimodal Class-Incremental Learning (MCIL) methods that focus only on vision and text, this paper explores MCIL across vision, audio and text modalities, addressing challenges in integrating complementary information…

Machine Learning · Computer Science 2025-06-13 Yukun Chen , Zihuan Qiu , Fanman Meng , Hongliang Li , Linfeng Xu , Qingbo Wu

Cross-modal retrieval between visual data and natural language description remains a long-standing challenge in multimedia. While recent image-text retrieval methods offer great promise by learning deep representations aligned across…

The rapid growth of 3D digital content necessitates expandable recognition systems for open-world scenarios. However, existing 3D class-incremental learning methods struggle under extreme data scarcity due to geometric misalignment and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Tuo Xiang , Xuemiao Xu , Bangzhen Liu , Jinyi Li , Yong Li , Shengfeng He

Composed Image Retrieval (CIR) is the task of retrieving images matching a reference image augmented with a text, where the text describes changes to the reference image in natural language. Traditionally, models designed for CIR have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Yiqun Duan , Sameera Ramasinghe , Stephen Gould , Ajanthan Thalaiyasingam