English
Related papers

Related papers: Recurrence Meets Transformers for Universal Multim…

200 papers

This article aims to provide the information retrieval community with some reflections on recent advances in retrieval learning by analyzing the reproducibility of image-text retrieval models. Due to the increase of multimodal data over the…

Information Retrieval · Computer Science 2022-08-30 Jun Rao , Fei Wang , Liang Ding , Shuhan Qi , Yibing Zhan , Weifeng Liu , Dacheng Tao

Current text-video retrieval methods mainly rely on cross-modal matching between queries and videos to calculate their similarity scores, which are then sorted to obtain retrieval results. This method considers the matching between each…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yili Li , Jing Yu , Keke Gai , Bang Liu , Gang Xiong , Qi Wu

Despite the prevalence of retrieval-augmented language models (RALMs), the seamless integration of these models with retrieval mechanisms to enhance performance in document-based tasks remains challenging. While some post-retrieval…

Computation and Language · Computer Science 2024-06-05 Chuankai Xu , Dongming Zhao , Bo Wang , Hanwen Xing

Recent multimodal large language models (MLLMs) still struggle with long document understanding due to two fundamental challenges: information interference from abundant irrelevant content, and the quadratic computational cost of…

Computation and Language · Computer Science 2025-11-14 Yongxin Shi , Jiapeng Wang , Zeyu Shan , Dezhi Peng , Zening Lin , Lianwen Jin

The recent advancements in generative language models have demonstrated their ability to memorize knowledge from documents and recall knowledge to respond to user queries effectively. Building upon this capability, we propose to enable…

Multimedia · Computer Science 2024-02-19 Yongqi Li , Wenjie Wang , Leigang Qu , Liqiang Nie , Wenjie Li , Tat-Seng Chua

While large language models (LLMs) demonstrate impressive capabilities, their reliance on parametric knowledge often leads to factual inaccuracies. Retrieval-Augmented Generation (RAG) mitigates this by leveraging external documents, yet…

Computation and Language · Computer Science 2025-10-07 Lingnan Xu , Chong Feng , Kaiyuan Zhang , Liu Zhengyong , Wenqiang Xu , Fanqing Meng

Most existing cross-modal retrieval methods employ two-stream encoders with different architectures for images and texts, \textit{e.g.}, CNN for images and RNN/Transformer for texts. Such discrepancy in architectures may induce different…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Yi Bin , Haoxuan Li , Yahui Xu , Xing Xu , Yang Yang , Heng Tao Shen

Multimodal embedding models have been crucial in enabling various downstream tasks such as semantic similarity, information retrieval, and clustering over different modalities. However, existing multimodal embeddings like VLM2Vec, E5-V, GME…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Rui Meng , Ziyan Jiang , Ye Liu , Mingyi Su , Xinyi Yang , Yuepeng Fu , Can Qin , Zeyuan Chen , Ran Xu , Caiming Xiong , Yingbo Zhou , Wenhu Chen , Semih Yavuz

The rapid growth of video content demands efficient and precise retrieval systems. While vision-language models (VLMs) excel in representation learning, they often struggle with adaptive, time-sensitive video retrieval. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yicheng Duan , Xi Huang , Duo Chen

Retrieval-Augmented Generation (RAG) integrates non-parametric knowledge into Large Language Models (LLMs), typically from unstructured texts and structured graphs. While recent progress has advanced text-based RAG to multi-turn reasoning…

Computation and Language · Computer Science 2025-12-11 Yucan Guo , Miao Su , Saiping Guan , Zihao Sun , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Text-to-video retrieval answers user queries through searches based on concepts and embeddings. However, due to limitations in the size of the concept bank and the amount of training data, answering queries in the wild is not always…

Multimedia · Computer Science 2025-08-14 Jiaxin Wu , Chong-Wah Ngo , Wing-Kwong Chan , Sheng-Hua Zhong , Xiong-Yong Wei , Qing Li

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

We present a new state-of-the-art on the text to video retrieval task on MSRVTT and LSMDC benchmarks where our model outperforms all previous solutions by a large margin. Moreover, state-of-the-art results are achieved with a single model…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Maksim Dzabraev , Maksim Kalashnikov , Stepan Komkov , Aleksandr Petiushko

Multimodal encoders have pushed the boundaries of visual document retrieval, matching textual query tokens directly to image patches and achieving state-of-the-art performance on public benchmarks. Recent models relying on this paradigm…

Computation and Language · Computer Science 2026-04-08 Omri Uzan , Asaf Yehudai , Roi pony , Eyal Shnarch , Ariel Gera

In this paper, we introduce Technical-Embeddings, a novel framework designed to optimize semantic retrieval in technical documentation, with applications in both hardware and software development. Our approach addresses the challenges of…

Information Retrieval · Computer Science 2025-09-05 Songjiang Lai , Tsun-Hin Cheung , Ka-Chun Fung , Kaiwen Xue , Kwan-Ho Lin , Yan-Ming Choi , Vincent Ng , Kin-Man Lam

Large language models are powerful text processors and reasoners, but are still subject to limitations including outdated knowledge and hallucinations, which necessitates connecting them to the world. Retrieval-augmented large language…

Computation and Language · Computer Science 2023-10-24 Zhihong Shao , Yeyun Gong , Yelong Shen , Minlie Huang , Nan Duan , Weizhu Chen

Video-text retrieval is a class of cross-modal representation learning problems, where the goal is to select the video which corresponds to the text query between a given text query and a pool of candidate videos. The contrastive paradigm…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Jinbin Bai , Chunhui Liu , Feiyue Ni , Haofan Wang , Mengying Hu , Xiaofeng Guo , Lele Cheng

Conversational search requires accurate interpretation of user intent from complex multi-turn contexts. This paper presents ChatRetriever, which inherits the strong generalization capability of large language models to robustly represent…

Information Retrieval · Computer Science 2024-04-23 Kelong Mao , Chenlong Deng , Haonan Chen , Fengran Mo , Zheng Liu , Tetsuya Sakai , Zhicheng Dou

Our objective is language-based search of large-scale image and video datasets. For this task, the approach that consists of independently mapping text and vision to a joint embedding space, a.k.a. dual encoders, is attractive as retrieval…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Antoine Miech , Jean-Baptiste Alayrac , Ivan Laptev , Josef Sivic , Andrew Zisserman

Universal Multimodal Retrieval (UMR) seeks any-to-any search across text and vision, yet modern embedding models remain brittle when queries require latent reasoning (e.g., resolving underspecified references or matching compositional…

Information Retrieval · Computer Science 2026-02-10 Jianrui Zhang , Anirudh Sundara Rajan , Brandon Han , Soochahn Lee , Sukanta Ganguly , Yong Jae Lee