English
Related papers

Related papers: Rethinking the Role of Token Retrieval in Multi-Ve…

200 papers

Retrieving specific information from a large corpus of documents is a prevalent industrial use case of modern AI, notably due to the popularity of Retrieval-Augmented Generation (RAG) systems. Although neural document retrieval models have…

Information Retrieval · Computer Science 2025-12-17 Paul Teiletche , Quentin Macé , Max Conti , Antonio Loison , Gautier Viaud , Pierre Colombo , Manuel Faysse

Retrieving known items from vague descriptions, Tip-of-the-Tongue (ToT) retrieval, remains a significant challenge. We propose using a single call to a generic 8B-parameter LLM for query reformulation, bridging the gap between ill-formed…

Information Retrieval · Computer Science 2026-02-12 Debayan Mukhopadhyay , Utshab Kumar Ghosh , Shubham Chatterjee

We study the problem of retrieval with instructions, where users of a retrieval system explicitly describe their intent along with their queries. We aim to develop a general-purpose task-aware retrieval system using multi-task instruction…

Computation and Language · Computer Science 2022-12-21 Akari Asai , Timo Schick , Patrick Lewis , Xilun Chen , Gautier Izacard , Sebastian Riedel , Hannaneh Hajishirzi , Wen-tau Yih

Segmentation-based methods are widely used for scene text detection due to their superiority in describing arbitrary-shaped text instances. However, two major problems still exist: 1) current label generation techniques are mostly empirical…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Chenwei Cui , Liangfu Lu , Zhiyuan Tan , Amir Hussain

The NLI4CT task aims to entail hypotheses based on Clinical Trial Reports (CTRs) and retrieve the corresponding evidence supporting the justification. This task poses a significant challenge, as verifying hypotheses in the NLI4CT task…

Computation and Language · Computer Science 2023-06-05 Yuxuan Zhou , Ziyu Jin , Meiwei Li , Miao Li , Xien Liu , Xinxin You , Ji Wu

DeepSeek-OCR leverages visual-text compression to reduce long-text processing costs and accelerate inference, yet visual tokens remain prone to redundant textual and structural information. Moreover, current token pruning methods for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Ben Wan , Yan Feng , Zihan Tang , Weizhe Huang , Yuting Zeng , Jia Wang , Tongxuan Liu

Conversational context understanding aims to recognize the real intention of user from the conversation history, which is critical for building the dialogue system. However, the multi-turn conversation understanding in open domain is still…

Computation and Language · Computer Science 2020-04-14 Shuangyong Song , Chao Wang , Qianqian Xie , Xinxing Zu , Huan Chen , Haiqing Chen

Retrieval-augmented generation has achieved strong performance on knowledge-intensive tasks where query-document relevance can be identified through direct lexical or semantic matches. However, many real-world queries involve abstract…

Information Retrieval · Computer Science 2026-04-03 Duolin Sun , Meixiu Long , Dan Yang , Junjie Wang , Yecheng Luo , Yue Shen , Jian Wang , Hualei Zhou , Chunxiao Guo , Peng Wei , Jiahai Wang , Jinjie Gu

Lowering the numerical precision of model parameters and computations is widely adopted to improve the efficiency of retrieval systems. However, when computing relevance scores between the query and documents in low-precision, we observe…

Information Retrieval · Computer Science 2026-04-14 Kisu Yang , Yoonna Jang , Hwanseok Jang , Kenneth Choi , Isabelle Augenstein , Heuiseok Lim

In this work we focus on multi-turn passage retrieval as a crucial component of conversational search. One of the key challenges in multi-turn passage retrieval comes from the fact that the current turn query is often underspecified due to…

Information Retrieval · Computer Science 2020-05-26 Nikos Voskarides , Dan Li , Pengjie Ren , Evangelos Kanoulas , Maarten de Rijke

Multi-vector dense models, such as ColBERT, have proven highly effective in information retrieval. ColBERT's late interaction scoring approximates the joint query-document attention seen in cross-encoders while maintaining inference…

Neural information retrieval (IR) has greatly advanced search and other knowledge-intensive language tasks. While many neural IR methods encode queries and documents into single-vector representations, late interaction models produce…

Information Retrieval · Computer Science 2022-07-12 Keshav Santhanam , Omar Khattab , Jon Saad-Falcon , Christopher Potts , Matei Zaharia

The rise of multi-modal search requests from users has highlighted the importance of multi-modal retrieval (i.e. image-to-text or text-to-image retrieval), yet the more complex task of image-to-multi-modal retrieval, crucial for many…

Information Retrieval · Computer Science 2024-06-11 Zida Cheng , Chen Ju , Shuai Xiao , Xu Chen , Zhonghua Zhai , Xiaoyi Zeng , Weilin Huang , Junchi Yan

Event extraction, the technology that aims to automatically get the structural information from documents, has attracted more and more attention in many fields. Most existing works discuss this issue with the token-level multi-label…

Computation and Language · Computer Science 2022-01-11 Zhuo Xu , Yue Wang , Lu Bai , Lixin Cui

Recent research has shown that mixed-initiative conversational search, based on the interaction between users and computers to clarify and improve a query, provides enormous advantages. Nonetheless, incorporating additional information…

Computation and Language · Computer Science 2021-09-23 Oleg Borisov , Mohammad Aliannejadi , Fabio Crestani

Retrieve-and-rerank is a prevalent framework in neural information retrieval, wherein a bi-encoder network initially retrieves a pre-defined number of candidates (e.g., K=100), which are then reranked by a more powerful cross-encoder model.…

Information Retrieval · Computer Science 2024-05-29 Revanth Gangi Reddy , Pradeep Dasigi , Md Arafat Sultan , Arman Cohan , Avirup Sil , Heng Ji , Hannaneh Hajishirzi

Recent work in cross-language information retrieval (CLIR), where queries and documents are in different languages, has shown the benefit of the Translate-Distill framework that trains a cross-language neural dual-encoder model using…

Information Retrieval · Computer Science 2024-05-03 Eugene Yang , Dawn Lawrie , James Mayfield

Talent search is a cornerstone of modern recruitment systems, yet existing approaches often struggle to capture nuanced job-specific preferences, model recruiter behavior at a fine-grained level, and mitigate noise from subjective human…

Information Retrieval · Computer Science 2025-12-02 Jihang Li , Bing Xu , Zulong Chen , Chuanfei Xu , Minping Chen , Suyu Liu , Ying Zhou , Zeyi Wen

Benchmarks that reflect the diversity and complexity of real-world documents are essential for accurately evaluating Automatic Text Recognition (ATR) systems, especially Vision-Large Language Models (vLLMs). Although recent models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mélodie Boillet , Solène Tarride , Christopher Kermorvant

Although reward models have been successful in improving multimodal large language models, the reward models themselves remain brutal and contain minimal information. Notably, existing reward models only mimic human annotations by assigning…

Machine Learning · Computer Science 2025-02-26 Deqing Fu , Tong Xiao , Rui Wang , Wang Zhu , Pengchuan Zhang , Guan Pang , Robin Jia , Lawrence Chen