English
Related papers

Related papers: Rethinking the Role of Token Retrieval in Multi-Ve…

200 papers

We present an approach to ranking with dense representations that applies knowledge distillation to improve the recently proposed late-interaction ColBERT model. Specifically, we distill the knowledge from ColBERT's expressive MaxSim…

Information Retrieval · Computer Science 2020-10-23 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Extreme multi-label text classification (XMC) seeks to find relevant labels from an extreme large label collection for a given text input. Many real-world applications can be formulated as XMC problems, such as recommendation systems,…

Machine Learning · Computer Science 2021-11-01 Jiong Zhang , Wei-cheng Chang , Hsiang-fu Yu , Inderjit S. Dhillon

Engineering rulebooks and technical standards contain multimodal information like dense text, tables, and illustrations that are challenging for retrieval augmented generation (RAG) systems. Building upon the DesignQA framework [1], which…

Information Retrieval · Computer Science 2026-05-28 Kiarash Naghavi Khanghah , Hoang Anh Nguyen , Anna C. Doris , Amir Mohammad Vahedi , Daniele Grandi , Faez Ahmed , Hongyi Xu

Generative retrieval shed light on a new paradigm of document retrieval, aiming to directly generate the identifier of a relevant document for a query. While it takes advantage of bypassing the construction of auxiliary index structures,…

Information Retrieval · Computer Science 2025-06-03 Sunkyung Lee , Minjin Choi , Jongwuk Lee

Table Retrieval (TR) has traditionally been formulated as an ad-hoc retrieval problem, where relevance is primarily determined by topical semantic similarity. With the growing adoption of LLM-based agentic systems, access to structured data…

Information Retrieval · Computer Science 2026-05-04 Rihui Jin , Yuchen Lu , Ting Zhang , Jun Wang , Kuicai Dong , Zhaocheng Du , Dongping Liu , Gang Wang , Yong Liu , Guilin Qi

Traditional information retrieval (IR) methods excel at textual and semantic matching but struggle in reasoning-intensive retrieval tasks that require multi-hop inference or complex semantic understanding between queries and documents. One…

Information Retrieval · Computer Science 2025-06-17 Xubo Qin , Jun Bai , Jiaqi Li , Zixia Jia , Zilong Zheng

Considering the multimodal signals of search items is beneficial for retrieval effectiveness. Especially in web table retrieval (WTR) experiments, accounting for multimodal properties of tables boosts effectiveness. However, it still…

Information Retrieval · Computer Science 2023-10-19 Björn Engelmann , Timo Breuer , Philipp Schaer

Realistic text-to-SQL workflows often require joining multiple tables. As a result, accurately retrieving the relevant set of tables becomes a key bottleneck for end-to-end performance. We study an open-book setting where queries must be…

Computation and Language · Computer Science 2026-05-29 Hassan Soliman , Vivek Gupta , Dan Roth , Iryna Gurevych

This is the second year of the TREC Deep Learning Track, with the goal of studying ad hoc ranking in the large training data regime. We again have a document retrieval task and a passage retrieval task, each with hundreds of thousands of…

Information Retrieval · Computer Science 2021-02-16 Nick Craswell , Bhaskar Mitra , Emine Yilmaz , Daniel Campos

Generative retrieval constitutes an innovative approach in information retrieval, leveraging generative language models (LM) to generate a ranked list of document identifiers (docid) for a given query. It simplifies the retrieval pipeline…

Information Retrieval · Computer Science 2025-02-13 Penghao Lu , Xin Dong , Yuansheng Zhou , Lei Cheng , Chuan Yuan , Linjian Mo

Neural information retrieval systems typically use a cascading pipeline, in which a first-stage model retrieves a candidate set of documents and one or more subsequent stages re-rank this set using contextualized language models such as…

Information Retrieval · Computer Science 2021-04-27 Antonio Mallia , Omar Khattab , Nicola Tonellotto , Torsten Suel

Document-level relation extraction aims at inferring structured human knowledge from textual documents. State-of-the-art methods for this task use pre-trained language models (LMs) via fine-tuning, yet fine-tuning is computationally…

Computation and Language · Computer Science 2024-10-03 Yilmazcan Ozyurt , Stefan Feuerriegel , Ce Zhang

The success of DeepSeek-R1 demonstrates the immense potential of using reinforcement learning (RL) to enhance LLMs' reasoning capabilities. This paper introduces Retrv-R1, the first R1-style MLLM specifically designed for multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Lanyun Zhu , Deyi Ji , Tianrun Chen , Haiyang Wu , Shiqi Wang

Ranking has always been one of the top concerns in information retrieval research. For decades, lexical matching signal has dominated the ad-hoc retrieval process, but it also has inherent defects, such as the vocabulary mismatch problem.…

Information Retrieval · Computer Science 2020-10-21 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Min Zhang , Shaoping Ma

Retrieval-augmented language models can better adapt to changes in world state and incorporate long-tail knowledge. However, most existing methods retrieve only short contiguous chunks from a retrieval corpus, limiting holistic…

Computation and Language · Computer Science 2024-02-01 Parth Sarthi , Salman Abdullah , Aditi Tuli , Shubh Khanna , Anna Goldie , Christopher D. Manning

The usage of neural network models puts multiple objectives in conflict with each other: Ideally we would like to create a neural model that is effective, efficient, and interpretable at the same time. However, in most instances we have to…

Information Retrieval · Computer Science 2019-12-04 Sebastian Hofstätter , Markus Zlabinger , Allan Hanbury

The vision tokens in multimodal large language models usually exhibit significant spatial and temporal redundancy and take up most of the input tokens, which harms their inference efficiency. To solve this problem, some recent works were…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ting Liu , Liangtao Shi , Richang Hong , Yue Hu , Quanjun Yin , Linfeng Zhang

Document indexing is a key component for efficient information retrieval (IR). After preprocessing steps such as stemming and stop-word removal, document indexes usually store term-frequencies (tf). Along with tf (that only reflects the…

Information Retrieval · Computer Science 2020-04-29 Jibril Frej , Phillipe Mulhem , Didier Schwab , Jean-Pierre Chevallet

Composed Video Retrieval (CoVR) aims to retrieve a video based on a query video and a modifying text. Current CoVR methods fail to fully exploit modern Vision-Language Models (VLMs), either using outdated architectures or requiring…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Gabriele Serussi , David Vainshtein , Jonathan Kouchly , Dotan Di Castro , Chaim Baskin

E-commerce search optimization has evolved to include a wider range of metrics that reflect user engagement and business objectives. Modern search frameworks now incorporate advanced quality features, such as sales counts and document-query…

Information Retrieval · Computer Science 2025-09-03 Jungbae Park , Heonseok Jang