English
Related papers

Related papers: Efficient Long-Document Reranking via Block-Level …

200 papers

Large Language Models (LLMs) have transformed listwise document reranking by enabling global reasoning over candidate sets, yet single models often struggle to balance fine-grained relevance scoring with holistic cross-document analysis. We…

Computation and Language · Computer Science 2025-08-26 Abdelrahman Abdallah , Jamshid Mozafari , Bhawna Piryani , Adam Jatowt

Dense retrieval is a crucial task in Information Retrieval (IR), serving as the basis for downstream tasks such as re-ranking and augmenting generation. Recently, large language models (LLMs) have demonstrated impressive semantic…

Information Retrieval · Computer Science 2025-08-20 Hengran Zhang , Keping Bi , Jiafeng Guo , Xiaojie Sun , Shihao Liu , Daiting Shi , Dawei Yin , Xueqi Cheng

Large Language Models (LLMs) excel at understanding the semantic relationships between queries and documents, even with lengthy and complex long-tail queries. These queries are challenging for feedback-based rankings due to sparse user…

Recently, Dense Retrieval (DR) has become a promising solution to document retrieval, where document representations are used to perform effective and efficient semantic search. However, DR remains challenging on long documents, due to the…

Information Retrieval · Computer Science 2022-11-22 Junying Chen , Qingcai Chen , Dongfang Li , Yutao Huang

Although considerable efforts have been devoted to transformer-based ranking models for document search, the relevance-efficiency tradeoff remains a critical problem for ad-hoc ranking. To overcome this challenge, this paper presents BECR…

Information Retrieval · Computer Science 2022-01-07 Yingrui Yang , Yifan Qiao , Jinjin Shao , Mayuresh Anand , Xifeng Yan , Tao Yang

Retrieval with extremely long queries and documents is a well-known and challenging task in information retrieval and is commonly known as Query-by-Document (QBD) retrieval. Specifically designed Transformer models that can handle long…

Information Retrieval · Computer Science 2023-11-03 Arian Askari , Suzan Verberne , Amin Abolghasemi , Wessel Kraaij , Gabriella Pasi

Supervised ranking methods based on bi-encoder or cross-encoder architectures have shown success in multi-stage text ranking tasks, but they require large amounts of relevance judgments as training data. In this work, we propose Listwise…

Information Retrieval · Computer Science 2023-05-04 Xueguang Ma , Xinyu Zhang , Ronak Pradeep , Jimmy Lin

Multimodal documents contain diverse elements, such as tables, figures, and layouts, which can complicate retrieval tasks. While current approaches typically combine dense visual embedding models with supervised rerankers to achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Ruofan Hu , Menghui Zhu , Jieming Zhu , Bo Chen , Shengyang Xu , Minjie Hong , Xiaoda Yang , Sashuai Zhou , Li Tang , Tao Jin , Zhou Zhao

Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existing pipelines often…

Information Retrieval · Computer Science 2025-11-25 Roksana Goworek , Olivia Macmillan-Scott , Eda B. Özyiğit

Large Language Models (LLMs) have significantly advanced the field of information retrieval, particularly for reranking. Listwise LLM rerankers have showcased superior performance and generalizability compared to existing supervised…

Information Retrieval · Computer Science 2024-06-25 Revanth Gangi Reddy , JaeHyeok Doo , Yifei Xu , Md Arafat Sultan , Deevya Swain , Avirup Sil , Heng Ji

Large Language Models (LLMs) have recently demonstrated strong capabilities in tool use, yet progress in tool retrieval remains hindered by incomplete and heterogeneous tool documentation. To address this challenge, we introduce Tool-DE, a…

Information Retrieval · Computer Science 2025-10-28 Xuan Lu , Haohang Huang , Rui Meng , Yaohui Jin , Wenjun Zeng , Xiaoyu Shen

Recent studies have demonstrated the effectiveness of using large language language models (LLMs) in passage ranking. The listwise approaches, such as RankGPT, have become new state-of-the-art in this task. However, the efficiency of…

Computation and Language · Computer Science 2025-01-29 Qi Liu , Bo Wang , Nan Wang , Jiaxin Mao

Real-world RAG applications often encounter long-context input scenarios, where redundant information and noise results in higher inference costs and reduced performance. To address these challenges, we propose LongRefiner, an efficient…

Computation and Language · Computer Science 2025-05-16 Jiajie Jin , Xiaoxi Li , Guanting Dong , Yuyao Zhang , Yutao Zhu , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

Reranking, the process of refining the output of a first-stage retriever, is often considered computationally expensive, especially with Large Language Models. Borrowing from recent advances in document compression for RAG, we reduce the…

Information Retrieval · Computer Science 2025-05-22 Hervé Déjean , Stéphane Clinchant

Reinforcement Learning with Verifiable Rewards~(RLVR) has become a prominent paradigm to enhance the capabilities (i.e.\ long-context) of Large Language Models~(LLMs). However, it often relies on gold-standard answers or explicit evaluation…

Computation and Language · Computer Science 2026-03-03 Yao Xiao , Lei Wang , Yue Deng , Guanzheng Chen , Ziqi Jin , Jung-jae Kim , Xiaoli Li , Roy Ka-wei Lee , Lidong Bing

Large Language Models (LLMs) have significantly impacted many facets of natural language processing and information retrieval. Unlike previous encoder-based approaches, the enlarged context window of these generative models allows for…

Information Retrieval · Computer Science 2024-05-24 Andrew Parry , Sean MacAvaney , Debasis Ganguly

Text summarization aims to condense long documents and retain key information. Critical to the success of a summarization model is the faithful inference of latent representations of words or tokens in the source documents. Most recent…

Computation and Language · Computer Science 2022-03-16 Bo Pang , Erik Nijkamp , Wojciech Kryściński , Silvio Savarese , Yingbo Zhou , Caiming Xiong

The usage of neural network models puts multiple objectives in conflict with each other: Ideally we would like to create a neural model that is effective, efficient, and interpretable at the same time. However, in most instances we have to…

Information Retrieval · Computer Science 2019-12-04 Sebastian Hofstätter , Markus Zlabinger , Allan Hanbury

Search engines operate under a strict time constraint as a fast response is paramount to user satisfaction. Thus, neural re-ranking models have a limited time-budget to re-rank documents. Given the same amount of time, a faster re-ranking…

Information Retrieval · Computer Science 2020-02-06 Sebastian Hofstätter , Markus Zlabinger , Allan Hanbury

Neural IR has advanced through two distinct paths: entity-oriented approaches leveraging knowledge graphs and multi-vector models capturing fine-grained semantics. We introduce QDER, a neural re-ranking model that unifies these approaches…

Information Retrieval · Computer Science 2025-10-14 Shubham Chatterjee , Jeff Dalton