English
Related papers

Related papers: Beyond Relevance: Evaluate and Improve Retrievers …

200 papers

Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. Motivated by the emergent reasoning abilities…

Information Retrieval · Computer Science 2026-05-04 Yiyang Wei , Tingyu Song , Siyue Zhang , Yilun Zhao

In order to adopt deep learning for information retrieval, models are needed that can capture all relevant information required to assess the relevance of a document to a given user query. While previous works have successfully captured…

Information Retrieval · Computer Science 2017-07-25 Kai Hui , Andrew Yates , Klaus Berberich , Gerard de Melo

The Relevance Feedback (RF) process relies on accurate and real-time relevance estimation of feedback documents to improve retrieval performance. Since collecting explicit relevance annotations imposes an extra burden on the user, extensive…

Artificial Intelligence · Computer Science 2023-12-12 Ziyi Ye , Xiaohui Xie , Qingyao Ai , Yiqun Liu , Zhihong Wang , Weihang Su , Min Zhang

Retrieval systems are central to many NLP pipelines, but often rely on surface-level cues such as keyword overlap and lexical semantic similarity. To evaluate retrieval beyond these shallow signals, recent benchmarks introduce…

Computation and Language · Computer Science 2025-09-26 Zeinab Sadat Taghavi , Ali Modarressi , Yunpu Ma , Hinrich Schütze

Conversational retrieval refers to an information retrieval system that operates in an iterative and interactive manner, requiring the retrieval of various external resources, such as persona, knowledge, and even response, to effectively…

Computation and Language · Computer Science 2024-02-29 Hongru Wang , Boyang Xue , Baohang Zhou , Rui Wang , Fei Mi , Weichao Wang , Yasheng Wang , Kam-Fai Wong

The Visual Object Information Retrieval (VOIR) system described in this paper implements an image retrieval approach that combines two layers, the conceptual and the visual layer. It uses terms from a textual thesaurus to represent the…

Information Retrieval · Computer Science 2008-09-30 Jose Torres , Luis Paulo Reis

Instruction-following information retrieval (IF-IR) studies retrieval systems that must not only find documents relevant to a query, but also obey explicit user constraints such as required attributes, exclusions, or output preferences.…

Information Retrieval · Computer Science 2026-04-22 Qingcheng Zeng , Puxuan Yu , Aman Mehta , Fuheng Zhao , Rajhans Samdani

Information Retrieval (IR) is the task of obtaining pieces of data (such as documents) that are relevant to a particular query or need from a large repository of information. IR is a valuable component of several downstream Natural Language…

Information Retrieval · Computer Science 2020-08-05 Samarth Rawal

Given a query and a document corpus, the information retrieval (IR) task is to output a ranked list of relevant documents. Combining large language models (LLMs) with embedding-based retrieval models, recent work shows promising results on…

Computation and Language · Computer Science 2023-11-01 Daman Arora , Anush Kini , Sayak Ray Chowdhury , Nagarajan Natarajan , Gaurav Sinha , Amit Sharma

Typically, every part in most coherent text has some plausible reason for its presence, some function that it performs to the overall semantics of the text. Rhetorical relations, e.g. contrast, cause, explanation, describe how the parts of…

Information Retrieval · Computer Science 2017-04-07 Christina Lioma , Birger Larsen , Wei Lu

Information Retrieval evaluation has traditionally focused on defining principled ways of assessing the relevance of a ranked list of documents with respect to a query. Several methods extend this type of evaluation beyond relevance, making…

Information Retrieval · Computer Science 2022-12-02 Maria Maistro , Lucas Chaves Lima , Jakob Grue Simonsen , Christina Lioma

Despite the critical need to align search targets with users' intention, retrievers often only prioritize query information without delving into the users' intended search context. Enhancing the capability of retrievers to understand…

Computation and Language · Computer Science 2024-02-23 Hanseok Oh , Hyunji Lee , Seonghyeon Ye , Haebin Shin , Hansol Jang , Changwook Jun , Minjoon Seo

Although synthetic data has changed various aspects of information retrieval (IR) pipelines, the main training paradigm remains: contrastive learning with binary relevance labels, where one positive document is compared against several…

Information Retrieval · Computer Science 2025-11-05 Reza Esfandiarpoor , George Zerveas , Ruochen Zhang , Macton Mgonzo , Carsten Eickhoff , Stephen H. Bach

Reasoning-intensive retrieval aims to surface evidence that supports downstream reasoning rather than merely matching topical similarity. This capability is increasingly important for agentic search systems, where retrievers must provide…

Computation and Language · Computer Science 2026-05-06 Yilun Zhao , Jinbiao Wei , Tingyu Song , Siyue Zhang , Chen Zhao , Arman Cohan

With the increasing accessibility and utilization of multilingual documents, Cross-Lingual Information Retrieval (CLIR) has emerged as an important research area. Conventionally, CLIR tasks have been conducted under settings where the…

Information Retrieval · Computer Science 2026-04-08 Seongtae Hong , Youngjoon Jang , Jungseob Lee , Hyeonseok Moon , Heuiseok Lim

Dense retrieval models are commonly used in Information Retrieval (IR) applications, such as Retrieval-Augmented Generation (RAG). Since they often serve as the first step in these systems, their robustness is critical to avoid downstream…

Computation and Language · Computer Science 2025-06-04 Mohsen Fayyaz , Ali Modarressi , Hinrich Schuetze , Nanyun Peng

Mechanistic interpretation has greatly contributed to a more detailed understanding of generative language models, enabling significant progress in identifying structures that implement key behaviors through interactions between internal…

Information Retrieval · Computer Science 2025-11-25 Meng Lu , Catherine Chen , Carsten Eickhoff

With the ever increasing number of filed patent applications every year, the need for effective and efficient systems for managing such tremendous amounts of data becomes inevitably important. Patent Retrieval (PR) is considered the pillar…

Information Retrieval · Computer Science 2018-12-21 Walid Shalaby , Wlodek Zadrozny

Considering the limited internal parametric knowledge, retrieval-augmented generation (RAG) has been widely used to extend the knowledge scope of large language models (LLMs). Despite the extensive efforts on RAG research, in existing…

Computation and Language · Computer Science 2024-11-22 Yuhao Wang , Ruiyang Ren , Junyi Li , Wayne Xin Zhao , Jing Liu , Ji-Rong Wen

The crucial role of the evaluation in the development of the information retrieval tools is useful evidence to improve the performance of these tools and the quality of results that they return. However, the classic evaluation approaches…

Information Retrieval · Computer Science 2011-06-01 Abdelkrim Bouramoul , Mohamed-Khireddine Kholladi , Bich-Lien Doan