English
Related papers

Related papers: A Novelty-based Evaluation Method for Information …

200 papers

A key component of fact verification is thevevidence retrieval, often from multiple documents. Recent approaches use dense representations and condition the retrieval of each document on the previously retrieved ones. The latter step is…

Computation and Language · Computer Science 2022-12-13 Rami Aly , Andreas Vlachos

With the explosive growth of accessible information, expecially on the Internet, evaluation-based filtering has become a crucial task. Various systems have been devised aiming to sort through large volumes of information and select what is…

Data Analysis, Statistics and Probability · Physics 2007-05-23 P. Laureti , L. Moret , Y. -C. Zhang , Y. -K. Yu

This paper is a short description of an information retrieval system enhanced by three model driven retrieval services: (1) co-word analysis based query expansion, re-ranking via (2) Bradfordizing and (3) author centrality. The different…

Information Retrieval · Computer Science 2017-05-03 Philipp Schaer , Philipp Mayr , Peter Mutschke

The crucial role of the evaluation in the development of the information retrieval tools is useful evidence to improve the performance of these tools and the quality of results that they return. However, the classic evaluation approaches…

Information Retrieval · Computer Science 2011-06-01 Abdelkrim Bouramoul , Mohamed-Khireddine Kholladi , Bich-Lien Doan

Bibliometric-enhanced Information Retrieval (BIR) workshops serve as the annual gathering of IR researchers who address various information-related tasks on scientific corpora and bibliometrics. The workshop features original approaches to…

Information Retrieval · Computer Science 2017-11-01 Philipp Mayr , Ingo Frommholz , Guillaume Cabanac

Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. Motivated by the emergent reasoning abilities…

Information Retrieval · Computer Science 2026-05-04 Yiyang Wei , Tingyu Song , Siyue Zhang , Yilun Zhao

This paper systematically addresses the challenges of rule retrieval, a crucial yet underexplored area. Vanilla retrieval methods using sparse or dense retrievers to directly search for relevant rules to support downstream reasoning, often…

Computation and Language · Computer Science 2025-05-19 Ziyang Huang , Wangtao Sun , Jun Zhao , Kang Liu

Effective information retrieval (IR) from vast datasets relies on advanced techniques to extract relevant information in response to queries. Recent advancements in dense retrieval have showcased remarkable efficacy compared to traditional…

Information Retrieval · Computer Science 2024-10-03 Chao-Wei Huang , Yun-Nung Chen

We propose Referral-Augmented Retrieval (RAR), a simple technique that concatenates document indices with referrals, i.e. text from other documents that cite or link to the given document, to provide significant performance gains for…

Computation and Language · Computer Science 2023-05-25 Michael Tang , Shunyu Yao , John Yang , Karthik Narasimhan

Theoretical frameworks like the Probability Ranking Principle and its more recent Interactive Information Retrieval variant have guided the development of ranking and retrieval algorithms for decades, yet they are not capable of helping us…

Information Retrieval · Computer Science 2016-01-19 Marc Sloan , Jun Wang

In this paper, an Eliteness Hypothesis for information retrieval is proposed, where we define two generative processes to create information items and queries. By assuming the deterministic relationships between the eliteness of terms and…

Information Retrieval · Computer Science 2011-08-16 Jagadeesh Gorla , Stephen Robertson , Jun Wang

This work introduces a companion reproducible paper with the aim of allowing the exact replication of the methods, experiments, and results discussed in a previous work [5]. In that parent paper, we proposed many and varied techniques for…

Data Structures and Algorithms · Computer Science 2019-12-30 Antonio Fariña , Miguel A. Martínez-Prieto , Francisco Claude , Gonzalo Navarro , Juan J. Lastra-Díaz , Nicola Prezza , Diego Seco

In this work, we propose a theory for information matching. It is motivated by the observation that retrieval is about the relevance matching between two sets of properties (features), namely, the information need representation and…

Information Retrieval · Computer Science 2012-06-04 Jagadeesh Gorla , Stephen Robertson , Jun Wang , Tamas Jambor

In any ranking system, the retrieval model outputs a single score for a document based on its belief on how relevant it is to a given search query. While retrieval models have continued to improve with the introduction of increasingly…

Information Retrieval · Computer Science 2021-05-12 Daniel Cohen , Bhaskar Mitra , Oleg Lesota , Navid Rekabsaz , Carsten Eickhoff

Benchmarking the performance of information retrieval (IR) is mostly conducted with a fixed set of documents (static corpora). However, in realistic scenarios, this is rarely the case and the documents to be retrieved are constantly updated…

Information Retrieval · Computer Science 2024-10-08 Chaeeun Kim , Soyoung Yoon , Hyunji Lee , Joel Jang , Sohee Yang , Minjoon Seo

Novelty is a crucial criterion in the peer review process for evaluating academic papers. Traditionally, it's judged by experts or measure by unique reference combinations. Both methods have limitations: experts have limited knowledge, and…

Computation and Language · Computer Science 2025-07-17 Wenqing Wu , Chengzhi Zhang , Yi Zhao

To create a new IR test collection at low cost, it is valuable to carefully select which documents merit human relevance judgments. Shared task campaigns such as NIST TREC pool document rankings from many participating systems (and often…

Information Retrieval · Computer Science 2020-08-06 Md Mustafizur Rahman , Mucahid Kutlu , Tamer Elsayed , Matthew Lease

Real-world fact verification task aims to verify the factuality of a claim by retrieving evidence from the source document. The quality of the retrieved evidence plays an important role in claim verification. Ideally, the retrieved evidence…

Computation and Language · Computer Science 2023-05-08 Xuming Hu , Zhaochen Hong , Zhijiang Guo , Lijie Wen , Philip S. Yu

Generative Retrieval (GR) is an emerging paradigm in information retrieval that leverages generative models to directly map queries to relevant document identifiers (DocIDs) without the need for traditional query processing or document…

Information Retrieval · Computer Science 2024-06-05 Tzu-Lin Kuo , Tzu-Wei Chiu , Tzung-Sheng Lin , Sheng-Yang Wu , Chao-Wei Huang , Yun-Nung Chen

Reference resolution on extended texts (several thousand references) cannot be evaluated manually. An evaluation algorithm has been proposed for the MUC tests, using equivalence classes for the coreference relation. However, we show here…

Computation and Language · Computer Science 2007-05-23 Andrei Popescu-Belis , Isabelle Robba