English
Related papers

Related papers: A Novelty-based Evaluation Method for Information …

200 papers

Explainable information retrieval is an emerging research area aiming to make transparent and trustworthy information retrieval systems. Given the increasing use of complex machine learning models in search systems, explainability is…

Information Retrieval · Computer Science 2022-11-07 Avishek Anand , Lijun Lyu , Maximilian Idahl , Yumeng Wang , Jonas Wallat , Zijian Zhang

With the emerging needs of creating fairness-aware solutions for search and recommendation systems, a daunting challenge exists of evaluating such solutions. While many of the traditional information retrieval (IR) metrics can capture the…

Information Retrieval · Computer Science 2022-03-31 Ruoyuan Gao , Yingqiang Ge , Chirag Shah

This paper proposes an incremental method that can be used by an intelligent system to learn better descriptions of a thematic context. The method starts with a small number of terms selected from a simple description of the topic under…

Information Retrieval · Computer Science 2010-04-28 Carlos M. Lorenzetti , Ana G. Maguitman

We present a novel iterative extraction model, IterX, for extracting complex relations, or templates (i.e., N-tuples representing a mapping from named slots to spans of text) within a document. Documents may feature zero or more instances…

Computation and Language · Computer Science 2023-05-02 Yunmo Chen , William Gantt , Weiwei Gu , Tongfei Chen , Aaron Steven White , Benjamin Van Durme

In this paper, we introduce Spotlight, a novel paradigm for information extraction that produces concise, engaging narratives by highlighting the most compelling aspects of a document. Unlike traditional summaries, which prioritize…

Computation and Language · Computer Science 2025-10-22 Ankan Mullick , Sombit Bose , Rounak Saha , Ayan Kumar Bhowmick , Aditya Vempaty , Prasenjit Dey , Ravi Kokku , Pawan Goyal , Niloy Ganguly

Evaluating novelty is critical yet challenging in peer review, as reviewers must assess submissions against a vast, rapidly evolving literature. This report presents OpenNovelty, an LLM-powered agentic system for transparent, evidence-based…

Given a query and a document corpus, the information retrieval (IR) task is to output a ranked list of relevant documents. Combining large language models (LLMs) with embedding-based retrieval models, recent work shows promising results on…

Computation and Language · Computer Science 2023-11-01 Daman Arora , Anush Kini , Sayak Ray Chowdhury , Nagarajan Natarajan , Gaurav Sinha , Amit Sharma

In this paper we look beyond metrics-based evaluation of Information Retrieval systems, to explore the reasons behind ranking results. We present the content-focused Neural-IR-Explorer, which empowers users to browse through retrieval…

Information Retrieval · Computer Science 2019-12-11 Sebastian Hofstätter , Markus Zlabinger , Allan Hanbury

Document retrieval systems have experienced a revitalized interest with the advent of retrieval-augmented generation (RAG). RAG architecture offers a lower hallucination rate than LLM-only applications. However, the accuracy of the…

Information Retrieval · Computer Science 2024-08-21 Kavsar Huseynova , Jafar Isbarov

Because of the increasing number of electronic data, designing efficient tools to retrieve and exploit documents is a major challenge. Current search engines suffer from two main drawbacks: there is limited interaction with the list of…

Information Retrieval · Computer Science 2010-12-09 Sylvie Ranwez , Vincent Ranwez , Mohameth-François Sy , Jacky Montmain , Michel Crampes

We present an efficient and robust reference resolution algorithm in an end-to-end state-of-the-art information extraction system, which must work with a considerably impoverished syntactic analysis of the input sentences. Considering this…

cmp-lg · Computer Science 2008-02-03 Megumi Kameyama

This article evaluates the performance of two techniques for query reformulation in a system for information retrieval, namely, the concept based and the pseudo relevance feedback reformulation. The experiments performed on a corpus of…

Information Retrieval · Computer Science 2014-03-19 Mohammed El Amine Abderrahim

Summarizing content contributed by individuals can be challenging, because people make different lexical choices even when describing the same events. However, there remains a significant need to summarize such content. Examples include the…

Computation and Language · Computer Science 2018-07-26 Wencan Luo , Fei Liu , Zitao Liu , Diane Litman

Attribution and fact verification are critical challenges in natural language processing for assessing information reliability. While automated systems and Large Language Models (LLMs) aim to retrieve and select concise evidence to support…

Computation and Language · Computer Science 2026-01-30 Guy Alt , Eran Hirsch , Serwar Basch , Ido Dagan , Oren Glickman

While entity-oriented neural IR models have advanced significantly, they often overlook a key nuance: the varying degrees of influence individual entities within a document have on its overall relevance. Addressing this gap, we present…

Information Retrieval · Computer Science 2024-01-12 Shubham Chatterjee , Iain Mackie , Jeff Dalton

In this paper, we investigate the retrievability of datasets and publications in a real-life Digital Library (DL). The measure of retrievability was originally developed to quantify the influence that a retrieval system has on the access to…

Information Retrieval · Computer Science 2022-07-22 Dwaipayan Roy , Zeljko Carevic , Philipp Mayr

A systematic review identifies and collates various clinical studies and compares data elements and results in order to provide an evidence based answer for a particular clinical question. The process is manual and involves lot of time. A…

Information Retrieval · Computer Science 2016-06-22 Tanmay Basu , Shraman Kumar , Abhishek Kalyan , Priyanka Jayaswal , Pawan Goyal , Stephen Pettifer , Siddhartha R. Jonnalagadda

The main aim of an information retrieval system is to extract appropriate information from an enormous collection of data based on users need. The basic concept of the information retrieval system is that when a user sends out a query, the…

Information Retrieval · Computer Science 2020-12-17 Abdulmalik Johar

Retrieval-augmented generation (RAG) systems address complex user requests by decomposing them into subqueries, retrieving potentially relevant documents for each, and then aggregating them to generate an answer. Efficiently selecting…

Artificial Intelligence · Computer Science 2025-10-22 Roxana Petcu , Kenton Murray , Daniel Khashabi , Evangelos Kanoulas , Maarten de Rijke , Dawn Lawrie , Kevin Duh

Query expansion is a well known method to improve the performance of information retrieval systems. In this work we have tested different approaches to extract the candidate query terms from the top ranked documents returned by the…

Information Retrieval · Computer Science 2008-12-18 José R. Pérez-Agüera , Lourdes Araujo