English
Related papers

Related papers: NevIR: Negation in Neural Information Retrieval

200 papers

To evaluate Information Retrieval (IR) effectiveness, a possible approach is to use test collections, which are composed of a collection of documents, a set of description of information needs (called topics), and a set of relevant…

Information Retrieval · Computer Science 2020-11-03 Kevin Roitero

Establishing a docker-based replicability infrastructure offers the community a great opportunity: measuring the run time of information retrieval systems. The time required to present query results to a user is paramount to the users…

Information Retrieval · Computer Science 2019-07-11 Sebastian Hofstätter , Allan Hanbury

Large language models (LLMs) fine-tuned for text-retrieval have demonstrated state-of-the-art results across several information retrieval (IR) benchmarks. However, supervised training for improving these models requires numerous labeled…

Information Retrieval · Computer Science 2024-06-24 William Fleshman , Benjamin Van Durme

A number of recent benchmarks seek to assess how well models handle natural language negation. However, these benchmarks lack the controlled example paradigms that would allow us to infer whether a model had learned how negation morphemes…

Computation and Language · Computer Science 2024-04-19 Jingyuan Selena She , Christopher Potts , Samuel R. Bowman , Atticus Geiger

Vocabulary mismatch is a central problem in information retrieval (IR), i.e., the relevant documents may not contain the same (symbolic) terms of the query. Recently, neural representations have shown great success in capturing semantic…

Information Retrieval · Computer Science 2018-07-24 Yan Xiao , Jiafeng Guo , Yixing Fan , Yanyan Lan , Jun Xu , Xueqi Cheng

This paper illustrates some challenges of common ranking evaluation methods for legal information retrieval (IR). We show these challenges with log data from a live legal search system and two user studies. We provide an overview of aspects…

Information Retrieval · Computer Science 2024-03-29 Gineke Wiggers , Suzan Verberne , Arjen de Vries , Roel van der Burg

One crucial aspect of sentiment analysis is negation handling, where the occurrence of negation can flip the sentiment of a sentence and negatively affects the machine learning-based sentiment classification. The role of negation in Arabic…

Computation and Language · Computer Science 2021-07-27 Omar Al-Harbi

A sequential pattern with negation, or negative sequential pattern, takes the form of a sequential pattern for which the negation symbol may be used in front of some of the pattern's itemsets. Intuitively, such a pattern occurs in a…

Machine Learning · Computer Science 2023-09-22 Thomas Guyet

Benchmarking the performance of information retrieval (IR) is mostly conducted with a fixed set of documents (static corpora). However, in realistic scenarios, this is rarely the case and the documents to be retrieved are constantly updated…

Information Retrieval · Computer Science 2024-10-08 Chaeeun Kim , Soyoung Yoon , Hyunji Lee , Joel Jang , Sohee Yang , Minjoon Seo

Information Retrieval (IR) systems are crucial tools for users to access information, which have long been dominated by traditional methods relying on similarity matching. With the advancement of pre-trained language models, generative…

Information Retrieval · Computer Science 2025-03-05 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yuyao Zhang , Peitian Zhang , Yutao Zhu , Zhicheng Dou

In the field of artificial intelligence, understanding, distinguishing, expressing, and computing the negation in knowledge is a fundamental issue in knowledge processing and research. In this paper, we examine and analyze the understanding…

Artificial Intelligence · Computer Science 2025-06-02 Zhenghua Pan , Yong Wang

We study the utility of the lexical translation model (IBM Model 1) for English text retrieval, in particular, its neural variants that are trained end-to-end. We use the neural Model1 as an aggregator layer applied to context-free or…

Computation and Language · Computer Science 2021-03-19 Leonid Boytsov , Zico Kolter

We present the Benchmark of Information Retrieval (IR) tasks with Complex Objectives (BIRCO). BIRCO evaluates the ability of IR systems to retrieve documents given multi-faceted user objectives. The benchmark's complexity and compact size…

Information Retrieval · Computer Science 2024-04-05 Xiaoyue Wang , Jianyou Wang , Weili Cao , Kaicheng Wang , Ramamohan Paturi , Leon Bergen

Current sparse neural information retrieval (IR) methods, and to a lesser extent more traditional models such as BM25, do not take into account the document collection and the complex interplay between different term weights when…

Information Retrieval · Computer Science 2025-05-08 Arthur Satouf , Gabriel Ben Zenou , Benjamin Piwowarski , Habiboulaye Amadou Boubacar , Pablo Piantanida

Machine learning plays a role in many aspects of modern IR systems, and deep learning is applied in all of them. The fast pace of modern-day research has given rise to many approaches to many IR problems. The amount of information available…

Information Retrieval · Computer Science 2018-01-09 Tom Kenter , Alexey Borisov , Christophe Van Gysel , Mostafa Dehghani , Maarten de Rijke , Bhaskar Mitra

Retrieval systems generally focus on web-style queries that are short and underspecified. However, advances in language models have facilitated the nascent rise of retrieval models that can understand more complex queries with diverse…

In recent years, neural models have been repeatedly touted to exhibit state-of-the-art performance in recommendation. Nevertheless, multiple recent studies have revealed that the reported state-of-the-art results of many neural…

Information Retrieval · Computer Science 2023-05-04 Yushun Dong , Jundong Li , Tobias Schnabel

With the growing success of reasoning models across complex natural language tasks, researchers in the Information Retrieval (IR) community have begun exploring how similar reasoning capabilities can be integrated into passage rerankers…

Information Retrieval · Computer Science 2025-05-23 Nour Jedidi , Yung-Sung Chuang , James Glass , Jimmy Lin

Neural IR has advanced through two distinct paths: entity-oriented approaches leveraging knowledge graphs and multi-vector models capturing fine-grained semantics. We introduce QDER, a neural re-ranking model that unifies these approaches…

Information Retrieval · Computer Science 2025-10-14 Shubham Chatterjee , Jeff Dalton

Retrieval systems are central to many NLP pipelines, but often rely on surface-level cues such as keyword overlap and lexical semantic similarity. To evaluate retrieval beyond these shallow signals, recent benchmarks introduce…

Computation and Language · Computer Science 2025-09-26 Zeinab Sadat Taghavi , Ali Modarressi , Yunpu Ma , Hinrich Schütze