English
Related papers

Related papers: IncDSI: Incrementally Updatable Document Retrieval

200 papers

The widely used retrieve-and-rerank pipeline faces two critical limitations: they are constrained by the initial retrieval quality of the top-k documents, and the growing computational demands of LLM-based rerankers restrict the number of…

Information Retrieval · Computer Science 2025-09-10 Haike Xu , Tong Chen

With the advent of the Internet, a new era of digital information exchange has begun. Currently, the Internet encompasses more than five billion online sites and this number is exponentially increasing every day. Fundamentally, Information…

Information Retrieval · Computer Science 2012-04-03 Youssef Bassil , Paul Semaan

Neural models have transformed the fundamental information retrieval problem of mapping a query to a giant set of items. However, the need for efficient and low latency inference forces the community to reconsider efficient approximate…

Information Retrieval · Computer Science 2021-03-19 Gaurav Gupta , Tharun Medini , Anshumali Shrivastava , Alexander J Smola

In this paper, we propose a new dense retrieval model which learns diverse document representations with deep query interactions. Our model encodes each document with a set of generated pseudo-queries to get query-informed, multi-view…

Information Retrieval · Computer Science 2022-08-09 Zehan Li , Nan Yang , Liang Wang , Furu Wei

We present a novel model for the problem of ranking a collection of documents according to their semantic similarity to a source (query) document. While the problem of document-to-document similarity ranking has been studied, most modern…

Computation and Language · Computer Science 2021-12-15 Dvir Ginzburg , Itzik Malkiel , Oren Barkan , Avi Caciularu , Noam Koenigstein

Current text-video retrieval methods mainly rely on cross-modal matching between queries and videos to calculate their similarity scores, which are then sorted to obtain retrieval results. This method considers the matching between each…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Yili Li , Jing Yu , Keke Gai , Bang Liu , Gang Xiong , Qi Wu

Natural language (NL)-driven table discovery identifies relevant tables from large table repositories based on NL queries. While current deep-learning-based methods using the traditional dense vector search pipeline, i.e.,…

Databases · Computer Science 2025-05-01 Yuxiang Guo , Zhonghao Hu , Yuren Mao , Baihua Zheng , Yunjun Gao , Mingwei Zhou

We present an end-to-end differentiable training method for retrieval-augmented open-domain question answering systems that combine information from multiple retrieved documents when generating answers. We model retrieval decisions as…

Computation and Language · Computer Science 2021-12-07 Devendra Singh Sachan , Siva Reddy , William Hamilton , Chris Dyer , Dani Yogatama

Document retrieval aims at finding the most important documents where a pattern appears in a collection of strings. Traditional pattern-matching techniques yield brute-force document retrieval solutions, which has motivated the research on…

Data Structures and Algorithms · Computer Science 2014-07-02 Gonzalo Navarro , Simon J. Puglisi , Jouni Sirén

Sparse vector Maximum Inner Product Search (MIPS) is crucial in multi-path retrieval for Retrieval-Augmented Generation (RAG). Recent inverted index-based and graph-based algorithms have achieved high search accuracy with practical…

Finding desired information from large data set is a difficult problem. Information retrieval is concerned with the structure, analysis, organization, storage, searching, and retrieval of information. Index is the main constituent of an IR…

Information Retrieval · Computer Science 2012-09-26 Md. Abdullah al Mamun , Md. Hanif , Md. Rakib Uddin , Tanvir Ahmed , Md. Mofizul Islam

Pairing a lexical retriever with a neural re-ranking model has set state-of-the-art performance on large-scale information retrieval datasets. This pipeline covers scenarios like question answering or navigational queries, however, for…

Information Retrieval · Computer Science 2022-10-20 Tim Baumgärtner , Leonardo F. R. Ribeiro , Nils Reimers , Iryna Gurevych

We present a novel scalable framework for image change detection (ICD) from an on-board 3D imagery system. We argue that existing ICD systems are constrained by the time required to align a given query image with individual reference image…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Kojima Yusuke , Tanaka Kanji , Yang Naiming , Hirota Yuji

Generative retrieval shed light on a new paradigm of document retrieval, aiming to directly generate the identifier of a relevant document for a query. While it takes advantage of bypassing the construction of auxiliary index structures,…

Information Retrieval · Computer Science 2025-06-03 Sunkyung Lee , Minjin Choi , Jongwuk Lee

The International Classification of Diseases (ICD) is an authoritative medical classification system of different diseases and conditions for clinical and management purposes. ICD indexing assigns a subset of ICD codes to a medical record.…

Computation and Language · Computer Science 2024-05-30 Xindi Wang , Robert E. Mercer , Frank Rudzicz

While retrieval techniques are widely used in practice, they still face significant challenges in cross-domain scenarios. Recently, generation-augmented methods have emerged as a promising solution to this problem. These methods enhance raw…

Computation and Language · Computer Science 2025-02-18 Chaofan Li , Zheng Liu , Jianlyv Chen , Defu Lian , Yingxia Shao

The longitudinal evaluation of retrieval systems aims to capture how information needs and documents evolve over time. However, classical Cranfield-style retrieval evaluations only consist of a static set of queries and documents and…

Information Retrieval · Computer Science 2025-09-23 Jüri Keller , Maik Fröbe , Gijs Hendriksen , Daria Alexander , Martin Potthast , Philipp Schaer

Acquiring structured data from domain-specific, image-based documents such as scanned reports is crucial for many downstream tasks but remains challenging due to document variability. Many of these documents exist as images rather than as…

Software Engineering · Computer Science 2025-05-07 Qiang Sun , Sirui Li , Tingting Bi , Du Huynh , Mark Reynolds , Yuanyi Luo , Wei Liu

Documents are visually rich structures that convey information through text, but also figures, page layouts, tables, or even fonts. Since modern retrieval systems mainly rely on the textual information they extract from document pages to…

Information Retrieval · Computer Science 2025-03-03 Manuel Faysse , Hugues Sibille , Tony Wu , Bilel Omrani , Gautier Viaud , Céline Hudelot , Pierre Colombo

This paper presents a deep learning approach for image retrieval and pattern spotting in digital collections of historical documents. First, a region proposal algorithm detects object candidates in the document page images. Next, deep…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Caio da S. Dias , Alceu de S. Britto , Jean P. Barddal , Laurent Heutte , Alessandro L. Koerich