English
Related papers

Related papers: Hybrid Inverted Index Is a Robust Accelerator for …

200 papers

Embedding-based retrieval methods construct vector indices to search for document representations that are most similar to the query representations. They are widely used in document retrieval due to low latency and decent recall…

Similarity-preserving hashing is a widely-used method for nearest neighbour search in large-scale image retrieval tasks. There has been considerable research on generating efficient image representation via the deep-network-based hashing…

Computer Vision and Pattern Recognition · Computer Science 2017-10-20 Hanjiang Lai , Yan Pan

A search query consists of several words. In a proximity full-text search, we want to find documents that contain these words near each other. This task requires much time when the query consists of high-frequently occurring words. If we…

Information Retrieval · Computer Science 2020-09-08 Alexander B. Veretennikov

The convolutional neural network (CNN) features can give a good description of image content, which usually represent images with unique global vectors. Although they are compact compared to local descriptors, they still cannot efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-02-02 Ruoyu Liu , Yao Zhao , Shikui Wei , Yi Yang

The increase in the rate of data is much higher than the increase in the speed of computers, which results in a heavy emphasis on search algorithms in research literature. Searching an item in ordered list is an efficient operation in data…

Data Structures and Algorithms · Computer Science 2017-08-04 Adnan Saher Mohammed , Şahin Emrah Amrahov , Fatih V. Çelebi

This study introduces De-DSI, a novel framework that fuses large language models (LLMs) with genuine decentralization for information retrieval, particularly employing the differentiable search index (DSI) concept in a decentralized…

Information Retrieval · Computer Science 2024-04-22 Petru Neague , Marcel Gregoriadis , Johan Pouwelse

Importance of document clustering is now widely acknowledged by researchers for better management, smart navigation, efficient filtering, and concise summarization of large collection of documents like World Wide Web (WWW). The next…

Information Retrieval · Computer Science 2011-12-30 Muhammad Rafi , M. Shahid Shaikh , Amir Farooq

Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result,…

Information Retrieval · Computer Science 2024-04-16 Dahlia Shehata

Many recent approaches of passage retrieval are using dense embeddings generated from deep neural models, called "dense passage retrieval". The state-of-the-art end-to-end dense passage retrieval systems normally deploy a deep neural model…

Information Retrieval · Computer Science 2022-10-11 Yifan Wang , Haodi Ma , Daisy Zhe Wang

Learned sparse document representations using a transformer-based neural model has been found to be attractive in both relevance effectiveness and time efficiency. This paper describes a representation sparsification scheme based on hard…

Information Retrieval · Computer Science 2023-06-21 Yifan Qiao , Yingrui Yang , Shanxiu He , Tao Yang

While dense retrieval has been shown effective and efficient across tasks and languages, it remains difficult to create effective fully zero-shot dense retrieval systems when no relevance label is available. In this paper, we recognize the…

Information Retrieval · Computer Science 2022-12-21 Luyu Gao , Xueguang Ma , Jimmy Lin , Jamie Callan

Dense Retrieval (DR) has achieved state-of-the-art first-stage ranking effectiveness. However, the efficiency of most existing DR models is limited by the large memory cost of storing dense vectors and the time-consuming nearest neighbor…

Information Retrieval · Computer Science 2021-10-13 Jingtao Zhan , Jiaxin Mao , Yiqun Liu , Jiafeng Guo , Min Zhang , Shaoping Ma

There are settings in which reproducibility of ranked lists is desirable, such as when extracting a subset of an evolving document corpus for downstream research tasks or in domains such as patent retrieval or in medical systematic reviews,…

Information Retrieval · Computer Science 2024-11-07 Moritz Staudinger , Florina Piroi , Andreas Rauber

Generative retrieval employs sequence models for conditional generation of document IDs based on a query (DSI (Tay et al., 2022); NCI (Wang et al., 2022); inter alia). While this has led to improved performance in zero-shot retrieval, it is…

Information Retrieval · Computer Science 2025-02-27 Tongfei Chen , Ankita Sharma , Adam Pauls , Benjamin Van Durme

In neural Information Retrieval (IR), ongoing research is directed towards improving the first retriever in ranking pipelines. Learning dense embeddings to conduct retrieval using efficient approximate nearest neighbors methods has proven…

Information Retrieval · Computer Science 2021-09-22 Thibault Formal , Carlos Lassance , Benjamin Piwowarski , Stéphane Clinchant

Inverted indexes allow to query large databases without needing to search in the database at each query. An important line of research is to construct the most efficient inverted indexes, both in terms of compression ratio and time…

Databases · Computer Science 2025-05-06 Yann Barsamian , André Chailloux

Neural document retrieval often treats a corpus as a flat cloud of vectors scored at a single granularity, leaving corpus structure underused and explanations opaque. We use Cobweb--a hierarchy-aware framework--to organize sentence…

Computation and Language · Computer Science 2026-04-17 Anant Gupta , Karthik Singaravadivelan , Zekun Wang

The field of scientometrics has shown the power of citation-based clusters for literature analysis, yet this technique has barely been used for information retrieval tasks. This work evaluates the performance of citation based-clusters for…

Digital Libraries · Computer Science 2023-10-06 Juan Pablo Bascur , Suzan Verberne , Nees Jan van Eck , Ludo Waltman

Cloud data storage solutions offer customers cost-effective and reduced data management. While attractive, data security issues remain to be a core concern. Traditional encryption protects stored documents, but hinders simple…

Cryptography and Security · Computer Science 2023-06-28 Marc Damie , Florian Hahn , Andreas Peter

Expansion-enhanced sparse lexical representation improves information retrieval (IR) by minimizing vocabulary mismatch problems during lexical matching. In this paper, we explore the potential of jointly learning dense semantic…

Machine Learning · Computer Science 2024-05-24 Biplob Biswas , Rajiv Ramnath