English
Related papers

Related papers: Index-based, High-dimensional, Cosine Threshold Qu…

200 papers

Compressed inverted indices in use today are based on the idea of gap compression: documents pointers are stored in increasing order, and the gaps between successive document pointers are stored using suitable codes which represent smaller…

Information Retrieval · Computer Science 2012-06-20 Sebastiano Vigna

With the ever-increasing quantity and variety of data worldwide, the Web has become a rich repository of mathematical formulae. This necessitates the creation of robust and scalable systems for Mathematical Information Retrieval, where…

Information Retrieval · Computer Science 2015-07-23 Richard Zanibbi , Kenny Davila , Andrew Kane , Frank Tompa

This study proposes a novel hybrid retrieval strategy for Retrieval-Augmented Generation (RAG) that integrates cosine similarity and cosine distance measures to improve retrieval performance, particularly for sparse data. The traditional…

Information Retrieval · Computer Science 2024-06-05 Kush Juvekar , Anupam Purwar

The real-world effectiveness of deep neural networks often depends on their latency, thereby necessitating optimization techniques that can reduce a model's inference time while preserving its performance. One popular approach is to…

Machine Learning · Computer Science 2024-10-10 Jakob Hartmann , Guoliang He , Eiko Yoneki

In many data classification problems, there is no linear relationship between an explanatory and the dependent variables. Instead, there may be ranges of the input variable for which the observed outcome is signficantly more or less likely.…

Machine Learning · Computer Science 2016-04-13 Mallory Sheth , Roy Welsch , Natasha Markuzon

We consider the problem of minimizing the number of matrix-vector queries needed for accurate trace estimation in the dynamic setting where our underlying matrix is changing slowly, such as during an optimization process. Specifically, for…

Data Structures and Algorithms · Computer Science 2022-10-03 David P. Woodruff , Fred Zhang , Qiuyi Zhang

Operational consistent query answering (CQA) is a recent framework for CQA based on revised definitions of repairs, which are built by applying a sequence of operations (e.g., fact deletions) starting from an inconsistent database until we…

Databases · Computer Science 2025-08-25 Marco Calautti , Ester Livshits , Andreas Pieris , Markus Schneider

Full-text search engines are important tools for information retrieval. Term proximity is an important factor in relevance score measurement. In a proximity full-text search, we assume that a relevant document contains query terms near each…

Information Retrieval · Computer Science 2018-11-20 Alexander B. Veretennikov

The data structure at the core of large-scale search engines is the inverted index, which is essentially a collection of sorted integer sequences called inverted lists. Because of the many documents indexed by such engines and stringent…

Information Retrieval · Computer Science 2022-02-08 Giulio Ermanno Pibiri , Rossano Venturini

Iterative thresholding algorithms seek to optimize a differentiable objective function over a sparsity or rank constraint by alternating between gradient steps that reduce the objective, and thresholding steps that enforce the constraint.…

Methodology · Statistics 2019-08-01 Haoyang Liu , Rina Foygel Barber

A view with a binding pattern is a parameterised query on a database. Such views are used, e.g., to model Web services. To answer a query on such views, one has to orchestrate the views together in execution plans. The goal is usually to…

Databases · Computer Science 2020-10-08 Julien Romero , Nicoleta Preda , Fabian Suchanek

We formulate and optimally solve a new generalized Set Similarity Search problem, which assumes the size of the database and query sets are known in advance. By creating polylog copies of our data-structure, we optimally solve any symmetric…

Data Structures and Algorithms · Computer Science 2020-04-21 Thomas Dybdahl Ahle , Jakob Bæk Tejs Knudsen

Approximate nearest neighbor search for vectors relies on indexes that are most often accessed from RAM. Therefore, storage is the factor limiting the size of the database that can be served from a machine. Lossy vector compression, i.e.,…

Machine Learning · Computer Science 2025-01-22 Daniel Severo , Giuseppe Ottaviano , Matthew Muckley , Karen Ullrich , Matthijs Douze

The optimal runtime of a quantum computer searching a database is typically cited as the square root of the number of items in the database, which is famously achieved by Grover's algorithm. With parallel oracles, however, it is possible to…

Given a large dataset of binary codes and a binary query point, we address how to efficiently find $K$ codes in the dataset that yield the largest cosine similarities to the query. The straightforward answer to this problem is to compare…

Databases · Computer Science 2018-04-19 Sepehr Eghbali , Ladan Tahvildari

Many emerging use cases of data mining and machine learning operate on large datasets with data from heterogeneous sources, specifically with both sparse and dense components. For example, dense deep neural network embedding vectors are…

Machine Learning · Computer Science 2019-03-22 Xiang Wu , Ruiqi Guo , David Simcha , Dave Dopson , Sanjiv Kumar

Similarity search approaches based on graph walks have recently attained outstanding speed-accuracy trade-offs, taking aside the memory requirements. In this paper, we revisit these approaches by considering, additionally, the memory…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Matthijs Douze , Alexandre Sablayrolles , Hervé Jégou

The importance of an efficient and scalable document similarity detection system is undeniable nowadays. Search engines need batch text similarity measures to detect duplicated and near-duplicated web pages in their indexes in order to…

Information Retrieval · Computer Science 2018-10-09 Hamid Mohammadi , Amin Nikoukaran

An increasing amount of trajectory data is being annotated with text descriptions to better capture the semantics associated with locations. The fusion of spatial locations and text descriptions in trajectories engenders a new type of…

Databases · Computer Science 2012-05-15 Gao Cong , Hua Lu , Beng Chin Ooi , Dongxiang Zhang , Meihui Zhang

Search is one of the most common platforms used to seek information. However, users mostly get overloaded with results whenever they use such a platform to resolve their queries. Nowadays, direct answers to queries are being provided as a…

Computation and Language · Computer Science 2021-01-08 Ankush Chopra , Shruti Agrawal , Sohom Ghosh