English
Related papers

Related papers: Incremental IVF Index Maintenance for Streaming Ve…

200 papers

As declarative query processing techniques expand in scope --- to the Web, data streams, network routers, and cloud platforms --- there is an increasing need for adaptive query processing techniques that can re-plan in the presence of…

Databases · Computer Science 2014-09-23 Mengmeng Liu , Zachary G. Ives , Boon Thau Loo

Retrievers, which form one of the most important recommendation stages, are responsible for efficiently selecting possible positive samples to the later stages under strict latency limitations. Because of this, large-scale systems always…

Information Retrieval · Computer Science 2025-01-16 Xingyan Bin , Jianfei Cui , Wujie Yan , Zhichen Zhao , Xintian Han , Chongyang Yan , Feng Zhang , Xun Zhou , Qi Wu , Zuotao Liu

This paper proposes an auxiliary vector filtering (AVF) algorithm based on a constrained constant modulus (CCM) design for robust adaptive beamforming. This scheme provides an efficient way to deal with filters with a large number of…

Information Theory · Computer Science 2013-03-14 Lei Wang , Rodrigo de Lamare

Materialized views (MVs), stored pre-computed results, are widely used to facilitate fast queries on large datasets. When new records arrive at a high rate, it is infeasible to continuously update (maintain) MVs and a common solution is to…

Databases · Computer Science 2015-09-25 Sanjay Krishnan , Jiannan Wang , Michael J. Franklin , Ken Goldberg , Tim Kraska

Exploratory search starts with ill-defined goals and involves browsing, learning, and formulating new targets for search. To fluidly support such dynamic search behaviours, we focus on devising interactive visual facets (IVF), visualising…

Human-Computer Interaction · Computer Science 2021-09-14 Chen He , Luana Micallef , Barış Serim , Tung Vuong , Tuukka Ruotsalo , Giulio Jacucci

Classification is a common AI problem, and vector search is a typical solution. This transforms a given body of text into a numerical representation, known as an embedding, and modern improvements to vector search focus on optimising speed…

Information Retrieval · Computer Science 2025-06-04 Lee Harris

We study the classical incremental view maintenance problem: Given a query and a database, maintain the query output under single-tuple updates (inserts or deletes) to the database such that the tuples in the query output can be enumerated…

Databases · Computer Science 2026-05-12 Mahmoud Abo-Khamis , Eden Chmielewski , Andrei Draghici , Ahmet Kara , Dan Olteanu

Variational methods that rely on a recognition network to approximate the posterior of directed graphical models offer better inference and learning than previous methods. Recent advances that exploit the capacity and flexibility in this…

Machine Learning · Computer Science 2018-02-21 R Devon Hjelm , Kyunghyun Cho , Junyoung Chung , Russ Salakhutdinov , Vince Calhoun , Nebojsa Jojic

Similarity-based vector search underpins many important applications, but a key challenge is processing massive vector datasets (e.g., in TBs). To reduce costs, some systems utilize SSDs as the primary data storage. They employ a proximity…

Databases · Computer Science 2025-08-22 Peiqi Yin , Xiao Yan , Qihui Zhou , Hui Li , Xiaolu Li , Lin Zhang , Meiling Wang , Xin Yao , James Cheng

This study introduces the Instance-Aware Index Advisor (IA2), a novel deep reinforcement learning (DRL)-based approach for optimizing index selection in databases facing large action spaces of potential candidates. IA2 introduces the Twin…

Databases · Computer Science 2024-04-11 Taiyi Wang , Eiko Yoneki

Graph-based approximate nearest neighbor search (ANNS) methods (e.g., HNSW) have become the de facto state of the art for their high precision and low latency. To scale beyond main memory, recent out-of-memory ANNS systems leverage SSDs to…

Databases · Computer Science 2026-02-27 Weichen Zhao , Yuncheng Lu , Yao Tian , Hao Zhang , Jiehui Li , Minghao Zhao , Yakun Li , Weining Qian

Materialized views and indexes are physical structures for accelerating data access that are casually used in data warehouses. However, these data structures generate some maintenance overhead. They also share the same storage space. Most…

Databases · Computer Science 2007-07-12 Kamel Aouiche , Jérôme Darmont

There exists a natural tension between encouraging a diverse ecosystem of open-source search engines and supporting fair, replicable comparisons across those systems. To balance these two goals, we examine two approaches to providing…

Information Retrieval · Computer Science 2020-03-19 Jimmy Lin , Joel Mackenzie , Chris Kamphuis , Craig Macdonald , Antonio Mallia , Michał Siedlaczek , Andrew Trotman , Arjen de Vries

Approximate Nearest Neighbor Search (ANNS) in high-dimensional space is an essential operator in many online services, such as information retrieval and recommendation. Indices constructed by the state-of-the-art ANNS algorithms must be…

Databases · Computer Science 2025-10-21 Kun Yu , Jiabao Jin , Xiaoyao Zhong , Peng Cheng , Lei Chen , Zhitao Shen , Jingkuan Song , Hengtao Shen , Xuemin Lin

Retrieving semantically relevant documents in niche domains poses significant challenges for traditional TF-IDF-based systems, often resulting in low similarity scores and suboptimal retrieval performance. This paper addresses these…

Information Retrieval · Computer Science 2024-12-24 Elham Peimani , Gurpreet Singh , Nisarg Mahyavanshi , Aman Arora , Awais Shaikh

Dual-encoder-based dense retrieval models have become the standard in IR. They employ large Transformer-based language models, which are notoriously inefficient in terms of resources and latency. We propose Fast-Forward indexes -- vector…

Information Retrieval · Computer Science 2023-11-03 Jurek Leonhardt , Henrik Müller , Koustav Rudra , Megha Khosla , Abhijit Anand , Avishek Anand

Vector indexing enables semantic search over diverse corpora and has become an important interface to databases for both users and AI agents. Efficient vector search requires deep optimizations in database systems. This has motivated a new…

The identification of primal variables and adjoint variables is usually done via indices in operator overloading algorithmic differentiation tools. One approach is a linear management scheme, which is easy to implement and supports memory…

Mathematical Software · Computer Science 2023-08-16 Max Sagebaum , Johannes Blühdorn , Nicolas R. Gauger

Modern deep learning models have the ability to generate high-dimensional vectors whose similarity reflects semantic resemblance. Thus, similarity search, i.e., the operation of retrieving those vectors in a large collection that are…

Machine Learning · Computer Science 2024-04-04 Mariano Tepper , Ishwar Singh Bhati , Cecilia Aguerrebere , Mark Hildebrand , Ted Willke

This paper investigates different vector step-size adaptation approaches for non-stationary online, continual prediction problems. Vanilla stochastic gradient descent can be considerably improved by scaling the update with a vector of…

Machine Learning · Computer Science 2019-12-16 Andrew Jacobsen , Matthew Schlegel , Cameron Linke , Thomas Degris , Adam White , Martha White