English
Related papers

Related papers: LSM-VEC: A Large-Scale Disk-Based System for Dynam…

200 papers

High-dimensional vector similarity search (HVSS) is gaining prominence as a powerful tool for various data science and AI applications. As vector data scales up, in-memory indexes pose a significant challenge due to the substantial increase…

Approximate Nearest Neighbor Search (ANNS) underpins modern applications such as information retrieval and recommendation. With the rapid growth of vector data, efficient indexing for real-time vector search has become rudimentary. Existing…

Databases · Computer Science 2026-01-14 Yuchen Peng , Dingyu Yang , Zhongle Xie , Ji Sun , Lidan Shou , Ke Chen , Gang Chen

Vector search, the task of finding the k-nearest neighbors of a query vector against a database of high-dimensional vectors, underpins many machine learning applications, including retrieval-augmented generation, recommendation systems, and…

Managing large-scale vector datasets with disk-resident graph approximate nearest neighbor search (ANNS) systems incurs substantial storage overhead due to the co-location of vector data and auxiliary index metadata, which prevents the…

Databases · Computer Science 2026-05-18 Yuanming Ren , Juncheng Zhang , Yanjing Ren , Rui Yang , Di Wu , Patrick P. C. Lee

State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by…

Machine Learning · Computer Science 2022-12-01 Shikhar Jaiswal , Ravishankar Krishnaswamy , Ankit Garg , Harsha Vardhan Simhadri , Sheshansh Agrawal

In high-dimensional vector spaces, Approximate Nearest Neighbor Search (ANNS) is a key component in database and artificial intelligence infrastructures. Graph-based methods, particularly HNSW, have emerged as leading solutions among…

Databases · Computer Science 2025-02-26 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Yifan Zhu , Wenchao Zhou

In multi-vector retrieval, both queries and data are represented as sets of high-dimensional vectors, enabling finer-grained semantic matching and improving retrieval quality over single-vector approaches. However, its practical adoption is…

Information Retrieval · Computer Science 2026-03-24 Yao Tian , Zhoujin Tian , Xi Zhao , Ruiyuan Zhang , Xiaofang Zhou

Vector search (VS) has become a fundamental component in multimodal data management, enabling core functionalities such as image, video, and code retrieval. As vector data scales rapidly, VS faces growing challenges in balancing search,…

Databases · Computer Science 2026-01-06 Yitong Song , Xuanhe Zhou , Christian S. Jensen , Jianliang Xu

Large-scale approximate nearest neighbor search (ANN) has been gaining attention along with the latest machine learning researches employing ANNs. If the data is too large to fit in memory, it is necessary to search for the most similar…

Machine Learning · Computer Science 2025-01-29 Taiga Ikeda , Daisuke Miyashita , Jun Deguchi

Similarity-based vector search underpins many important applications, but a key challenge is processing massive vector datasets (e.g., in TBs). To reduce costs, some systems utilize SSDs as the primary data storage. They employ a proximity…

Databases · Computer Science 2025-08-22 Peiqi Yin , Xiao Yan , Qihui Zhou , Hui Li , Xiaolu Li , Lin Zhang , Meiling Wang , Xin Yao , James Cheng

Locality-sensitive hashing (LSH) is a well-known solution for approximate nearest neighbor (ANN) search with theoretical guarantees. Traditional LSH-based methods mainly focus on improving the efficiency and accuracy of query phase by…

Databases · Computer Science 2026-03-27 Jiuqi Wei , Xiaodong Lee , Botao Peng , Quanqing Xu , Chuanhui Yang , Themis Palpanas

There is an increasing demand for extending existing DBMSs with vector indices so that they become unified systems capable of supporting modern predictive applications, which require joint querying of vector embeddings together with the…

Information Retrieval · Computer Science 2025-07-01 Gaurav Sehgal , Semih Salihoglu

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

Approximate nearest neighbour (ANN) search has become a central task in modern data-intensive applications, particularly when operating on large, heterogeneous, or high-dimensional datasets. However, many existing ANN methods struggle in…

Information Retrieval · Computer Science 2026-01-15 Elena Garcia-Morato , Maria Jesus Algar , Cesar Alfaro , Felipe Ortega , Javier Gomez , Javier M. Moguerza

The growing volume of graph data may exhaust the main memory. It is crucial to design a disk-based graph storage system to ingest updates and analyze graphs efficiently. However, existing dynamic graph storage systems suffer from read or…

The graph-based index has been widely adopted to meet the demand for approximate nearest neighbor search (ANNS) for high-dimensional vectors. However, in dynamic scenarios involving frequent vector insertions and deletions, existing systems…

Databases · Computer Science 2025-03-19 Song Yu , Shengyuan Lin , Shufeng Gong , Yongqing Xie , Ruicheng Liu , Yijie Zhou , Ji Sun , Yanfeng Zhang , Guoliang Li , Ge Yu

Vector databases typically rely on approximate nearest neighbor (ANN) search to retrieve the top-k closest vectors to a query in embedding space. While effective, this approach often yields semantically redundant results, missing the…

Machine Learning · Computer Science 2025-07-29 Rahul Raja , Arpita Vats

ANNS for embedded vector representations of texts is commonly used in information retrieval, with two important information representations being sparse and dense vectors. While it has been shown that combining these representations…

Information Retrieval · Computer Science 2024-10-29 Haoyu Zhang , Jun Liu , Zhenhua Zhu , Shulin Zeng , Maojia Sheng , Tao Yang , Guohao Dai , Yu Wang

The in-memory algorithms for approximate nearest neighbor search (ANNS) have achieved great success for fast high-recall search, but are extremely expensive when handling very large scale database. Thus, there is an increasing request for…

Databases · Computer Science 2021-11-17 Qi Chen , Bing Zhao , Haidong Wang , Mingqin Li , Chuanjie Liu , Zengzhong Li , Mao Yang , Jingdong Wang

With the advancement of machine learning and deep learning, vector search becomes instrumental to many information retrieval systems, to search and find best matches to user queries based on their semantic similarities.These online services…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Minjia Zhang , Yuxiong He