English
Related papers

Related papers: Decoupling Vector Data and Index Storage for Space…

200 papers

Modern deep learning models capture the semantics of complex data by transforming them into high-dimensional embedding vectors. Emerging applications, such as retrieval-augmented generation, use approximate nearest neighbor (ANN) search in…

Databases · Computer Science 2025-10-01 Guoyu Hu , Shaofeng Cai , Tien Tuan Anh Dinh , Zhongle Xie , Cong Yue , Gang Chen , Beng Chin Ooi

Similarity-based vector search underpins many important applications, but a key challenge is processing massive vector datasets (e.g., in TBs). To reduce costs, some systems utilize SSDs as the primary data storage. They employ a proximity…

Databases · Computer Science 2025-08-22 Peiqi Yin , Xiao Yan , Qihui Zhou , Hui Li , Xiaolu Li , Lin Zhang , Meiling Wang , Xin Yao , James Cheng

On-disk graph-based vector search (GVS) has become the dominant approach for serving large-scale vector databases at high recall, but prior systems struggle to sustain concurrent search and update throughput on high-dimensional workloads.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Jaeyong Song , Hongsun Jang , Changmin Shin , Seongyeon Park , Yong Jae Ryoo , Seo Jin Park , Jinho Lee

We propose a generic feature compression method for Approximate Nearest Neighbor Search (ANNS) problems, which speeds up existing ANNS methods in a plug-and-play manner. Specifically, based on transformer, we propose a new network structure…

Information Retrieval · Computer Science 2022-04-07 Haokui Zhang , Buzhou Tang , Wenze Hu , Xiaoyu Wang

As data volumes grow while memory capacity remains limited, disk-resident graph-based approximate nearest neighbor (ANN) methods have become a practical alternative to memory-resident designs, shifting the bottleneck from computation to…

Databases · Computer Science 2026-03-03 Xiaoyu Chen , Jinxiu Qu , Yitong Song , Shuhang Lu , Huiling Li , Minghui Jiang , Wei Zhou , Jianliang Xu , Xuanhe Zhou , Fan Wu

Recently, crossbar array based in-memory accelerators have been gaining interest due to their high throughput and energy efficiency. While software and compiler support for the in-memory accelerators has also been introduced, they are…

Hardware Architecture · Computer Science 2025-01-14 Jihoon Park , Jeongin Choe , Dohyun Kim , Jae-Joon Kim

Approximate Nearest Neighbor Search (ANNS) is essential for modern data-driven applications that require efficient retrieval of top-k results from massive vector databases. Although existing graph-based ANNS algorithms achieve a high recall…

Information Retrieval · Computer Science 2025-03-03 Yang Shi , Yiping Sun , Jiaolong Du , Xiaocheng Zhong , Zhiyong Wang , Yao Hu

Approximate Nearest Neighbor Search (ANNS) underpins modern applications such as information retrieval and recommendation. With the rapid growth of vector data, efficient indexing for real-time vector search has become rudimentary. Existing…

Databases · Computer Science 2026-01-14 Yuchen Peng , Dingyu Yang , Zhongle Xie , Ji Sun , Lidan Shou , Ke Chen , Gang Chen

With the advancement of information retrieval, recommendation systems, and Retrieval-Augmented Generation (RAG), Approximate Nearest Neighbor Search (ANNS) gains widespread applications due to its higher performance and accuracy. While…

Databases · Computer Science 2026-03-03 Yang Xiao , Mo Sun , Ziyu Song , Bing Tian , Jie Zhang , Jie Sun , Zeke Wang

State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by…

Machine Learning · Computer Science 2022-12-01 Shikhar Jaiswal , Ravishankar Krishnaswamy , Ankit Garg , Harsha Vardhan Simhadri , Sheshansh Agrawal

Neural Architecture Search (NAS) has shown great potentials in automatically designing scalable network architectures for dense image predictions. However, existing NAS algorithms usually compromise on restricted search space and search on…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiong Zhang , Hongmin Xu , Hong Mo , Jianchao Tan , Cheng Yang , Lei Wang , Wenqi Ren

Sparse embeddings of data form an attractive class due to their inherent interpretability: Every dimension is tied to a term in some vocabulary, making it easy to visually decipher the latent space. Sparsity, however, poses unique…

Data Structures and Algorithms · Computer Science 2025-09-30 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Approximate nearest neighbor search (ANNS) is a fundamental building block in information retrieval with graph-based indices being the current state-of-the-art and widely used in the industry. Recent advances in graph-based indices have…

Information Retrieval · Computer Science 2021-05-21 Aditi Singh , Suhas Jayaram Subramanya , Ravishankar Krishnaswamy , Harsha Vardhan Simhadri

High-dimensional vector similarity search (HVSS) is gaining prominence as a powerful tool for various data science and AI applications. As vector data scales up, in-memory indexes pose a significant challenge due to the substantial increase…

Vector approximate nearest neighbor search (ANNS) underpins search engines, recommendation systems, and advertising services. Recent advances in ANNS indexes make CPU a cost-effective choice for serving million-scale, in-memory vector…

Information Retrieval · Computer Science 2026-05-12 Yuchen Huang , Baiteng Ma , Yiping Sun , Yang Shi , Xiao Chen , Xiaocheng Zhong , Zhiyong Wang , Yao Hu , Chuliang Weng

Recently, neural network (NN)-based image compression studies have actively been made and has shown impressive performance in comparison to traditional methods. However, most of the works have focused on non-scalable image compression…

Image and Video Processing · Electrical Eng. & Systems 2026-01-06 Jongmin Park , Jooyoung Lee , Munchurl Kim

Approximate nearest neighbor (ANN) search on SSD-backed indexes is increasingly I/O-bound (I/O accounts for 70--90\% of query latency). We present an I/O-first framework for disk-based ANN that organizes techniques along three dimensions:…

Databases · Computer Science 2026-03-24 Liang Li , Shufeng Gong , Yanan Yang , Yiduo Wang , Jie Wu

The increase in the dimensionality of neural embedding models has enhanced the accuracy of semantic search capabilities but also amplified the computational demands for Approximate Nearest Neighbor Searches (ANNS). This complexity poses…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Jingjia Luo , Mingxing Zhang , Kang Chen , Xia Liao , Yingdi Shan , Jinlei Jiang , Yongwei Wu

Approximate nearest neighbor search (ANNS) is a fundamental problem in databases and data mining. A scalable ANNS algorithm should be both memory-efficient and fast. Some early graph-based approaches have shown attractive theoretical…

Machine Learning · Computer Science 2025-07-08 Cong Fu , Chao Xiang , Changxu Wang , Deng Cai

Approximate Nearest Neighbor Search (ANNS) is a core primitive in modern AI systems, and graph-based methods currently offer the best accuracy-efficiency trade-off at scale. The workload is fundamentally memory-bound: graph traversal…

Hardware Architecture · Computer Science 2026-05-26 Sitian Chen , Yusen Li , Yao Chen , Minwen Deng , Jintao Meng , Amelie Chi Zhou