English
Related papers

Related papers: DISTRIBUTEDANN: Efficient Scaling of a Single DISK…

200 papers

Vector search underpins modern information-retrieval systems, including retrieval-augmented generation (RAG) pipelines and search engines over unstructured text and images. As datasets scale to billions of vectors, disk-based vector search…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-07 Nam Anh Dang , Ben Landrum , Ken Birman

Approximate Nearest Neighbor Search (ANNS) in high-dimensional space is an essential operator in many online services, such as information retrieval and recommendation. Indices constructed by the state-of-the-art ANNS algorithms must be…

Databases · Computer Science 2025-10-21 Kun Yu , Jiabao Jin , Xiaoyao Zhong , Peng Cheng , Lei Chen , Zhitao Shen , Jingkuan Song , Hengtao Shen , Xuemin Lin

Partitioning a graph into blocks of roughly equal weight while cutting only few edges is a fundamental problem in computer science with numerous practical applications. While shared-memory parallel partitioners have recently matured to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Peter Sanders , Daniel Seemaier

Embedding-based vector search underpins many important applications, such as recommendation and retrieval-augmented generation (RAG). It relies on vector indices to enable efficient search. However, these indices require storing…

Given a vector dataset $\mathcal{X}$ and a query vector $\vec{x}_q$, graph-based Approximate Nearest Neighbor Search (ANNS) aims to build a graph index $G$ and approximately return vectors with minimum distances to $\vec{x}_q$ by searching…

Information Retrieval · Computer Science 2023-12-01 Jiongkang Ni , Xiaoliang Xu , Yuxiang Wang , Can Li , Jiajie Yao , Shihai Xiao , Xuecang Zhang

Graph-based ANNS algorithms have gained increasing research interest and market adoption due to their efficiency and accuracy in retrieval. Existing approaches primarily rely on CPUs for graph index construction and retrieval, but this…

Databases · Computer Science 2026-05-12 Lan Lu , Peiqi Yin , Isaac Yang , Tao Luo , Hua Fan , Wenchao Zhou , Feifei Li , Boon Thau Loo

We present GateANN, an I/O-efficient SSD-based graph ANNS system that supports filtered vector search on an unmodified graph index. Existing SSD-based systems either waste I/O by post-filtering, or require expensive filter-aware index…

Operating Systems · Computer Science 2026-03-27 Nakyung Lee , Soobin Cho , Jiwoong Park , Gyuyeong Kim

State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by…

Machine Learning · Computer Science 2022-12-01 Shikhar Jaiswal , Ravishankar Krishnaswamy , Ankit Garg , Harsha Vardhan Simhadri , Sheshansh Agrawal

Neural Architecture Search (NAS) has demonstrated state-of-the-art performance on various computer vision tasks. Despite the superior performance achieved, the efficiency and generality of existing methods are highly valued due to their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Xiawu Zheng , Chenyi Yang , Shaokun Zhang , Yan Wang , Baochang Zhang , Yongjian Wu , Yunsheng Wu , Ling Shao , Rongrong Ji

We propose PipeANN-Filter, an efficient filtered vector search system on SSD. Unlike existing systems that explore only valid vectors (i.e., those satisfying the attribute constraints) during search, PipeANN-Filter explores a superset of…

Operating Systems · Computer Science 2026-05-19 Hao Guo , Jiwu Shu , Youyou Lu

Graph-based approximate nearest neighbor search has attracted more and more attentions due to its online search advantages. Numbers of methods studying the enhancement of speed and recall have been put forward. However, few of them focus on…

Information Retrieval · Computer Science 2021-02-10 Kang Zhao , Pan Pan , Yun Zheng , Yanhao Zhang , Changxu Wang , Yingya Zhang , Yinghui Xu , Rong Jin

Equivariant Graph Neural Networks (GNNs) have achieved remarkable success across diverse scientific applications. However, existing approaches face critical efficiency challenges when scaling to large geometric graphs and suffer significant…

Machine Learning · Computer Science 2025-06-25 Yuelin Zhang , Jiacheng Cen , Jiaqi Han , Wenbing Huang

We propose Distributed Neighbor Expansion (Distributed NE), a parallel and distributed graph partitioning method that can scale to trillion-edge graphs while providing high partitioning quality. Distributed NE is based on a new heuristic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-24 Masatoshi Hanai , Toyotaro Suzumura , Wen Jun Tan , Elvis Liu , Georgios Theodoropoulos , Wentong Cai

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

Graph partitioning plays a pivotal role in various distributed graph processing applications, including graph analytics, graph neural network training, and distributed graph databases. Graphs that require distributed settings are often too…

Databases · Computer Science 2024-12-11 Milad Rezaei Hajidehi , Sraavan Sridhar , Margo Seltzer

Graph-based approximate nearest neighbor search (ANNS) methods (e.g., HNSW) have become the de facto state of the art for their high precision and low latency. To scale beyond main memory, recent out-of-memory ANNS systems leverage SSDs to…

Databases · Computer Science 2026-02-27 Weichen Zhao , Yuncheng Lu , Yao Tian , Hao Zhang , Jiehui Li , Minghao Zhao , Yakun Li , Weining Qian

Scaling Approximate Nearest Neighbor Search (ANNS) to billions of vectors requires distributed indexes that balance accuracy, latency, and throughput. Yet existing index designs struggle with this tradeoff. This paper presents SPIRE, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-22 Yuming Xu , Qianxi Zhang , Qi Chen , Baotong Lu , Menghao Li , Philip Adams , Mingqin Li , Zengzhong Li , Jing Liu , Cheng Li , Fan Yang

Full-batch training on Graph Neural Networks (GNN) to learn the structure of large graphs is a critical problem that needs to scale to hundreds of compute nodes to be feasible. It is challenging due to large memory capacity and bandwidth…

Approximate Nearest Neighbor Search (ANNS) has become fundamental to modern deep learning applications, having gained particular prominence through its integration into recent generative models that work with increasingly complex datasets…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-28 Yuntao Gui , Peiqi Yin , Xiao Yan , Chaorui Zhang , Weixi Zhang , James Cheng

Approximate Nearest Neighbor Search (ANNS), as the core of vector databases (VectorDBs), has become widely used in modern AI and ML systems, powering applications from information retrieval to bio-informatics. While graph-based ANNS methods…

Machine Learning · Computer Science 2025-10-07 Dingyi Kang , Dongming Jiang , Hanshen Yang , Hang Liu , Bingzhe Li
‹ Prev 1 2 3 10 Next ›