English
Related papers

Related papers: DGAI: Decoupled On-Disk Graph-Based ANN Index for …

200 papers

Approximate nearest neighbor search (ANNS) at billion scale is fundamentally an out-of-core problem: vectors and indexes live on SSD, so performance is dominated by I/O rather than compute. Under skewed semantic embeddings, existing…

Approximate Nearest Neighbor Search (ANNS) has recently gained significant attention due to its many applications, such as Retrieval-Augmented Generation. Such applications require ANNS algorithms that support dynamic data, so the ANNS…

Machine Learning · Computer Science 2025-12-09 Tomohiro Yamashita , Daichi Amagata , Yusuke Matsui

Dynamic graphs, featuring continuously updated vertices and edges, have grown in importance for numerous real-world applications. To accommodate this, graph frameworks, particularly their internal data structures, must support both…

Data Structures and Algorithms · Computer Science 2024-03-06 Abdullah Al Raqibul Islam , Dong Dai

Dynamic Graph Neural Network (DGNN) has shown a strong capability of learning dynamic graphs by exploiting both spatial and temporal features. Although DGNN has recently received considerable attention by AI community and various DGNN…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-08 Fahao Chen , Peng Li , Celimuge Wu

Despite the efficacy of graph-based algorithms for Approximate Nearest Neighbor (ANN) searches, the optimal tuning of such systems remains unclear. This study introduces a method to tune the performance of off-the-shelf graph-based indexes,…

Information Retrieval · Computer Science 2023-09-04 Yutaro Oguri , Yusuke Matsui

As artificial intelligence gains more and more popularity, vectors are one of the most widely used data structures for services such as information retrieval and recommendation. Approximate Nearest Neighbor Search (ANNS), which generally…

Databases · Computer Science 2026-02-03 Yuhui Lai , Shixun Huang , Sheng Wang

This study introduces a robust solution for the detection of Distributed Denial of Service (DDoS) attacks in Internet of Things (IoT) systems, leveraging the capabilities of Graph Convolutional Networks (GCN). By conceptualizing IoT devices…

Cryptography and Security · Computer Science 2024-03-15 Arvin Hekmati , Bhaskar Krishnamachari

We study online graph queries that retrieve nearby nodes of a query node from a large network. To answer such queries with high throughput and low latency, we partition the graph and process the data in parallel across a cluster of servers.…

Databases · Computer Science 2017-10-17 Arijit Khan , Gustavo Segovia , Donald Kossmann

Storing and processing of embedding vectors by specialized Vector databases (VDBs) has become the linchpin in building modern AI pipelines. Most current VDBs employ variants of a graph-based ap- proximate nearest-neighbor (ANN) index…

Databases · Computer Science 2025-11-20 Selim Furkan Tekin , Rajesh Bordawekar

Approximate nearest neighbor (ANN) search is a fundamental problem in computer science for which in-memory graph-based methods, such as Hierarchical Navigable Small World (HNSW), perform exceptionally well. To scale beyond billions of…

Databases · Computer Science 2025-07-24 Manuel Widmoser , Daniel Kocher , Nikolaus Augsten

Real world graphs are often dynamic and evolve over time. It is crucial for storing and querying graph evolution in graph databases. However, existing works either suffer from high storage overhead or lack efficient temporal query support,…

Databases · Computer Science 2024-04-02 Jiamin Hou , Zhanhao Zhao , Zhouyu Wang , Wei Lu , Guodong Jin , Dong Wen , Xiaoyong Du

Approximate nearest neighbor search (ANNS) is a key retrieval technique for vector database and many data center applications, such as person re-identification and recommendation systems. It is also fundamental to retrieval augmented…

Hardware Architecture · Computer Science 2024-05-30 Yitu Wang , Shiyu Li , Qilin Zheng , Linghao Song , Zongwang Li , Andrew Chang , Hai "Helen" Li , Yiran Chen

Graph-based approximate nearest neighbor search (ANNS) algorithms work effectively against large-scale vector retrieval. Among such methods, DiskANN achieves good recall-speed tradeoffs using both DRAM and storage. DiskANN adopts product…

Information Retrieval · Computer Science 2025-02-27 Kento Tatsuno , Daisuke Miyashita , Taiga Ikeda , Kiyoshi Ishiyama , Kazunari Sumiyoshi , Jun Deguchi

Approximate nearest-neighbor search (ANNS) algorithms are a key part of the modern deep learning stack due to enabling efficient similarity search over high-dimensional vector space representations (i.e., embeddings) of data. Among various…

Information Retrieval · Computer Science 2024-02-09 Magdalen Dobson Manohar , Zheqi Shen , Guy E. Blelloch , Laxman Dhulipala , Yan Gu , Harsha Vardhan Simhadri , Yihan Sun

Approximate nearest neighbor search (ANNS) plays an indispensable role in a wide variety of applications, including recommendation systems, information retrieval, and semantic search. Among the cutting-edge ANNS algorithms, graph-based…

Hardware Architecture · Computer Science 2026-03-31 Weihong Xu , Junwei Chen , Po-Kai Hsu , Jaeyoung Kang , Minxuan Zhou , Sumukh Pinge , Shimeng Yu , Tajana Rosing

Motivated by the need to extract knowledge and value from interconnected data, graph analytics on big data is a very active area of research in both industry and academia. To support graph analytics efficiently a large number of in memory…

Graph neural networks (GNNs) have achieved breakthroughs in various real-world downstream tasks due to their powerful expressiveness. As the scale of real-world graphs has been continuously growing, a storage-based approach to GNN training…

Machine Learning · Computer Science 2026-01-07 Myung-Hwan Jang , Jeong-Min Park , Yunyong Ko , Sang-Wook Kim

Approximate nearest neighbor search (ANNS) has emerged as a crucial component of database and AI infrastructure. Ever-increasing vector datasets pose significant challenges in terms of performance, cost, and accuracy for ANNS services. None…

Information Retrieval · Computer Science 2024-10-02 Bing Tian , Haikun Liu , Yuhang Tang , Shihai Xiao , Zhuohui Duan , Xiaofei Liao , Xuecang Zhang , Junhua Zhu , Yu Zhang

Similarity-based vector search underpins many important applications, but a key challenge is processing massive vector datasets (e.g., in TBs). To reduce costs, some systems utilize SSDs as the primary data storage. They employ a proximity…

Databases · Computer Science 2025-08-22 Peiqi Yin , Xiao Yan , Qihui Zhou , Hui Li , Xiaolu Li , Lin Zhang , Meiling Wang , Xin Yao , James Cheng

Nearest neighbor search plays a fundamental role in many disciplines such as multimedia information retrieval, data-mining, and machine learning. The graph-based search approaches show superior performance over other types of approaches in…

Information Retrieval · Computer Science 2022-04-05 Hui Wang , Yong Wang , Wan-Lei Zhao