English
Related papers

Related papers: Onyx: Cost-Efficient Disk-Oblivious ANN Search

200 papers

Approximate nearest neighbor (ANN) search on SSD-backed indexes is increasingly I/O-bound (I/O accounts for 70--90\% of query latency). We present an I/O-first framework for disk-based ANN that organizes techniques along three dimensions:…

Databases · Computer Science 2026-03-24 Liang Li , Shufeng Gong , Yanan Yang , Yiduo Wang , Jie Wu

In-memory graph-based approximate nearest neighbor (ANN) search has superior search performance but incurs significant memory footprint. Disk-based methods reduce memory usage but suffer from high disk access latency. A common challenge is…

Databases · Computer Science 2026-05-08 Ziwen Song , Bin Wang , Xiaochun Yang , Junhua Zhang

Approximate nearest neighbor search (ANNS) at billion scale is fundamentally an out-of-core problem: vectors and indexes live on SSD, so performance is dominated by I/O rather than compute. Under skewed semantic embeddings, existing…

Approximate nearest neighbor search (ANNS) is essential for applications like recommendation systems and retrieval-augmented generation (RAG) but is highly I/O-intensive and memory-demanding. CPUs face I/O bottlenecks, while GPUs are…

Performance · Computer Science 2025-08-27 Mingkai Chen , Tianhua Han , Cheng Liu , Shengwen Liang , Kuai Yu , Lei Dai , Ziming Yuan , Ying Wang , Lei Zhang , Huawei Li , Xiaowei Li

Approximate Nearest Neighbor Search (ANNS) is a core primitive in modern AI systems, and graph-based methods currently offer the best accuracy-efficiency trade-off at scale. The workload is fundamentally memory-bound: graph traversal…

Hardware Architecture · Computer Science 2026-05-26 Sitian Chen , Yusen Li , Yao Chen , Minwen Deng , Jintao Meng , Amelie Chi Zhou

Meeting real-time constraints for high-performance Approximate Nearest Neighbor (ANN) search remains a critical challenge in remote sensing edge devices, which are essentially fusion systems like micro-satellites and UAVs, largely due to…

Computational Geometry · Computer Science 2025-11-24 Xianwei Lv , Debin Tang , Zhecheng Shi , Wang Wang , Yujiao Zheng , Xiatian Zhu

Approximate nearest neighbor search (ANNS) has emerged as a crucial component of database and AI infrastructure. Ever-increasing vector datasets pose significant challenges in terms of performance, cost, and accuracy for ANNS services. None…

Information Retrieval · Computer Science 2024-10-02 Bing Tian , Haikun Liu , Yuhang Tang , Shihai Xiao , Zhuohui Duan , Xiaofei Liao , Xuecang Zhang , Junhua Zhu , Yu Zhang

Approximate nearest neighbor search (ANNS) is a key retrieval technique for vector database and many data center applications, such as person re-identification and recommendation systems. It is also fundamental to retrieval augmented…

Hardware Architecture · Computer Science 2024-05-30 Yitu Wang , Shiyu Li , Qilin Zheng , Linghao Song , Zongwang Li , Andrew Chang , Hai "Helen" Li , Yiran Chen

Approximate nearest neighbor search (ANNS) has become vital to modern AI infrastructure, particularly in retrieval-augmented generation (RAG) applications. Numerous in-browser ANNS engines have emerged to seamlessly integrate with popular…

Information Retrieval · Computer Science 2025-07-03 Mugeng Liu , Siqi Zhong , Qi Yang , Yudong Han , Xuanzhe Liu , Yun Ma

Approximate Nearest Neighbor Search (ANNS), as the core of vector databases (VectorDBs), has become widely used in modern AI and ML systems, powering applications from information retrieval to bio-informatics. While graph-based ANNS methods…

Machine Learning · Computer Science 2025-10-07 Dingyi Kang , Dongming Jiang , Hanshen Yang , Hang Liu , Bingzhe Li

A major algorithmic challenge in designing applications intended for secure remote execution is ensuring that they are oblivious to their inputs, in the sense that their memory access patterns do not leak sensitive information to the…

Databases · Computer Science 2020-12-16 Simeon Krastnikov , Florian Kerschbaum , Douglas Stebila

Approximate nearest neighbor search (ANNS) plays an indispensable role in a wide variety of applications, including recommendation systems, information retrieval, and semantic search. Among the cutting-edge ANNS algorithms, graph-based…

Hardware Architecture · Computer Science 2026-03-31 Weihong Xu , Junwei Chen , Po-Kai Hsu , Jaeyoung Kang , Minxuan Zhou , Sumukh Pinge , Shimeng Yu , Tajana Rosing

The in-memory algorithms for approximate nearest neighbor search (ANNS) have achieved great success for fast high-recall search, but are extremely expensive when handling very large scale database. Thus, there is an increasing request for…

Databases · Computer Science 2021-11-17 Qi Chen , Bing Zhao , Haidong Wang , Mingqin Li , Chuanjie Liu , Zengzhong Li , Mao Yang , Jingdong Wang

Large-scale approximate nearest neighbor search (ANN) has been gaining attention along with the latest machine learning researches employing ANNs. If the data is too large to fit in memory, it is necessary to search for the most similar…

Machine Learning · Computer Science 2025-01-29 Taiga Ikeda , Daisuke Miyashita , Jun Deguchi

Approximate Nearest Neighbor Search (ANNS) is a cornerstone algorithm for information retrieval, recommendation systems, and machine learning applications. While x86-based architectures have historically dominated this domain, the…

With the advancement of information retrieval, recommendation systems, and Retrieval-Augmented Generation (RAG), Approximate Nearest Neighbor Search (ANNS) gains widespread applications due to its higher performance and accuracy. While…

Databases · Computer Science 2026-03-03 Yang Xiao , Mo Sun , Ziyu Song , Bing Tian , Jie Zhang , Jie Sun , Zeke Wang

Reducing the database space overhead is critical in big-data processing. In this paper, we revisit oblivious RAM (ORAM) using big-data standard for the database space overhead. ORAM is a cryptographic primitive that enables users to perform…

Data Structures and Algorithms · Computer Science 2018-04-24 Taku Onodera , Tetsuo Shibuya

Given a vector dataset $\mathcal{X}$ and a query vector $\vec{x}_q$, graph-based Approximate Nearest Neighbor Search (ANNS) aims to build a graph index $G$ and approximately return vectors with minimum distances to $\vec{x}_q$ by searching…

Information Retrieval · Computer Science 2023-12-01 Jiongkang Ni , Xiaoliang Xu , Yuxiang Wang , Can Li , Jiajie Yao , Shihai Xiao , Xuecang Zhang

Approximate Nearest Neighbor Search (ANNS) is a critical component of modern AI systems, such as recommendation engines and retrieval-augmented large language models (RAG-LLMs). However, scaling ANNS to billion-entry datasets exposes…

Hardware Architecture · Computer Science 2025-08-21 Sitian Chen , Amelie Chi Zhou , Yucheng Shi , Yusen Li , Xin Yao

We study the Approximate Nearest Neighbor (ANN) problem under a powerful adaptive adversary that controls both the dataset and a sequence of $Q$ queries. Primarily, for the high-dimensional regime of $d = \omega(\sqrt{Q})$, we introduce a…

Data Structures and Algorithms · Computer Science 2026-01-05 Alexandr Andoni , Themistoklis Haris , Esty Kelman , Krzysztof Onak
‹ Prev 1 2 3 10 Next ›