English
Related papers

Related papers: Efficient Algorithms for Adversarially Robust Appr…

200 papers

Motivated by applications in computer vision and databases, we introduce and study the Simultaneous Nearest Neighbor Search (SNN) problem. Given a set of data points, the goal of SNN is to design a data structure that, given a collection of…

Data Structures and Algorithms · Computer Science 2016-04-11 Piotr Indyk , Robert Kleinberg , Sepideh Mahabadi , Yang Yuan

Approximate nearest-neighbor search is a fundamental algorithmic problem that continues to inspire study due its essential role in numerous contexts. In contrast to most prior work, which has focused on point sets, we consider…

Computational Geometry · Computer Science 2021-04-01 Ahmed Abdelkader , David M. Mount

The k-nearest neighbors (kNN) algorithm is a cornerstone of non-parametric classification in artificial intelligence, yet its deployment in large-scale applications is persistently constrained by the computational trade-off between…

Machine Learning · Computer Science 2026-01-26 Jiaye Li , Gang Chen , Hang Xu , Shichao Zhang

Filtered approximate nearest neighbor search (ANNS) restricts the search to data objects whose attributes satisfy a given filter and retrieves the top-$K$ objects that are most semantically similar to the query object. Many graph-based ANNS…

Databases · Computer Science 2025-11-04 Tianming Wu , Dixin Tang

The problem of landmark recognition has achieved excellent results in small-scale datasets. When dealing with large-scale retrieval, issues that were irrelevant with small amount of data, quickly become fundamental for an efficient…

Computer Vision and Pattern Recognition · Computer Science 2018-06-18 Federico Magliani , Tomaso Fontanini , Andrea Prati

Exact nearest neighbor search is a computationally intensive process, and even its simpler sibling -- vector retrieval -- can be computationally complex. This is exacerbated when retrieving vectors which have high-dimension $d$ relative to…

Computation and Language · Computer Science 2024-05-08 Richard Zhu

Approximate Nearest Neighbor Search (ANNS), as the core of vector databases (VectorDBs), has become widely used in modern AI and ML systems, powering applications from information retrieval to bio-informatics. While graph-based ANNS methods…

Machine Learning · Computer Science 2025-10-07 Dingyi Kang , Dongming Jiang , Hanshen Yang , Hang Liu , Bingzhe Li

Approximate Nearest Neighbor Search (ANNS) is fundamental to modern AI applications. Most existing solutions optimize query efficiency but fail to align with the practical requirements of modern workloads. In this paper, we outline six…

Information Retrieval · Computer Science 2026-03-10 Kejing Lu , Zhenpeng Pan , Jianbin Qin , Yoshiharu Ishikawa , Chuan Xiao

Networks are ubiquitous in the real world. Link prediction, as one of the key problems for network-structured data, aims to predict whether there exists a link between two nodes. The traditional approaches are based on the explicit…

Machine Learning · Computer Science 2021-06-01 Wei Wu , Bin Li , Chuan Luo , Wolfgang Nejdl

Nearest-neighbor query processing is a fundamental operation for many image retrieval applications. Often, images are stored and represented by high-dimensional vectors that are generated by feature-extraction algorithms. Since tree-based…

Databases · Computer Science 2019-12-17 Omid Jafari , Khandker Mushfiqul Islam , Parth Nagarkar

Approximate nearest neighbor search (ANNS) is a fundamental problem in vector databases and AI infrastructures. Recent graph-based ANNS algorithms have achieved high search accuracy with practical efficiency. Despite the advancements, these…

Graph-based approaches to nearest neighbor search are popular and powerful tools for handling large datasets in practice, but they have limited theoretical guarantees. We study the worst-case performance of recent graph-based approximate…

Data Structures and Algorithms · Computer Science 2023-10-31 Piotr Indyk , Haike Xu

Proximity graph-based methods have emerged as a leading paradigm for approximate nearest neighbor (ANN) search in the system community. This paper presents fresh insights into the theoretical foundation of these methods. We describe an…

Data Structures and Algorithms · Computer Science 2025-09-10 Shangqi Lu , Yufei Tao

Despite a large amount of attention on adversarial examples, very few works have demonstrated an effective defense against this threat. We examine Deep k-Nearest Neighbor (DkNN), a proposed defense that combines k-Nearest Neighbor (kNN) and…

Cryptography and Security · Computer Science 2019-03-21 Chawin Sitawarin , David Wagner

Approximate Nearest Neighbor Search (ANNS) is a core primitive in modern AI systems, and graph-based methods currently offer the best accuracy-efficiency trade-off at scale. The workload is fundamentally memory-bound: graph traversal…

Hardware Architecture · Computer Science 2026-05-26 Sitian Chen , Yusen Li , Yao Chen , Minwen Deng , Jintao Meng , Amelie Chi Zhou

We present a geometric framework for filtered approximate nearest neighbor (ANN) search. Filtering a proximity graph by a metadata predicate produces a subgraph, a fiber, whose connectivity and geometry can differ sharply from the full…

Databases · Computer Science 2026-04-02 Thuong Dang

Filtered approximate nearest neighbor search (FANNS), an extension of approximate nearest neighbor search (ANNS) that incorporates scalar filters, has been widely applied to constrained retrieval of vector data. Despite its growing…

Databases · Computer Science 2025-05-13 Yanjun Lin , Kai Zhang , Zhenying He , Yinan Jing , X. Sean Wang

We study the problem of approximating Hamming distance in sublinear time under property-preserving hashing (PPH), where only hashed representations of inputs are available. Building on the threshold evaluation framework of Fleischhacker,…

Computational Complexity · Computer Science 2025-03-25 Dongfang Zhao

Approximate nearest neighbor search (ANNS) is essential for applications like recommendation systems and retrieval-augmented generation (RAG) but is highly I/O-intensive and memory-demanding. CPUs face I/O bottlenecks, while GPUs are…

Performance · Computer Science 2025-08-27 Mingkai Chen , Tianhua Han , Cheng Liu , Shengwen Liang , Kuai Yu , Lei Dai , Ziming Yuan , Ying Wang , Lei Zhang , Huawei Li , Xiaowei Li

The non-convexity of the artificial neural network (ANN) training landscape brings inherent optimization difficulties. While the traditional back-propagation stochastic gradient descent (SGD) algorithm and its variants are effective in…

Machine Learning · Computer Science 2025-06-18 Yatong Bai , Tanmay Gautam , Somayeh Sojoudi