English
Related papers

Related papers: Efficient Sketching and Nearest Neighbor Search Al…

200 papers

Let $k$ be a nonnegative integer. In the approximate $k$-flat nearest neighbor ($k$-ANN) problem, we are given a set $P \subset \mathbb{R}^d$ of $n$ points in $d$-dimensional space and a fixed approximation factor $c > 1$. Our goal is to…

Computational Geometry · Computer Science 2014-11-07 Wolfgang Mulzer , Huy L. Nguyen , Paul Seiferth , Yannik Stein

Approximate K Nearest Neighbor (AKNN) search in high-dimensional spaces is a critical yet challenging problem. In AKNN search, distance computation is the core task that dominates the runtime. Existing approaches typically use approximate…

Databases · Computer Science 2025-01-20 Mingyu Yang , Wentao Li , Jiabao Jin , Xiaoyao Zhong , Xiangyu Wang , Zhitao Shen , Wei Jia , Wei Wang

We consider the problem of recovering clustered sparse signals with no prior knowledge of the sparsity pattern. Beyond simple sparsity, signals of interest often exhibits an underlying sparsity pattern which, if leveraged, can improve the…

Information Theory · Computer Science 2016-01-05 Xiangming Meng , Sheng Wu , Linling Kuang , Defeng , Huang , Jianhua Lu

Maximum Inner Product Search or top-k retrieval on sparse vectors is well-understood in information retrieval, with a number of mature algorithms that solve it exactly. However, all existing algorithms are tailored to text and…

Information Retrieval · Computer Science 2023-07-19 Sebastian Bruch , Franco Maria Nardini , Amir Ingber , Edo Liberty

Approximate Nearest Neighbor Search (ANNS) in high-dimensional Euclidean spaces is a fundamental problem with broad applications. Subspace Collision is a newly proposed ANNS framework that provides a novel paradigm for similarity search and…

Databases · Computer Science 2026-03-27 Jiuqi Wei , Zhenyu Liao , Ruoyu Han , Quanqing Xu , Chuanhui Yang , Themis Palpanas

Calculation of near-neighbor interactions among high dimensional, irregularly distributed data points is a fundamental task to many graph-based or kernel-based machine learning algorithms and applications. Such calculations, involving…

This paper proposes a binarization scheme for vectors of high dimension based on the recent concept of anti-sparse coding, and shows its excellent performance for approximate nearest neighbor search. Unlike other binarization schemes, this…

Computer Vision and Pattern Recognition · Computer Science 2011-10-27 Hervé Jégou , Teddy Furon , Jean-Jacques Fuchs

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

The ongoing Big Data explosion has created a demand for efficient and scalable algorithms for similarity search. Most recent work has focused on \textit{approximate} $k$-NN search, and while this may be sufficient for some applications,…

Data Structures and Algorithms · Computer Science 2025-01-28 Morgan E. Prior , Thomas J. Howard , Oliver McLaughlin , Terrence Ferguson , Najib Ishaq , Noah M. Daniels

Approximate Nearest Neighbor Search (ANNS) is now widely used in various applications, ranging from information retrieval, question answering, and recommendation, to search for similar high-dimensional vectors. As the amount of vector data…

Information Retrieval · Computer Science 2024-10-21 Yuming Xu , Hengyu Liang , Jin Li , Shuotao Xu , Qi Chen , Qianxi Zhang , Cheng Li , Ziyue Yang , Fan Yang , Yuqing Yang , Peng Cheng , Mao Yang

Approximate nearest neighbour (ANN) search is one of the most important problems in computer science fields such as data mining or computer vision. In this paper, we focus on ANN for high-dimensional binary vectors and we propose a simple…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Michal Komorowski , Tomasz Trzcinski

Approximate Nearest Neighbor Search (ANNS) plays a critical role in various disciplines spanning data mining and artificial intelligence, from information retrieval and computer vision to natural language processing and recommender systems.…

Data Structures and Algorithms · Computer Science 2024-07-10 Hiroyuki Ootomo , Akira Naruse , Corey Nolet , Ray Wang , Tamas Feher , Yong Wang

We propose a new algorithm for the fast solution of large, sparse, symmetric positive-definite linear systems, spaND -- sparsified Nested Dissection. It is based on nested dissection, sparsification and low-rank compression. After…

Numerical Analysis · Mathematics 2020-01-28 Léopold Cambier , Chao Chen , Erik G Boman , Sivasankaran Rajamanickam , Raymond S. Tuminaro , Eric Darve

State-of-the-art algorithms for Approximate Nearest Neighbor Search (ANNS) such as DiskANN, FAISS-IVF, and HNSW build data dependent indices that offer substantially better accuracy and search efficiency over data-agnostic indices by…

Machine Learning · Computer Science 2022-12-01 Shikhar Jaiswal , Ravishankar Krishnaswamy , Ankit Garg , Harsha Vardhan Simhadri , Sheshansh Agrawal

Most conventional Neural Architecture Search (NAS) approaches are limited in that they only generate architectures without searching for the optimal parameters. While some NAS methods handle this issue by utilizing a supernet trained on a…

Machine Learning · Computer Science 2021-10-29 Wonyong Jeong , Hayeon Lee , Gun Park , Eunyoung Hyung , Jinheon Baek , Sung Ju Hwang

We show conditional hardness of Approximate Nearest Neighbor Search (ANN) under the $\ell_\infty$ norm with two simple reductions. Our first reduction shows that hardness of a special case of the Shortest Vector Problem (SVP), which…

Computational Complexity · Computer Science 2020-11-13 Young Kun Ko , Min Jae Song

The $k$-Nearest Neighbor Search ($k$-NNS) is the backbone of several cloud-based services such as recommender systems, face recognition, and database search on text and images. In these services, the client sends the query to the cloud…

Data Structures and Algorithms · Computer Science 2020-03-10 Hao Chen , Ilaria Chillotti , Yihe Dong , Oxana Poburinnaya , Ilya Razenshteyn , M. Sadegh Riazi

Nearest neighbor search is a very active field in machine learning for it appears in many application cases, including classification and object retrieval. In its canonical version, the complexity of the search is linear with both the…

Machine Learning · Computer Science 2017-07-06 Vincent Gripon , Matthias Löwe , Franck Vermet

In this work, we present a dimensionality reduction algorithm, aka. sketching, for categorical datasets. Our proposed sketching algorithm Cabin constructs low-dimensional binary sketches from high-dimensional categorical vectors, and our…

Machine Learning · Computer Science 2021-11-16 Bhisham Dev Verma , Rameshwar Pratap , Debajyoti Bera

Similarity search is a key to a variety of applications including content-based search for images and video, recommendation systems, data deduplication, natural language processing, computer vision, databases, computational biology, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-11 Vincent T. Lee , Amrita Mazumdar , Carlo C. del Mundo , Armin Alaghi , Luis Ceze , Mark Oskin