English
Related papers

Related papers: DEANN: Speeding up Kernel-Density Estimation using…

200 papers

Nowadays, face recognition and more generally image recognition have many applications in the modern world and are widely used in our daily tasks. This paper aims to propose a distributed approximate nearest neighbor (ANN) method for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Aysan Aghazadeh , Maryam Amirmazlaghani

Approximate Nearest Neighbor Search (ANNS) is a cornerstone algorithm for information retrieval, recommendation systems, and machine learning applications. While x86-based architectures have historically dominated this domain, the…

We study the Approximate Nearest Neighbor (ANN) problem under a powerful adaptive adversary that controls both the dataset and a sequence of $Q$ queries. Primarily, for the high-dimensional regime of $d = \omega(\sqrt{Q})$, we introduce a…

Data Structures and Algorithms · Computer Science 2026-01-05 Alexandr Andoni , Themistoklis Haris , Esty Kelman , Krzysztof Onak

Approximate Nearest neighbor search (ANNS) is fundamental and essential operation in applications from many domains, such as databases, machine learning, multimedia, and computer vision. Although many algorithms have been continuously…

Databases · Computer Science 2016-10-11 Wen Li , Ying Zhang , Yifang Sun , Wei Wang , Wenjie Zhang , Xuemin Lin

Kernel density estimation (KDE) has become a popular method for visual analysis in various fields, such as financial risk forecasting, crime clustering, and traffic monitoring. KDE can identify high-density areas from discrete datasets.…

Databases · Computer Science 2025-01-14 Yu Shao , Peng Cheng , Xiang Lian , Lei Chen , Wangze Ni , Xuemin Lin , Chen Zhang , Liping Wang

Fast k-Nearest Neighbor search over real-valued vector spaces (KNN) is an important algorithmic task for information retrieval and recommendation systems. We present a method for using reduced precision to represent vectors through…

Information Retrieval · Computer Science 2021-10-19 Anthony Ko , Iman Keivanloo , Vihan Lakshman , Eric Schkufza

Approximate Nearest Neighbor Search (ANNS) is a fundamental problem in many areas of machine learning and data mining. During the past decade, numerous hashing algorithms are proposed to solve this problem. Every proposed algorithm claims…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Deng Cai

Approximate Nearest Neighbors (ANN) search is a crucial task in several applications like recommender systems and information retrieval. Current state-of-the-art ANN libraries, although being performance-oriented, often lack modularity and…

Information Retrieval · Computer Science 2026-01-13 Leonardo Delfino , Domenico Erriquez , Silvio Martinico , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Conducting text retrieval in a dense learned representation space has many intriguing advantages over sparse retrieval. Yet the effectiveness of dense retrieval (DR) often requires combination with sparse retrieval. In this paper, we…

Information Retrieval · Computer Science 2020-10-22 Lee Xiong , Chenyan Xiong , Ye Li , Kwok-Fung Tang , Jialin Liu , Paul Bennett , Junaid Ahmed , Arnold Overwijk

We introduce a new nonparametric density estimator inspired by Markov Chains, and generalizing the well-known Kernel Density Estimator (KDE). Our estimator presents several benefits with respect to the usual ones and can be used…

Methodology · Statistics 2020-09-15 Andrea De Simone , Alessandro Morandini

Approximate Nearest Neighbor Search (ANNS) is a fundamental operation in vector databases, enabling efficient similarity search in high-dimensional spaces. While dense ANNS has been optimized using specialized hardware accelerators, sparse…

Databases · Computer Science 2026-01-07 Tianqi Zhang , Flavio Ponzina , Tajana Rosing

This paper studies density-based clustering of point sets. These methods use dense regions of points to detect clusters of arbitrary shapes. In particular, we study variants of density peaks clustering, a popular type of algorithm that has…

Data Structures and Algorithms · Computer Science 2025-06-04 Shangdi Yu , Joshua Engels , Yihao Huang , Julian Shun

Approximate K Nearest Neighbor (AKNN) search in high-dimensional spaces is a critical yet challenging problem. In AKNN search, distance computation is the core task that dominates the runtime. Existing approaches typically use approximate…

Databases · Computer Science 2025-01-20 Mingyu Yang , Wentao Li , Jiabao Jin , Xiaoyao Zhong , Xiangyu Wang , Zhitao Shen , Wei Jia , Wei Wang

K-nearest neighbors (KNN) is one of the earliest and most established algorithms in machine learning. For regression tasks, KNN averages the targets within a neighborhood which poses a number of challenges: the neighborhood definition is…

Machine Learning · Computer Science 2022-05-18 Youssef Nader , Leon Sixt , Tim Landgraf

This tutorial provides a gentle introduction to kernel density estimation (KDE) and recent advances regarding confidence bands and geometric/topological features. We begin with a discussion of basic properties of KDE: the convergence rate…

Methodology · Statistics 2017-09-13 Yen-Chi Chen

Approximate Nearest Neighbor Search (ANNS) is the task of finding the database vector that is closest to a given query vector. Graph-based ANNS is the family of methods with the best balance of accuracy and speed for million-scale datasets.…

Information Retrieval · Computer Science 2023-11-01 Naoki Ono , Yusuke Matsui

The k-nearest neighbors (kNN) algorithm is a cornerstone of non-parametric classification in artificial intelligence, yet its deployment in large-scale applications is persistently constrained by the computational trade-off between…

Machine Learning · Computer Science 2026-01-26 Jiaye Li , Gang Chen , Hang Xu , Shichao Zhang

Sparse embeddings of data form an attractive class due to their inherent interpretability: Every dimension is tied to a term in some vocabulary, making it easy to visually decipher the latent space. Sparsity, however, poses unique…

Data Structures and Algorithms · Computer Science 2025-09-30 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Most dynamic ensemble selection (DES) methods utilize the K-Nearest Neighbors (KNN) algorithm to estimate the competence of classifiers in a small region surrounding the query sample. However, KNN is very sensitive to the local distribution…

Machine Learning · Computer Science 2022-05-24 Reza Davtalab , Rafael M. O. Cruz , Robert Sabourin

Kernel density estimation (KDE) is integral to a range of generative and discriminative tasks in machine learning. Drawing upon tools from the multidimensional calculus of variations, we derive an optimal weight function that reduces bias…

Machine Learning · Computer Science 2023-11-07 Sangwoong Yoon , Frank C. Park , Gunsu S Yun , Iljung Kim , Yung-Kyun Noh