English
Related papers

Related papers: Nearest Neighbor Search Under Uncertainty

200 papers

A recent series of papers by Andoni, Naor, Nikolov, Razenshteyn, and Waingarten (STOC 2018, FOCS 2018) has given approximate near neighbour search (NNS) data structures for a wide class of distance metrics, including all norms. In…

Data Structures and Algorithms · Computer Science 2021-05-12 Deepanshu Kush , Aleksandar Nikolov , Haohua Tang

We consider the problem of learning the nearest neighbor graph of a dataset of n items. The metric is unknown, but we can query an oracle to obtain a noisy estimate of the distance between any pair of items. This framework applies to…

Machine Learning · Statistics 2019-06-03 Blake Mason , Ardhendu Tripathy , Robert Nowak

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Biased sampling and missing data complicates statistical problems ranging from causal inference to reinforcement learning. We often correct for biased sampling of summary statistics with matching methods and importance weighting. In this…

Statistics Theory · Mathematics 2022-06-02 James Sharpnack

The nearest neighbor (NN) technique is very simple, highly efficient and effective in the field of pattern recognition, text categorization, object recognition etc. Its simplicity is its main advantage, but the disadvantages can't be…

Computer Vision and Pattern Recognition · Computer Science 2010-07-02 Nitin Bhatia , Vandana

As open-ended learning based on divergent search algorithms such as Novelty Search (NS) draws more and more attention from the research community, it is natural to expect that its application to increasingly complex real-world problems will…

Artificial Intelligence · Computer Science 2021-04-09 Achkan Salehi , Alexandre Coninx , Stephane Doncieux

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantages and…

Machine Learning · Computer Science 2017-03-01 Daniel Zoran , Balaji Lakshminarayanan , Charles Blundell

We present a new approach to approximate nearest-neighbor queries in fixed dimension under a variety of non-Euclidean distances. We are given a set $S$ of $n$ points in $\mathbb{R}^d$, an approximation parameter $\varepsilon > 0$, and a…

Computational Geometry · Computer Science 2023-06-28 Ahmed Abdelkader , Sunil Arya , Guilherme D. da Fonseca , David M. Mount

Neural Networks (NNs) are the method of choice for building learning algorithms. Their popularity stems from their empirical success on several challenging learning problems. However, most scholars agree that a convincing theoretical…

Numerical Analysis · Mathematics 2021-01-01 Ronald DeVore , Boris Hanin , Guergana Petrova

KNN has the reputation to be the word simplest but efficient supervised learning algorithm used for either classification or regression. KNN prediction efficiency highly depends on the size of its training data but when this training data…

Machine Learning · Computer Science 2021-07-01 Jude Tchaye-Kondi , Yanlong Zhai , Liehuang Zhu

Nearest neighbor (NN) queries in trajectory databases have received significant attention in the past, due to their application in spatio-temporal data analysis. Recent work has considered the realistic case where the trajectories are…

Fast approximate nearest neighbor (NN) search in large databases is becoming popular. Several powerful learning-based formulations have been proposed recently. However, not much attention has been paid to a more fundamental question: how…

Machine Learning · Computer Science 2012-07-03 Junfeng He , Sanjiv Kumar , Shih-Fu Chang

Large-scale approximate nearest neighbor search (ANN) has been gaining attention along with the latest machine learning researches employing ANNs. If the data is too large to fit in memory, it is necessary to search for the most similar…

Machine Learning · Computer Science 2025-01-29 Taiga Ikeda , Daisuke Miyashita , Jun Deguchi

Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Anthony Cazasnoves , Pierre-Antoine Ganaye , Kévin Sanchis , Tugdual Ceillier

We introduce a new variant of the nearest neighbor search problem, which allows for some coordinates of the dataset to be arbitrarily corrupted or unknown. Formally, given a dataset of $n$ points $P=\{ x_1,\ldots, x_n\}$ in high-dimensions,…

Computational Geometry · Computer Science 2015-11-24 Sariel Har-Peled , Sepideh Mahabadi

Approximate K nearest neighbor (AKNN) search is a fundamental and challenging problem. We observe that in high-dimensional space, the time consumption of nearly all AKNN algorithms is dominated by that of the distance comparison operations…

Data Structures and Algorithms · Computer Science 2023-03-20 Jianyang Gao , Cheng Long

The approximate nearest neighbor (ANN) search problem is fundamental to efficiently serving many real-world machine learning applications. A number of techniques have been developed for ANN search that are efficient, accurate, and scalable.…

Machine Learning · Computer Science 2023-02-23 Philip Sun , Ruiqi Guo , Sanjiv Kumar

Nearest neighbor search is a problem of finding the data points from the database such that the distances from them to the query point are the smallest. Learning to hash is one of the major solutions to this problem and has been widely…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Jingdong Wang , Ting Zhang , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Sparse embeddings of data form an attractive class due to their inherent interpretability: Every dimension is tied to a term in some vocabulary, making it easy to visually decipher the latent space. Sparsity, however, poses unique…

Data Structures and Algorithms · Computer Science 2025-09-30 Sebastian Bruch , Franco Maria Nardini , Cosimo Rulli , Rossano Venturini

Network spaces have been known as a critical factor in both handcrafted network designs or defining search spaces for Neural Architecture Search (NAS). However, an effective space involves tremendous prior knowledge and/or manual effort,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Min-Fong Hong , Hao-Yun Chen , Min-Hung Chen , Yu-Syuan Xu , Hsien-Kai Kuo , Yi-Min Tsai , Hung-Jen Chen , Kevin Jou