English
Related papers

Related papers: Weighted Distance Nearest Neighbor Condensing

200 papers

In this technical note, we introduce and analyze AWNN: an adaptively weighted nearest neighbor method for performing matrix completion. Nearest neighbor (NN) methods are widely used in missing data problems across multiple disciplines such…

Machine Learning · Statistics 2025-05-15 Tathagata Sadhukhan , Manit Paul , Raaz Dwivedi

We introduce a variant of the $k$-nearest neighbor classifier in which $k$ is chosen adaptively for each query, rather than supplied as a parameter. The choice of $k$ depends on properties of each neighborhood, and therefore may…

Machine Learning · Computer Science 2019-05-31 Akshay Balsubramani , Sanjoy Dasgupta , Yoav Freund , Shay Moran

Fast approximate nearest neighbor (NN) search in large databases is becoming popular. Several powerful learning-based formulations have been proposed recently. However, not much attention has been paid to a more fundamental question: how…

Machine Learning · Computer Science 2012-07-03 Junfeng He , Sanjiv Kumar , Shih-Fu Chang

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

Statistics Theory · Mathematics 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

We consider the problem of finding high dimensional approximate nearest neighbors. Suppose there are d independent rare features, each having its own independent statistics. A point x will have x_{i}=0 denote the absence of feature i, and…

Information Theory · Computer Science 2008-10-24 Moshe Dubiner

We consider machine learning in a comparison-based setting where we are given a set of points in a metric space, but we have no access to the actual distances between the points. Instead, we can only ask an oracle whether the distance…

Machine Learning · Statistics 2017-04-06 Siavash Haghiri , Debarghya Ghoshdastidar , Ulrike von Luxburg

Nearest neighbor (NN) matching as a tool to align data sampled from different groups is both conceptually natural and practically well-used. In a landmark paper, Abadie and Imbens (2006) provided the first large-sample analysis of NN…

Statistics Theory · Mathematics 2021-12-28 Zhexiao Lin , Peng Ding , Fang Han

We study the Approximate Nearest Neighbor problem for metric spaces where the query points are constrained to lie on a subspace of low doubling dimension, while the data is high-dimensional. We show that this problem can be solved…

Computational Geometry · Computer Science 2012-09-19 Sariel Har-Peled , Nirman Kumar

For many optimization problems it is possible to define a distance metric between problem variables that correlates with the likelihood and strength of interactions between the variables. For example, one may define a metric so that the…

Neural and Evolutionary Computing · Computer Science 2012-01-12 Martin Pelikan , Mark W. Hauschild

The article deals with the issue of modification of metric classification algorithms. In particular, it studies the algorithm k-Nearest Neighbours for its application to sequential data. A method of generalization of metric classification…

Machine Learning · Computer Science 2016-12-19 Roman Samarev , Andrey Vasnetsov , Elizaveta Smelkova

Filtered Approximate Nearest Neighbor (ANN) search retrieves the closest vectors for a query vector from a dataset. It enforces that a specified set of discrete labels $S$ for the query must be included in the labels of each retrieved…

Machine Learning · Computer Science 2025-11-07 Ananya Sutradhar , Suryansh Gupta , Ravishankar Krishnaswamy , Haiyang Xu , Aseem Rastogi , Gopal Srinivasa

Large margin nearest neighbor (LMNN) is a metric learner which optimizes the performance of the popular $k$NN classifier. However, its resulting metric relies on pre-selected target neighbors. In this paper, we address the feasibility of…

Data Structures and Algorithms · Computer Science 2018-05-03 Babak Hosseini , Barbara Hammer

Suppose $V$ is an $n$-element set where for each $x \in V$, the elements of $V \setminus \{x\}$ are ranked by their similarity to $x$. The $K$-nearest neighbor graph is a directed graph including an arc from each $x$ to the $K$ points of $V…

Combinatorics · Mathematics 2020-12-29 Jacob D. Baron , R. W. R. Darling

We present combinatorial approximation algorithms for the weighted correlation clustering problem. In this problem, we have a set of vertices and two weight values for each pair of vertices, denoting their difference and similarity. The…

Data Structures and Algorithms · Computer Science 2025-07-16 Mojtaba Ostovari , Alireza Zarei

Learning a robust classifier from a few samples remains a key challenge in machine learning. A major thrust of research has been focused on developing $k$-nearest neighbor ($k$-NN) based algorithms combined with metric learning that…

Machine Learning · Statistics 2022-02-17 Shixiang Zhu , Liyan Xie , Minghe Zhang , Rui Gao , Yao Xie

In this study, we present a novel ranking model based on learning neighborhood relationships embedded in the index space. Given a query point, conventional approximate nearest neighbor search calculates the distances to the cluster…

Information Retrieval · Computer Science 2019-05-01 Chih-Yi Chiu , Amorntip Prayoonwong , Yin-Chih Liao

We present a new approach to the calculation of measures in weighted networks, based on the translation of a weighted network into an ensemble of edges. This leads to a straightforward generalization of any measure defined on unweighted…

Statistical Mechanics · Physics 2009-07-06 S. E. Ahnert , D. Garlaschelli , T. M. Fink , G. Caldarelli

Nearest neighbor search is a basic computational tool used extensively in almost research domains of computer science specially when dealing with large amount of data. However, the use of nearest neighbor search is restricted for the…

Social and Information Networks · Computer Science 2015-11-24 Suman Saha , S. P. Ghrera

Trustworthiness in model predictions is crucial for safety-critical applications in the real world. However, deep neural networks often suffer from the issues of uncertainty estimation, such as miscalibration. In this study, we propose…

Computation and Language · Computer Science 2025-02-07 Wataru Hashimoto , Hidetaka Kamigaito , Taro Watanabe

Learning a good distance metric in feature space potentially improves the performance of the KNN classifier and is useful in many real-world applications. Many metric learning algorithms are however based on the point estimation of a…

Computer Vision and Pattern Recognition · Computer Science 2016-04-11 Dong Wang , Xiaoyang Tan