English
Related papers

Related papers: Adaptively-weighted Nearest Neighbors for Matrix C…

200 papers

Nearest neighbor methods are a popular class of nonparametric estimators with several desirable properties, such as adaptivity to different distance scales in different regions of space. Prior work on convergence rates for nearest neighbor…

Machine Learning · Computer Science 2014-07-03 Kamalika Chaudhuri , Sanjoy Dasgupta

Approximate Nearest neighbor search (ANNS) is fundamental and essential operation in applications from many domains, such as databases, machine learning, multimedia, and computer vision. Although many algorithms have been continuously…

Databases · Computer Science 2016-10-11 Wen Li , Ying Zhang , Yifang Sun , Wei Wang , Wenjie Zhang , Xuemin Lin

Various kinds of k-nearest neighbor (KNN) based classification methods are the bases of many well-established and high-performance pattern-recognition techniques, but both of them are vulnerable to their parameter choice. Essentially, the…

Artificial Intelligence · Computer Science 2016-12-08 Ji Feng , Qingsheng Zhu , Jinlong Huang , Lijun Yang

Nearest neighbor is a popular nonparametric method for classification and regression with many appealing properties. In the big data era, the sheer volume and spatial/temporal disparity of big data may prohibit centrally processing and…

Statistics Theory · Mathematics 2018-12-13 Jiexin Duan , Xingye Qiao , Guang Cheng

Large margin nearest neighbor (LMNN) is a metric learner which optimizes the performance of the popular $k$NN classifier. However, its resulting metric relies on pre-selected target neighbors. In this paper, we address the feasibility of…

Data Structures and Algorithms · Computer Science 2018-05-03 Babak Hosseini , Barbara Hammer

This work aims to address an open problem in data valuation literature concerning the efficient computation of Data Shapley for weighted $K$ nearest neighbor algorithm (WKNN-Shapley). By considering the accuracy of hard-label KNN with…

Data Structures and Algorithms · Computer Science 2024-01-23 Jiachen T. Wang , Prateek Mittal , Ruoxi Jia

To infer the parameters of mechanistic models with intractable likelihoods, techniques such as approximate Bayesian computation (ABC) are increasingly being adopted. One of the main disadvantages of ABC in practical situations, however, is…

Computation · Statistics 2018-08-03 Jonathan U Harrison , Ruth E Baker

Linear regression analysis focuses on predicting a numeric regressand value based on certain regressor values. In this context, k-Nearest Neighbors (k-NN) is a common non-parametric regression algorithm, which achieves efficient performance…

In contrastive self-supervised learning, positive samples are typically drawn from the same image but in different augmented views, resulting in a relatively limited source of positive samples. An effective way to alleviate this problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xianzhong Long , Chen Peng , Yun Li

A weighted directed network (WDN) is a directed graph in which each edge is associated to a unique value called weight. These networks are very suitable for modeling real-world social networks in which there is an assessment of one vertex…

Social and Information Networks · Computer Science 2020-10-01 Dong Quan Ngoc Nguyen , Lin Xing , Lizhen Lin

Approximate nearest neighbor search (ANNS) constitutes an important operation in a multitude of applications, including recommendation systems, information retrieval, and pattern recognition. In the past decade, graph-based ANNS algorithms…

Information Retrieval · Computer Science 2021-05-11 Mengzhao Wang , Xiaoliang Xu , Qiang Yue , Yuxiang Wang

The K-Nearest Neighbors (KNN) algorithm is widely used for classification and regression; however, it suffers from limitations, including the equal treatment of all samples. We propose Information-Modified KNN (IM-KNN), a novel approach…

Machine Learning · Computer Science 2025-07-11 Mohammad Ali Vahedifar , Azim Akhtarshenas , Mohammad Mohammadi Rafatpanah , Maryam Sabbaghian

Matrix completion refers to completing a low-rank matrix from a few observed elements of its entries and has been known as one of the significant and widely-used problems in recent years. The required number of observations for exact…

Information Theory · Computer Science 2021-11-02 Hamideh. Sadat Fazael Ardakani , Niloufar Rahmani , Sajad Daei

Data-driven neighborhood definitions and graph constructions are often used in machine learning and signal processing applications. k-nearest neighbor~(kNN) and $\epsilon$-neighborhood methods are among the most common methods used for…

Machine Learning · Computer Science 2023-04-18 Sarath Shekkizhar , Antonio Ortega

Graph-based algorithms have demonstrated state-of-the-art performance in the nearest neighbor search (NN-Search) problem. These empirical successes urge the need for theoretical results that guarantee the search quality and efficiency of…

Machine Learning · Computer Science 2023-03-14 Anshumali Shrivastava , Zhao Song , Zhaozhuo Xu

In one-class classification problems, only the data for the target class is available, whereas the data for the non-target class may be completely absent. In this paper, we study one-class nearest neighbour (OCNN) classifiers and their…

Machine Learning · Computer Science 2017-12-29 Shehroz S. Khan , Amir Ahmad

$k$ Nearest Neighbors ($k$NN) is one of the most widely used supervised learning algorithms to classify Gaussian distributed data, but it does not achieve good results when it is applied to nonlinear manifold distributed data, especially…

Machine Learning · Computer Science 2016-06-06 Enmei Tu , Yaqian Zhang , Lin Zhu , Jie Yang , Nikola Kasabov

The nearest neighbor (NN) technique is very simple, highly efficient and effective in the field of pattern recognition, text categorization, object recognition etc. Its simplicity is its main advantage, but the disadvantages can't be…

Computer Vision and Pattern Recognition · Computer Science 2010-07-02 Nitin Bhatia , Vandana

K-Neares Neighbors (KNN) and its variant weighted KNN (WKNN) have been explored for years in both academy and industry to provide stable and reliable performance in WiFi-based indoor positioning systems. Such algorithms estimate the…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Yinhuan Dong , Francisco Zampella , Firas Alsehly

The $k$-nearest neighbor ($k$-NN) algorithm is one of the most popular methods for nonparametric classification. However, a relevant limitation concerns the definition of the number of neighbors $k$. This parameter exerts a direct impact on…

Machine Learning · Computer Science 2024-09-10 Alexandre Luís Magalhães Levada , Frank Nielsen , Michel Ferreira Cardia Haddad