English
Related papers

Related papers: Coresets for the Nearest-Neighbor Rule

200 papers

We propose a new algorithm for fast approximate nearest neighbor search based on the properties of ordered vectors. Data vectors are classified based on the index and sign of their largest components, thereby partitioning the space in a…

Computer Vision and Pattern Recognition · Computer Science 2016-11-01 Luisa Verdoliva , Davide Cozzolino , Giovanni Poggi

We construct near-optimal coresets for kernel density estimates for points in $\mathbb{R}^d$ when the kernel is positive definite. Specifically we show a polynomial time construction for a coreset of size $O(\sqrt{d}/\varepsilon\cdot…

Machine Learning · Computer Science 2019-04-15 Jeff M. Phillips , Wai Ming Tai

Nearest neighbor methods are a popular class of nonparametric estimators with several desirable properties, such as adaptivity to different distance scales in different regions of space. Prior work on convergence rates for nearest neighbor…

Machine Learning · Computer Science 2014-07-03 Kamalika Chaudhuri , Sanjoy Dasgupta

The Correlation Clustering problem is one of the most extensively studied clustering formulations due to its wide applications in machine learning, data mining, computational biology and other areas. We consider the Correlation Clustering…

Data Structures and Algorithms · Computer Science 2025-03-04 Jianqi Zhou , Zhongyi Zhang , Jiong Guo

Conformal Prediction (CP) controls the prediction uncertainty of classification systems by producing a small prediction set, ensuring a predetermined probability that the true class lies within this set. This is commonly done by defining a…

Machine Learning · Computer Science 2025-08-14 Coby Penso , Jacob Goldberger , Ethan Fetaya

Self-supervised learning algorithms based on instance discrimination train encoders to be invariant to pre-defined transformations of the same instance. While most methods treat different views of the same image as positives for a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Debidatta Dwibedi , Yusuf Aytar , Jonathan Tompson , Pierre Sermanet , Andrew Zisserman

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems,…

The widespread use of location-aware devices has led to countless location-based services in which a user query can be arbitrarily complex, i.e., one that embeds multiple spatial selection and join predicates. Amongst these predicates, the…

Databases · Computer Science 2012-08-02 Ahmed M. Aly , Walid G. Aref , Mourad Ouzzani

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

Machine Learning · Statistics 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

In scenarios involving text classification where the number of classes is large (in multiples of 10000s) and training samples for each class are few and often verbose, nearest neighbor methods are effective but very slow in computing a…

Information Retrieval · Computer Science 2017-12-12 Gautam Singh , Gargi Dasgupta , Yu Deng

Randomized dimensionality reduction has been recognized as one of the fundamental techniques in handling high-dimensional data. Starting with the celebrated Johnson-Lindenstrauss Lemma, such reductions have been studied in depth for the…

Computational Geometry · Computer Science 2019-09-10 Ioannis Z. Emiris , Vasilis Margonis , Ioannis Psarros

Training neural networks on a large dataset requires substantial computational costs. Dataset reduction selects or synthesizes data instances based on the large dataset, while minimizing the degradation in generalization performance from…

Machine Learning · Computer Science 2023-03-09 Seungjae Shin , Heesun Bae , Donghyeok Shin , Weonyoung Joo , Il-Chul Moon

Coresets are modern data-reduction tools that are widely used in data analysis to improve efficiency in terms of running time, space and communication complexity. Our main result is a fast algorithm to construct a small coreset for k-Median…

Data Structures and Algorithms · Computer Science 2020-07-16 Vladimir Braverman , Shaofeng H. -C. Jiang , Robert Krauthgamer , Xuan Wu

K-Nearest neighbor classifier (k-NNC) is simple to use and has little design time like finding k values in k-nearest neighbor classifier, hence these are suitable to work with dynamically varying data-sets. There exists some fundamental…

Computer Vision and Pattern Recognition · Computer Science 2013-01-29 T. Hitendra Sarma , P. Viswanath , D. Sai Koti Reddy , S. Sri Raghava

Ensembles based on k nearest neighbours (kNN) combine a large number of base learners, each constructed on a sample taken from a given training data. Typical kNN based ensembles determine the k closest observations in the training data…

Machine Learning · Statistics 2023-03-23 Amjad Ali , Muhammad Hamraz , Dost Muhammad Khan , Wajdan Deebani , Zardad Khan

This paper describes a new type of auto-associative image classifier that uses a shallow architecture with a very quick learning phase. The image is parsed into smaller areas and each area is saved directly for a region, along with the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Kieran Greer

Nearest neighbor has always been one of the most appealing non-parametric approaches in machine learning, pattern recognition, computer vision, etc. Previous empirical studies partly shows that nearest neighbor is resistant to noise, yet…

Machine Learning · Computer Science 2018-09-14 Wei Gao , Bin-Bin Yang , Zhi-Hua Zhou

The Nearest subspace classifier (NSS) finds an estimation of the underlying subspace within each class and assigns data points to the class that corresponds to its nearest subspace. This paper mainly studies how well NSS can be generalized…

Machine Learning · Statistics 2015-01-27 Yi Wang

Nowadays, face recognition and more generally image recognition have many applications in the modern world and are widely used in our daily tasks. This paper aims to propose a distributed approximate nearest neighbor (ANN) method for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Aysan Aghazadeh , Maryam Amirmazlaghani

This paper presents Clustering based on Near Neighbor Influence (CNNI), a new clustering algorithm which is inspired by the idea of near neighbor and the superposition principle of influence. In order to clearly describe this algorithm, it…

Databases · Computer Science 2014-09-25 Xinquan Chen