English
Related papers

Related papers: An Efficient Algorithm for Bayesian Nearest Neighb…

200 papers

Approximate K nearest neighbor (AKNN) search is a fundamental and challenging problem. We observe that in high-dimensional space, the time consumption of nearly all AKNN algorithms is dominated by that of the distance comparison operations…

Data Structures and Algorithms · Computer Science 2023-03-20 Jianyang Gao , Cheng Long

Data valuation, the task of quantifying the contribution of individual data points to model performance, has emerged as a fundamental challenge in machine learning. Game-theoretic approaches, such as the Banzhaf value, offer principled…

Machine Learning · Computer Science 2026-05-21 Guangyi Zhang , Lutz Oettershagen , Lixu Wang , Aristides Gionis

Bayesian inference for complex models with an intractable likelihood can be tackled using algorithms performing many calls to computer simulators. These approaches are collectively known as "simulation-based inference" (SBI). Recent SBI…

K-nearest neighbors algorithm is one of the prominent techniques used in classification and regression. Despite its simplicity, the k-nearest neighbors has been successfully applied in time series forecasting. However, the selection of the…

Methodology · Statistics 2021-03-29 Samya Tajmouati , Bouazza El Wahbi , Adel Bedoui , Abdallah Abarda , Mohamed Dakkoun

$k$-nearest neighbor classification is a popular non-parametric method because of desirable properties like automatic adaption to distributional scale changes. Unfortunately, it has thus far proved difficult to design active learning…

Machine Learning · Computer Science 2023-08-22 Nick Rittler , Kamalika Chaudhuri

When data is of an extraordinarily large size or physically stored in different locations, the distributed nearest neighbor (NN) classifier is an attractive tool for classification. We propose a novel distributed adaptive NN classifier for…

Machine Learning · Statistics 2023-06-06 Ruiqi Liu , Ganggang Xu , Zuofeng Shang

We propose a simple approach which, given distributed computing resources, can nearly achieve the accuracy of $k$-NN prediction, while matching (or improving) the faster prediction time of $1$-NN. The approach consists of aggregating…

Statistics Theory · Mathematics 2017-12-25 Lirong Xue , Samory Kpotufe

We present a new method to approximate posterior probabilities of Bayesian Network using Deep Neural Network. Experiment results on several public Bayesian Network datasets shows that Deep Neural Network is capable of learning joint…

Machine Learning · Computer Science 2018-01-12 Jie Jia , Honggang Zhou , Yunchun Li

Reverse k nearest neighbor (RkNN) queries are fundamental in spatial databases, location-based analytics, and recommendation systems. Existing state-of-the-art techniques rely on spatial pruning supported by R-trees and their variants.…

Databases · Computer Science 2026-05-27 Zhengyang Bai , Peng Chen , Mohamed Wahib

Nearest neighbors (NN) are traditionally used to compute final decisions, e.g., in Support Vector Machines or k-NN classifiers, and to provide users with explanations for the model's decision. In this paper, we show a novel utility of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Giang , Nguyen , Valerie Chen , Mohammad Reza Taesiri , Anh Totti Nguyen

Existing methods for retrieving k-nearest neighbours suffer from the curse of dimensionality. We argue this is caused in part by inherent deficiencies of space partitioning, which is the underlying strategy used by most existing methods. We…

Data Structures and Algorithms · Computer Science 2017-04-07 Ke Li , Jitendra Malik

We propose Bayesian extensions of two nonparametric regression methods which are kernel and mutual $k$-nearest neighbor regression methods. Derived based on Gaussian process models for regression, the extensions provide distributions for…

Machine Learning · Computer Science 2016-08-05 Hyun-Chul Kim

k nearest neighbor join (kNN join), designed to find k nearest neighbors from a dataset S for every object in another dataset R, is a primitive operation widely adopted by many data mining applications. As a combination of the k nearest…

Databases · Computer Science 2015-03-20 Wei Lu , Yanyan Shen , Su Chen , Beng Chin Ooi

Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and…

Machine Learning · Computer Science 2024-02-06 Amartya Banerjee , Christopher J. Hazard , Jacob Beel , Cade Mack , Jack Xia , Michael Resnick , Will Goddin

Nearest neighbor (k-NN) graphs are widely used in machine learning and data mining applications, and our aim is to better understand what they reveal about the cluster structure of the unknown underlying distribution of points. Moreover, is…

Machine Learning · Statistics 2011-05-06 Samory Kpotufe , Ulrike von Luxburg

Approximate Bayesian computation (ABC) methods, which are applicable when the likelihood is difficult or impossible to calculate, are an active topic of current research. Most current ABC algorithms directly approximate the posterior…

Computation · Statistics 2012-12-10 Y. Fan , D. J. Nott , S. A. Sisson

We are in the era where the Big Data analytics has changed the way of interpreting the various biomedical phenomena, and as the generated data increase, the need for new machine learning methods to handle this evolution grows. An indicative…

Machine Learning · Computer Science 2020-12-04 Panagiotis Anagnostou , Petros T. Barmbas , Aristidis G. Vrahatis , Sotiris K. Tasoulis

The detection of change-points in heterogeneous sequences is a statistical challenge with applications across a wide variety of fields. In bioinformatics, a vast amount of methodology exists to identify an ideal set of change-points for…

Applications · Statistics 2013-01-23 The-Minh Luong , Yves Rozenholc , Gregory Nuel

Monte Carlo (MC) integration is the de facto method for approximating the predictive distribution of Bayesian neural networks (BNNs). But, even with many MC samples, Gaussian-based BNNs could still yield bad predictive performance due to…

Machine Learning · Computer Science 2022-10-18 Agustinus Kristiadi , Runa Eschenhagen , Philipp Hennig

Nearest neighbor (kNN) methods have been gaining popularity in recent years in light of advances in hardware and efficiency of algorithms. There is a plethora of methods to choose from today, each with their own advantages and…

Machine Learning · Computer Science 2017-03-01 Daniel Zoran , Balaji Lakshminarayanan , Charles Blundell