English
Related papers

Related papers: An Efficient Algorithm for Bayesian Nearest Neighb…

200 papers

This article introduces a Bayesian neural network estimation method for quantile regression assuming an asymmetric Laplace distribution (ALD) for the response variable. It is shown that the posterior distribution for feedforward neural…

Statistics Theory · Mathematics 2022-04-06 Sanket R. Jantre , Shrijita Bhattacharya , Tapabrata Maiti

Approximate K Nearest Neighbor (AKNN) search in high-dimensional spaces is a critical yet challenging problem. In AKNN search, distance computation is the core task that dominates the runtime. Existing approaches typically use approximate…

Databases · Computer Science 2025-01-20 Mingyu Yang , Wentao Li , Jiabao Jin , Xiaoyao Zhong , Xiangyu Wang , Zhitao Shen , Wei Jia , Wei Wang

Bayesian Neural Networks (BNNs) offer robust uncertainty quantification in model predictions, but training them presents a significant computational challenge. This is mainly due to the problem of sampling multimodal posterior distributions…

Machine Learning · Computer Science 2025-01-14 Ratneel Deo , Scott Sisson , Jody M. Webster , Rohitash Chandra

In a metric space, a set of point sets of roughly the same size and an integer $k\geq 1$ are given as the input and the goal of data-distributed $k$-center is to find a subset of size $k$ of the input points as the set of centers to…

Computational Geometry · Computer Science 2023-09-11 Sepideh Aghamolaei , Mohammad Ghodsi

Approximate Bayesian Computation has been successfully used in population genetics to bypass the calculation of the likelihood. These methods provide accurate estimates of the posterior distribution by comparing the observed dataset to a…

Nearest neighbor is a popular nonparametric method for classification and regression with many appealing properties. In the big data era, the sheer volume and spatial/temporal disparity of big data may prohibit centrally processing and…

Statistics Theory · Mathematics 2018-12-13 Jiexin Duan , Xingye Qiao , Guang Cheng

This paper proposes an inexpensive way to learn an effective dissimilarity function to be used for $k$-nearest neighbor ($k$-NN) classification. Unlike Mahalanobis metric learning methods that map both query (unlabeled) objects and labeled…

Machine Learning · Computer Science 2020-08-31 Yutaro Shigeto , Masashi Shimbo , Yuji Matsumoto

The K-Nearest Neighbor (KNN) join is an expensive but important operation in many data mining algorithms. Several recent applications need to perform KNN join for high dimensional sparse data. Unfortunately, all existing KNN join algorithms…

Databases · Computer Science 2010-11-15 Jijie Wang , Lei Lin , Ting Huang , Jingjing Wang , Zengyou He

Performing exact posterior inference in complex generative models is often difficult or impossible due to an expensive to evaluate or intractable likelihood function. Approximate Bayesian computation (ABC) is an inference framework that…

Machine Learning · Statistics 2016-02-16 Jovana Mitrovic , Dino Sejdinovic , Yee Whye Teh

This paper presents a new solution for choosing the K parameter in the k-nearest neighbor (KNN) algorithm, the solution depending on the idea of ensemble learning, in which a weak KNN classifier is used each time with a different K,…

Machine Learning · Computer Science 2014-09-04 Ahmad Basheer Hassanat , Mohammad Ali Abbadi , Ghada Awad Altarawneh , Ahmad Ali Alhasanat

k-nearest neighbor (k-NN) search is a fundamental primitive in geometry processing and computer graphics. While spatial partitioning structures such as kd-trees are standard, they are often manifold-blind, failing to exploit the intrinsic…

Computational Geometry · Computer Science 2026-05-05 Pengfei Wang , Qinghao Guo , Haisen Zhao , Shiqing Xin , Shuangmin Chen , Changhe Tu , Wenping Wang

This paper proposes a soft range limited K nearest neighbours (SRL-KNN) localization fingerprinting algorithm. The conventional KNN determines the neighbours of a user by calculating and ranking the fingerprint distance measured at the…

Signal Processing · Electrical Eng. & Systems 2022-11-09 Minh Tu Hoang , Yizhou Zhu , Brosnan Yuen , Tyler Reese , Xiaodai Dong , Tao Lu , Robert Westendorp , Michael Xie

Approximate k-Nearest Neighbour (ANN) methods are often used for mining information and aiding machine learning on large scale high-dimensional datasets. ANN methods typically differ in the index structure used for accelerating searches,…

Machine Learning · Computer Science 2025-02-04 Ben Harwood , Amir Dezfouli , Iadine Chades , Conrad Sanderson

Convolutional neural networks (CNNs) work well on large datasets. But labelled data is hard to collect, and in some applications larger amounts of data are not available. The problem then is how to use CNNs with small data -- as CNNs…

Machine Learning · Statistics 2016-01-19 Yarin Gal , Zoubin Ghahramani

We introduce a framework for efficient Markov Chain Monte Carlo (MCMC) algorithms targeting discrete-valued high-dimensional distributions, such as posterior distributions in Bayesian variable selection (BVS) problems. We show that many…

Computation · Statistics 2021-10-28 Xitong Liang , Samuel Livingstone , Jim Griffin

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

In the era of Big Data, Markov chain Monte Carlo (MCMC) methods, which are currently essential for Bayesian estimation, face significant computational challenges owing to their sequential nature. To achieve a faster and more effective…

Computation · Statistics 2024-11-08 Tomoki Matsumoto

The k-means++ seeding algorithm is one of the most popular algorithms that is used for finding the initial $k$ centers when using the k-means heuristic. The algorithm is a simple sampling procedure and can be described as follows: {quote}…

Data Structures and Algorithms · Computer Science 2013-06-19 Ragesh Jaiswal , Prachi Jain , Saumya Yadav

Finding the k-medianin a network involves identifying a subset of k vertices that minimize the total distance to all other vertices in a graph. This problem has been extensively studied in computer science, graph theory, operations…

Data Structures and Algorithms · Computer Science 2023-12-14 Roldan Pozo

We consider the problem of Bayesian parameter estimation for deep neural networks, which is important in problem settings where we may have little data, and/ or where we need accurate posterior predictive densities, e.g., for applications…

Machine Learning · Computer Science 2015-11-10 Anoop Korattikara , Vivek Rathod , Kevin Murphy , Max Welling