English
Related papers

Related papers: Efficient Nearest Neighbor based Uncertainty Estim…

200 papers

Nearest neighbor (NN) sampling provides more semantic variations than pre-defined transformations for self-supervised learning (SSL) based image recognition problems. However, its performance is restricted by the quality of the support set,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Momojit Biswas , Himanshu Buckchash , Dilip K. Prasad

Modern machine learning models are often trained on examples with noisy labels that hurt performance and are hard to identify. In this paper, we provide an empirical study showing that a simple $k$-nearest neighbor-based filtering approach…

Machine Learning · Computer Science 2020-04-28 Dara Bahri , Heinrich Jiang , Maya Gupta

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

This paper proposes a soft range limited K nearest neighbours (SRL-KNN) localization fingerprinting algorithm. The conventional KNN determines the neighbours of a user by calculating and ranking the fingerprint distance measured at the…

Signal Processing · Electrical Eng. & Systems 2022-11-09 Minh Tu Hoang , Yizhou Zhu , Brosnan Yuen , Tyler Reese , Xiaodai Dong , Tao Lu , Robert Westendorp , Michael Xie

Nearest neighbors is a successful and long-standing technique for anomaly detection. Significant progress has been recently achieved by self-supervised deep methods (e.g. RotNet). Self-supervised features however typically under-perform…

Machine Learning · Computer Science 2020-02-25 Liron Bergman , Niv Cohen , Yedid Hoshen

Researchers have proposed several approaches for neural network (NN) based uncertainty quantification (UQ). However, most of the approaches are developed considering strong assumptions. Uncertainty quantification algorithms often perform…

Accurately estimating uncertainties in neural network predictions is of great importance in building trusted DNNs-based models, and there is an increasing interest in providing accurate uncertainty estimation on many tasks, such as security…

Machine Learning · Computer Science 2020-07-14 Yukun Ding , Jinglan Liu , Jinjun Xiong , Yiyu Shi

Non-autoregressive (NAR) models can generate sentences with less computation than autoregressive models but sacrifice generation quality. Previous studies addressed this issue through iterative decoding. This study proposes using nearest…

Computation and Language · Computer Science 2022-08-29 Ayana Niwa , Sho Takase , Naoaki Okazaki

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do…

Machine Learning · Computer Science 2023-02-21 Romit Maulik , Romain Egele , Krishnan Raghavan , Prasanna Balaprakash

k-Nearest-Neighbor Machine Translation (kNN-MT) has been recently proposed as a non-parametric solution for domain adaptation in neural machine translation (NMT). It aims to alleviate the performance degradation of advanced MT systems in…

Computation and Language · Computer Science 2022-05-04 Dexin Wang , Kai Fan , Boxing Chen , Deyi Xiong

k-nearest neighbour (kNN) is one of the most prominent, simple and basic algorithm used in machine learning and data mining. However, kNN has limited prediction ability, i.e., kNN cannot predict any instance correctly if it does not belong…

Machine Learning · Computer Science 2020-03-03 Muhammad Asim , Muaaz Zakria

K-nearest neighbor classification algorithm is one of the most basic algorithms in machine learning, which determines the sample's category by the similarity between samples. In this paper, we propose a quantum K-nearest neighbor…

Quantum Physics · Physics 2023-04-03 Jing Li , Song Lin , Yu Kai , Gongde Guo

In this paper, we present an overview of Nearest neighbor (NN) methods, which are frequently employed for solving classification problems using supervised learning. The article concisely introduces the theoretical background, algorithmic,…

Networking and Internet Architecture · Computer Science 2021-07-19 Syed Ali Raza Zaidi

In this paper, we revisit techniques for uncertainty estimation within deep neural networks and consolidate a suite of techniques to enhance their reliability. Our investigation reveals that an integrated application of diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Yuting Li , Yingyi Chen , Xuanlong Yu , Dexiong Chen , Xi Shen

In many applications with real-world consequences, it is crucial to develop reliable uncertainty estimation for the predictions made by the AI decision systems. Targeting at the goal of estimating uncertainty, various deep neural network…

Machine Learning · Computer Science 2022-10-13 Huimin Zeng , Zhenrui Yue , Yang Zhang , Ziyi Kou , Lanyu Shang , Dong Wang

A $k$-nearest neighbor ($k$NN) query determines the $k$ nearest points, using distance metrics, from a specific location. An all $k$-nearest neighbor (A$k$NN) query constitutes a variation of a $k$NN query and retrieves the $k$ nearest…

Databases · Computer Science 2014-02-28 Nikolaos Nodarakis , Spyros Sioutas , Dimitrios Tsoumakos , Giannis Tzimas , Evaggelia Pitoura

We study statistical properties of the k-nearest neighbors algorithm for multiclass classification, with a focus on settings where the number of classes may be large and/or classes may be highly imbalanced. In particular, we consider a…

Machine Learning · Statistics 2020-05-05 Justin Khim , Ziyu Xu , Shashank Singh

The problem of finding K-nearest neighbors in the given dataset for a given query point has been worked upon since several years. In very high dimensional spaces the K-nearest neighbor search (KNNS) suffers in terms of complexity in…

Machine Learning · Computer Science 2021-02-15 Pramod Vadiraja , Christoph Peter Balada

Evidential deep learning (EDL) has shown remarkable success in uncertainty estimation. However, there is still room for improvement, particularly in out-of-distribution (OOD) detection and classification tasks. The limited OOD detection…

Machine Learning · Computer Science 2025-10-15 Taeseong Yoon , Heeyoung Kim

k-nearest-neighbor machine translation (NN-MT), proposed by Khandelwal et al. (2021), has achieved many state-of-the-art results in machine translation tasks. Although effective, NN-MT requires conducting NN searches through the large…

Computation and Language · Computer Science 2022-05-03 Zhixian Yang , Renliang Sun , Xiaojun Wan