English
Related papers

Related papers: Transductive Confidence Machine and its applicatio…

200 papers

Over the past decade, convolutional neural networks (CNN) have shown very competitive performance in medical image analysis tasks, such as disease classification, tumor segmentation, and lesion detection. CNN has great advantages in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Yin Dai , Yifan Gao

Nearest neighbor machine translation is a successful approach for fast domain adaption, which interpolates the pre-trained transformers with domain-specific token-level k-nearest-neighbor (kNN) retrieval without retraining. Despite kNN MT's…

Artificial Intelligence · Computer Science 2024-08-20 Hossam Amer , Abdelrahman Abouelenin , Mohamed Maher , Evram Narouz , Mohamed Afify , Hany Awadallah

We propose a linear-complexity method for sampling from truncated multivariate normal (TMVN) distributions with high fidelity by applying nearest-neighbor approximations to a product-of-conditionals decomposition of the TMVN density. To…

Computation · Statistics 2024-06-26 Jian Cao , Matthias Katzfuss

We introduce $k$-nearest-neighbor machine translation ($k$NN-MT), which predicts tokens with a nearest neighbor classifier over a large datastore of cached examples, using representations from a neural translation model for similarity…

Computation and Language · Computer Science 2021-07-23 Urvashi Khandelwal , Angela Fan , Dan Jurafsky , Luke Zettlemoyer , Mike Lewis

In this paper, we present an overview of Nearest neighbor (NN) methods, which are frequently employed for solving classification problems using supervised learning. The article concisely introduces the theoretical background, algorithmic,…

Networking and Internet Architecture · Computer Science 2021-07-19 Syed Ali Raza Zaidi

Probabilistic k-nearest neighbour (PKNN) classification has been introduced to improve the performance of original k-nearest neighbour (KNN) classification algorithm by explicitly modelling uncertainty in the classification of each feature…

Machine Learning · Computer Science 2013-05-07 Ji Won Yoon , Nial Friel

Large margin nearest neighbor (LMNN) is a metric learner which optimizes the performance of the popular $k$NN classifier. However, its resulting metric relies on pre-selected target neighbors. In this paper, we address the feasibility of…

Data Structures and Algorithms · Computer Science 2018-05-03 Babak Hosseini , Barbara Hammer

The support vector machine (SVM) and deep learning (e.g., convolutional neural networks (CNNs)) are the two most famous algorithms in small and big data, respectively. Nonetheless, smaller datasets may be very important, costly, and not…

Machine Learning · Computer Science 2020-02-19 Wei-Chang Yeh

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

The k-nearest neighbors (k-NN) is a basic machine learning (ML) algorithm, and several quantum versions of it, employing different distance metrics, have been presented in the last few years. Although the Euclidean distance is one of the…

Emerging Technologies · Computer Science 2024-04-25 Enrico Zardini , Enrico Blanzieri , Davide Pastorello

K-Nearest Neighbours (k-NN) is a popular classification and regression algorithm, yet one of its main limitations is the difficulty in choosing the number of neighbours. We present a Bayesian algorithm to compute the posterior probability…

Machine Learning · Computer Science 2017-06-05 Giuseppe Nuti

The problem of nearest-neighbor (NN) condensation aims to reduce the size of a training set of a nearest-neighbor classifier while maintaining its classification accuracy. Although many condensation techniques have been proposed, few bounds…

Computational Geometry · Computer Science 2019-04-30 Alejandro Flores-Velazco , David Mount

Convolutional Neural Networks (CNNs) have revolutionized performances in several machine learning tasks such as image classification, object tracking, and keyword spotting. However, given that they contain a large number of parameters,…

Image and Video Processing · Electrical Eng. & Systems 2019-03-28 Taruna Agrawal , Rahul Gupta , Shrikanth Narayanan

The nearest-neighbor rule is a well-known classification technique that, given a training set P of labeled points, classifies any unlabeled query point with the label of its closest point in P. The nearest-neighbor condensation problem aims…

Computational Geometry · Computer Science 2020-06-30 Alejandro Flores-Velazco

The k-Nearest Neighbors (kNN) classifier is a fundamental non-parametric machine learning algorithm. However, it is well known that it suffers from the curse of dimensionality, which is why in practice one often applies a kNN classifier on…

Machine Learning · Computer Science 2020-10-16 Luka Rimanic , Cedric Renggli , Bo Li , Ce Zhang

Deep learning has demonstrated abilities to learn complex structures, but they can be restricted by available data. Recently, Consensus Networks (CNs) were proposed to alleviate data sparsity by utilizing features from multiple modalities,…

Machine Learning · Computer Science 2018-11-20 Zining Zhu , Jekaterina Novikova , Frank Rudzicz

The nearest neighbor (NN) technique is very simple, highly efficient and effective in the field of pattern recognition, text categorization, object recognition etc. Its simplicity is its main advantage, but the disadvantages can't be…

Computer Vision and Pattern Recognition · Computer Science 2010-07-02 Nitin Bhatia , Vandana

$K$-NN classifier is one of the most famous classification algorithms, whose performance is crucially dependent on the distance metric. When we consider the distance metric as a parameter of $K$-NN, learning an appropriate distance metric…

Machine Learning · Computer Science 2019-11-26 Kun Song

Despite their power, Transformers face challenges with long sequences due to the quadratic complexity of self-attention. To address this limitation, methods like $k$-Nearest-Neighbor ($k$NN) attention have been introduced [Roy, Saffar,…

Machine Learning · Computer Science 2024-11-11 Themistoklis Haris

The ability to detect intent in dialogue systems has become increasingly important in modern technology. These systems often generate a large amount of unlabeled data, and manually labeling this data requires substantial human effort.…

Machine Learning · Computer Science 2023-10-19 Nicholas Botzer , David Vasquez , Tim Weninger , Issam Laradji