English
Related papers

Related papers: Adaptive kNN using Expected Accuracy for Classific…

200 papers

We provide finite-sample analysis of a general framework for using k-nearest neighbor statistics to estimate functionals of a nonparametric continuous probability density, including entropies and divergences. Rather than plugging a…

Statistics Theory · Mathematics 2016-08-23 Shashank Singh , Barnabás Póczos

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

We suggest a robust nearest-neighbor approach to classifying high-dimensional data. The method enhances sensitivity by employing a threshold and truncates to a sequence of zeros and ones in order to reduce the deleterious impact of…

Statistics Theory · Mathematics 2009-09-02 Yao-ban Chan , Peter Hall

The shift from Convolutional Neural Networks to Transformers has reshaped computer vision, yet these two architectural families are typically viewed as fundamentally distinct. We argue that convolution and self-attention, despite their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Mingi Kang , Jeová Farias Sales Rocha Neto

$k$-nearest neighbor classification is a popular non-parametric method because of desirable properties like automatic adaption to distributional scale changes. Unfortunately, it has thus far proved difficult to design active learning…

Machine Learning · Computer Science 2023-08-22 Nick Rittler , Kamalika Chaudhuri

In this technical note, we introduce and analyze AWNN: an adaptively weighted nearest neighbor method for performing matrix completion. Nearest neighbor (NN) methods are widely used in missing data problems across multiple disciplines such…

Machine Learning · Statistics 2025-05-15 Tathagata Sadhukhan , Manit Paul , Raaz Dwivedi

Pedestrian trajectory prediction is an essential component in a wide range of AI applications such as autonomous driving and robotics. Existing methods usually assume the training and testing motions follow the same pattern while ignoring…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yi Xu , Lichen Wang , Yizhou Wang , Yun Fu

Feature means countenance, remote sensing scene objects with similar characteristics, associated to interesting scene elements in the image formation process. They are classified into three types in image processing, that is low, middle and…

Computer Vision and Pattern Recognition · Computer Science 2013-07-18 T. Dharani , I. Laurence Aroquiaraj

Despite their power, Transformers face challenges with long sequences due to the quadratic complexity of self-attention. To address this limitation, methods like $k$-Nearest-Neighbor ($k$NN) attention have been introduced [Roy, Saffar,…

Machine Learning · Computer Science 2024-11-11 Themistoklis Haris

Numerous theories of failure have been postulated and implemented in various commercial programs for composite materials. Even the best theories have had limited success in predicting damage and failure in validation exercises. In view of…

Machine Learning · Computer Science 2021-06-08 Subramaniam Rajan , Bilal Khaled , Loukham Shyamsunder

In graph-based data analysis, $k$-nearest neighbor ($k$NN) graphs are widely used due to their adaptivity to local data densities. Allowing weighted edges in the graph, the kernelized graph affinity provides a more general type of $k$NN…

Machine Learning · Statistics 2026-05-21 Xiuyuan Cheng , Yixuan Tan , Nan Wu

The widespread use of location-aware devices has led to countless location-based services in which a user query can be arbitrarily complex, i.e., one that embeds multiple spatial selection and join predicates. Amongst these predicates, the…

Databases · Computer Science 2012-08-02 Ahmed M. Aly , Walid G. Aref , Mourad Ouzzani

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena

This paper proposes an inexpensive way to learn an effective dissimilarity function to be used for $k$-nearest neighbor ($k$-NN) classification. Unlike Mahalanobis metric learning methods that map both query (unlabeled) objects and labeled…

Machine Learning · Computer Science 2020-08-31 Yutaro Shigeto , Masashi Shimbo , Yuji Matsumoto

Learning graph-structured data with graph neural networks (GNNs) has been recently emerging as an important field because of its wide applicability in bioinformatics, chemoinformatics, social network analysis and data mining. Recent GNN…

Machine Learning · Computer Science 2021-12-16 Cheolhyeong Kim , Haeseong Moon , Hyung Ju Hwang

In the realm of machine learning, the KNN classification algorithm is widely recognized for its simplicity and efficiency. However, its sensitivity to the K value poses challenges, especially with small sample sizes or outliers, impacting…

Machine Learning · Computer Science 2024-05-29 Junzhuo Chen , Zhixin Lu , Shitong Kang

The problem of identifying the k-Nearest Neighbors (kNNS) of a point has proven to be very useful both as a standalone application and as a subroutine in larger applications. Given its far-reaching applicability in areas such as machine…

Machine Learning · Computer Science 2023-05-31 Vani Nagarajan , Durga Mandarapu , Milind Kulkarni

Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph…

Machine Learning · Computer Science 2018-01-11 Ruoyu Li , Sheng Wang , Feiyun Zhu , Junzhou Huang

In this paper, we propose a method, based on graph signal processing, to optimize the choice of $k$ in $k$-nearest neighbor graphs ($k$NNGs). $k$NN is one of the most popular approaches and is widely used in machine learning and signal…

Machine Learning · Computer Science 2024-01-17 Asuka Tamaru , Junya Hara , Hiroshi Higashi , Yuichi Tanaka , Antonio Ortega

We introduce a novel \textit{k}-nearest neighbor (\textit{k}-NN) regression method for joint estimation of the conditional mean and variance. The proposed algorithm preserves the computational efficiency and manifold-learning capabilities…